Jun 06 20:19:36.058111 ip-10-0-131-207 systemd[1]: Starting Kubernetes Kubelet... Jun 06 20:19:36.495956 ip-10-0-131-207 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:36.495956 ip-10-0-131-207 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 20:19:36.495956 ip-10-0-131-207 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:36.495956 ip-10-0-131-207 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 20:19:36.495956 ip-10-0-131-207 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:36.498959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.498877 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 20:19:36.504137 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504122 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.504137 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504136 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504140 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504144 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504147 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504151 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504155 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504159 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504162 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504165 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504168 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504171 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504174 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504176 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504179 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504181 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504184 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504187 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504189 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504192 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.504200 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504195 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504198 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504201 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504204 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504209 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504212 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504215 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504218 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504221 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504223 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504226 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504229 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504232 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504234 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504237 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504239 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504242 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504244 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504246 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.504653 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504249 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504251 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504254 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504257 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504265 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504267 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504270 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504272 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504275 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504277 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504280 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504282 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504285 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504287 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504290 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504293 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504296 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504299 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504301 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504304 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.505146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504307 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504309 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504312 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504315 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504317 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504320 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504322 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504327 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504330 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504332 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504336 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504339 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504341 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504344 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504347 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504350 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504353 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504355 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504358 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504360 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.505633 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504363 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504365 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504368 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504371 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504373 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504376 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504378 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504382 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504385 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504388 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504390 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504393 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504396 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504398 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504401 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504404 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504407 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504409 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504412 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.504415 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.506125 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505105 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505111 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505114 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505119 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505123 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505127 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505130 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505133 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505136 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505138 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505141 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505143 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505146 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505149 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505152 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505155 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505157 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505160 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505163 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505166 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.506610 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505169 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505172 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505175 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505177 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505180 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505182 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505185 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505188 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505190 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505193 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505196 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505198 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505201 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505203 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505207 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505211 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505214 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505217 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505220 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505223 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.507119 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505225 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505228 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505230 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505234 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505236 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505239 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505241 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505244 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505246 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505249 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505251 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505254 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505257 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505260 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505263 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505266 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505269 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505271 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505273 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.507614 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505276 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505280 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505283 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505286 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505289 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505291 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505294 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505297 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505301 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505303 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505306 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505308 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505311 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505314 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505316 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505319 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505321 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505324 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505327 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.508109 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505330 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505332 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505335 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505338 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505340 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505343 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505346 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505349 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505351 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505354 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505356 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505359 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505361 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505364 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505366 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505369 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505371 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505374 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505376 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505379 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.508579 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505381 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505764 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505770 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505773 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505776 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505780 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505783 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505786 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505788 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505791 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505794 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505797 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505799 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505802 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505804 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505807 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505810 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505812 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505815 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505818 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.509102 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505821 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505824 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505828 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505831 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505833 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505836 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505839 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505842 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505844 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505846 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505849 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505851 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505854 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505857 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505859 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505862 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505864 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505867 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505870 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.509586 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505872 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505875 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505878 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505880 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505883 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505886 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505889 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505891 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505894 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505897 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505899 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505902 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505905 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505907 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505910 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505912 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505915 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505919 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505922 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505925 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.510100 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505928 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505930 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505933 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505936 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505938 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505940 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505943 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505945 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505948 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505952 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505956 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505959 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505962 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505964 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505967 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505970 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505972 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505975 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505977 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.510585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505980 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505982 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505985 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505987 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505990 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505993 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505995 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.505998 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506001 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506003 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506006 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506008 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506011 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506013 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506016 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506019 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506021 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506024 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506026 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506028 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.511090 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506031 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506034 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506105 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506113 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506122 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506128 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506136 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506141 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506147 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506153 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506157 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506160 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506163 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506166 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506169 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506172 2575 flags.go:64] FLAG: --cgroup-root="" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506175 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506180 2575 flags.go:64] FLAG: --client-ca-file="" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506183 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506186 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506190 2575 flags.go:64] FLAG: --cluster-domain="" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506193 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506196 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506199 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 20:19:36.511582 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506202 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506206 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506209 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506212 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506215 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506218 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506221 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506223 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506226 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506232 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506236 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506239 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506242 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506245 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506248 2575 flags.go:64] FLAG: --enable-server="true" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506251 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506256 2575 flags.go:64] FLAG: --event-burst="100" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506259 2575 flags.go:64] FLAG: --event-qps="50" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506262 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506265 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506268 2575 flags.go:64] FLAG: --eviction-hard="" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506271 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506274 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506277 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506280 2575 flags.go:64] FLAG: --eviction-soft="" Jun 06 20:19:36.512295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506287 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506290 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506293 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506296 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506299 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506302 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506305 2575 flags.go:64] FLAG: --feature-gates="" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506308 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506311 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506315 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506318 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506321 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506324 2575 flags.go:64] FLAG: --help="false" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506327 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506330 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506333 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506338 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506341 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506344 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506347 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506350 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506353 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506355 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 20:19:36.513428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506359 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506362 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506365 2575 flags.go:64] FLAG: --kube-reserved="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506367 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506370 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506373 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506376 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506378 2575 flags.go:64] FLAG: --lock-file="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506381 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506385 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506388 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506393 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506396 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506399 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506402 2575 flags.go:64] FLAG: --logging-format="text" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506404 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506408 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506410 2575 flags.go:64] FLAG: --manifest-url="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506413 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506417 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506420 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506423 2575 flags.go:64] FLAG: --max-pods="110" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506426 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506429 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506432 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 20:19:36.514474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506436 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506439 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506443 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506446 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506452 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506455 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506458 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506461 2575 flags.go:64] FLAG: --pod-cidr="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506465 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506470 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506473 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506476 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506479 2575 flags.go:64] FLAG: --port="10250" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506482 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506485 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0761c4ee0ed67e691" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506488 2575 flags.go:64] FLAG: --qos-reserved="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506493 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506496 2575 flags.go:64] FLAG: --register-node="true" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506499 2575 flags.go:64] FLAG: --register-with-taints="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506502 2575 flags.go:64] FLAG: --registry-burst="10" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506505 2575 flags.go:64] FLAG: --registry-qps="5" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506508 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506510 2575 flags.go:64] FLAG: --reserved-memory="" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506514 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506517 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 20:19:36.515581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506520 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506523 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506525 2575 flags.go:64] FLAG: --runonce="false" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506528 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506531 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506534 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506537 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506539 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506544 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506547 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506550 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506553 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506556 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506559 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506561 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506564 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506568 2575 flags.go:64] FLAG: --system-cgroups="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506570 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506575 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506578 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506581 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506585 2575 flags.go:64] FLAG: --tls-min-version="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506588 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506592 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506594 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 20:19:36.516642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506597 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506600 2575 flags.go:64] FLAG: --v="2" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506604 2575 flags.go:64] FLAG: --version="false" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506607 2575 flags.go:64] FLAG: --vmodule="" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506611 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.506614 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506737 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506741 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506744 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506747 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506750 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506752 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506755 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506757 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506760 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506764 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506767 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506769 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506772 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506775 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506777 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.517556 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506780 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506782 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506785 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506788 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506791 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506793 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506796 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506798 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506801 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506805 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506808 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506810 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506813 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506816 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506818 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506821 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506824 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506826 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506828 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506831 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.518478 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506834 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506836 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506839 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506841 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506844 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506847 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506851 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506854 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506856 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506859 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506862 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506864 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506867 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506869 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506872 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506875 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506878 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506880 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506883 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506885 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.519268 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506888 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506891 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506894 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506898 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506901 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506904 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506907 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506909 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506912 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506914 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506917 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506919 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506922 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506924 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506927 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506930 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506932 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506935 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506939 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.519831 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506941 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506944 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506946 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506949 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506951 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506956 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506959 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506962 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506965 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506968 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506971 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506974 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506977 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506979 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506983 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506986 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506988 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506991 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506994 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.520309 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.506998 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.507001 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.507004 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.507007 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.507009 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.507012 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.507017 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.514836 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.514857 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.514885 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.514902 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.514999 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515007 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515013 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515018 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.520862 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515023 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515027 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515032 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515037 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515042 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515046 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515051 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515056 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515060 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515065 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515069 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515074 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515079 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515084 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515090 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515095 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515100 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515104 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515108 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515112 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.521251 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515117 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515121 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515125 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515130 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515134 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515149 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515154 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515158 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515162 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515166 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515171 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515175 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515179 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515184 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515188 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515192 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515197 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515201 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515205 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515209 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.521835 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515214 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515218 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515222 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515227 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515231 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515235 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515239 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515243 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515247 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515251 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515256 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515260 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515264 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515271 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515276 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515282 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515287 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515293 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515306 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.522326 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515311 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515315 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515320 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515324 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515328 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515332 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515337 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515341 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515346 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515350 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515354 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515358 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515362 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515367 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515371 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515376 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515380 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515385 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515389 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515393 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.522838 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515397 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515401 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515405 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515410 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515414 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515418 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515423 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515427 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515432 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515436 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515440 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515445 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515456 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515461 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515465 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.523438 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515470 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.515478 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515747 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515758 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515763 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515768 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515772 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515777 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515782 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515786 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515791 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515795 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515800 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515805 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515809 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:36.523830 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515813 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515818 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515822 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515826 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515832 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515836 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515840 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515845 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515849 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515853 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515857 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515862 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515866 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515870 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515875 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515887 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515892 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515896 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515900 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515904 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:36.524284 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515908 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515913 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515917 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515922 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515926 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515930 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515934 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515938 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515942 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515947 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515951 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515955 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515959 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515963 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515968 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515972 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515976 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515980 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515984 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515988 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:36.525202 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515992 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.515997 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516001 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516006 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516010 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516016 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516022 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516027 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516039 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516043 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516048 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516052 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516057 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516068 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516072 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516076 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516080 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516084 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516089 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:36.525878 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516093 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516100 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516105 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516110 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516114 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516118 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516122 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516126 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516130 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516134 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516138 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516143 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516147 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516151 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516155 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516159 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516164 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516168 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516172 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:36.526341 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516179 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516184 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516189 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516203 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516207 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516212 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516217 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:36.516221 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.516229 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.516400 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.519089 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.520649 2575 server.go:1019] "Starting client certificate rotation" Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.520795 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:19:36.526829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.520832 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:19:36.527159 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.526157 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:19:36.528122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.528105 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:19:36.541327 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.541310 2575 log.go:25] "Validated CRI v1 runtime API" Jun 06 20:19:36.543995 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.543983 2575 log.go:25] "Validated CRI v1 image API" Jun 06 20:19:36.545847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.545832 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 20:19:36.548422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.548396 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b7a10587-d6d1-40bb-bab4-3ea7e2ca8adb:/dev/nvme0n1p3 e75db2a0-f615-465b-ab19-749d39b71358:/dev/nvme0n1p4] Jun 06 20:19:36.548524 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.548420 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 20:19:36.551624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.551604 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:19:36.554121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.554006 2575 manager.go:216] Machine: {Timestamp:2026-06-06 20:19:36.55244724 +0000 UTC m=+0.363791814 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091584 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a5d117d294f98999021fd2c7fd62 SystemUUID:ec25a5d1-17d2-94f9-8999-021fd2c7fd62 BootID:dc093c4d-b74f-4db6-867e-0abe34dcdc17 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a6:69:ed:3f:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a6:69:ed:3f:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:53:ef:07:86:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 20:19:36.554121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.554110 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 20:19:36.554287 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.554211 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 20:19:36.557751 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.557727 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 20:19:36.557876 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.557753 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-207.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 20:19:36.558698 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.558689 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 20:19:36.558757 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.558714 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 20:19:36.558757 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.558722 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:19:36.559494 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.559485 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:19:36.560408 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.560398 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 20:19:36.563790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.563779 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:19:36.564080 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564069 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 20:19:36.564129 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564122 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 06 20:19:36.564173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564136 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 20:19:36.564173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564147 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 20:19:36.564173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564158 2575 kubelet.go:398] "Adding apiserver pod source" Jun 06 20:19:36.564173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564170 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 20:19:36.564687 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564675 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:19:36.564754 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.564698 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:19:36.567038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.567003 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 20:19:36.568499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.568481 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 20:19:36.568572 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.568514 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 20:19:36.569638 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569627 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569642 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569648 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569653 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569661 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569666 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569674 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 20:19:36.569681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569679 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569689 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569694 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569717 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569723 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569744 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 20:19:36.569885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.569749 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 20:19:36.573996 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.573799 2575 server.go:1268] "Started kubelet" Jun 06 20:19:36.574079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.574010 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 20:19:36.574130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.574079 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 20:19:36.574130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.573908 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 20:19:36.574767 ip-10-0-131-207 systemd[1]: Started Kubernetes Kubelet. Jun 06 20:19:36.575663 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.575633 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 20:19:36.576469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.576453 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 06 20:19:36.576921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.576905 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jt9d4" Jun 06 20:19:36.577805 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.577787 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-207.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 20:19:36.578534 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.578515 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 20:19:36.578587 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.578516 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-207.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 20:19:36.580904 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.580883 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 20:19:36.581024 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.580929 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 20:19:36.581083 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.581032 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.581083 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581040 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 20:19:36.581771 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581751 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 20:19:36.581897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581775 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 20:19:36.581897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581800 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 20:19:36.581897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581849 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 06 20:19:36.581897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.581860 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 06 20:19:36.582341 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582322 2575 factory.go:55] Registering systemd factory Jun 06 20:19:36.582437 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582372 2575 factory.go:223] Registration of the systemd container factory successfully Jun 06 20:19:36.582437 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582426 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jt9d4" Jun 06 20:19:36.582606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582593 2575 factory.go:153] Registering CRI-O factory Jun 06 20:19:36.582606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582607 2575 factory.go:223] Registration of the crio container factory successfully Jun 06 20:19:36.582693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582653 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 20:19:36.582693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582677 2575 factory.go:103] Registering Raw factory Jun 06 20:19:36.582805 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.582719 2575 manager.go:1196] Started watching for new ooms in manager Jun 06 20:19:36.583040 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.581968 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-207.ec2.internal.18b6976839cc44f7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-207.ec2.internal,UID:ip-10-0-131-207.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-207.ec2.internal,},FirstTimestamp:2026-06-06 20:19:36.573691127 +0000 UTC m=+0.385035747,LastTimestamp:2026-06-06 20:19:36.573691127 +0000 UTC m=+0.385035747,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-207.ec2.internal,}" Jun 06 20:19:36.583315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.583297 2575 manager.go:349] Starting recovery of all containers Jun 06 20:19:36.588222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.588201 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:36.591779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.591755 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.595950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.595933 2575 manager.go:354] Recovery completed Jun 06 20:19:36.600849 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.600831 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.602502 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.602480 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.602564 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.602515 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.602564 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.602531 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.603051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603038 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 20:19:36.603090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603053 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 20:19:36.603090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603072 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:19:36.603156 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603044 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.603806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603794 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.603855 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603819 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.603855 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.603831 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.604548 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.604537 2575 policy_none.go:49] "None policy: Start" Jun 06 20:19:36.604586 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.604551 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 20:19:36.604586 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.604561 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 20:19:36.605525 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.605515 2575 policy_none.go:47] "Start" Jun 06 20:19:36.640275 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640261 2575 manager.go:337] "Starting Device Plugin manager" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.640319 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640346 2575 server.go:87] "Starting device plugin registration server" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640624 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640635 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640751 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640838 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.640848 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.641345 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.641393 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.642806 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.644082 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.644114 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.644131 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 20:19:36.645753 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.644160 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 20:19:36.646237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.646102 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:36.741121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.741104 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.742205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.742190 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.742293 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.742222 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.742293 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.742236 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.742293 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.742266 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.744215 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.744195 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal"] Jun 06 20:19:36.744296 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.744250 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.744938 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.744927 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.744999 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.744954 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.744999 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.744965 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.746253 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746220 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.746347 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.746402 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746371 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.746877 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746859 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.746877 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746888 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.747026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746898 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.747026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746914 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.747026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746931 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.747026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.746941 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.748032 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.748018 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.748079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.748041 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:36.748882 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.748688 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:36.748882 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.748726 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:36.748882 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.748739 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:36.750404 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.750387 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.750467 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.750413 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-207.ec2.internal\": node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.763835 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.763820 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.772219 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.772200 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.776294 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.776280 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-207.ec2.internal\" not found" node="ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.864249 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.864222 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.883907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.883882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.883972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.883914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.883972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.883950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.964673 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:36.964647 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:36.985088 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.985144 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c0d397031f09076e54ac96b039a5d49-config\") pod \"kube-apiserver-proxy-ip-10-0-131-207.ec2.internal\" (UID: \"3c0d397031f09076e54ac96b039a5d49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.985144 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.985204 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.985204 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:36.985204 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:36.985194 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78ee8c279971671d1a011e53453b54ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal\" (UID: \"78ee8c279971671d1a011e53453b54ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:37.065345 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.065319 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.076471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.076454 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:37.081264 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.081245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:37.165597 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.165566 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.266099 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.266073 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.366651 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.366584 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.467202 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.467174 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.517864 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:37.517834 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0d397031f09076e54ac96b039a5d49.slice/crio-6b9204403b2d29c4e5ca212d2c8ee4a110affc3ca692ce56f3998aa4da1af9a6 WatchSource:0}: Error finding container 6b9204403b2d29c4e5ca212d2c8ee4a110affc3ca692ce56f3998aa4da1af9a6: Status 404 returned error can't find the container with id 6b9204403b2d29c4e5ca212d2c8ee4a110affc3ca692ce56f3998aa4da1af9a6 Jun 06 20:19:37.518426 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:37.518193 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ee8c279971671d1a011e53453b54ab.slice/crio-834733ffb37f0986d4f7df50d00b47ecd230dca6c4f6a26da8acdc2afe2b1cb4 WatchSource:0}: Error finding container 834733ffb37f0986d4f7df50d00b47ecd230dca6c4f6a26da8acdc2afe2b1cb4: Status 404 returned error can't find the container with id 834733ffb37f0986d4f7df50d00b47ecd230dca6c4f6a26da8acdc2afe2b1cb4 Jun 06 20:19:37.520310 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.520295 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 20:19:37.520438 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.520422 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:19:37.520477 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.520449 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:19:37.524066 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.524052 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:19:37.568022 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.568002 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.584843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.584816 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 20:14:36 +0000 UTC" deadline="2028-02-03 03:38:59.146171909 +0000 UTC" Jun 06 20:19:37.584843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.584840 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14551h19m21.561335102s" Jun 06 20:19:37.646958 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.646910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerStarted","Data":"834733ffb37f0986d4f7df50d00b47ecd230dca6c4f6a26da8acdc2afe2b1cb4"} Jun 06 20:19:37.647910 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:37.647891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" event={"ID":"3c0d397031f09076e54ac96b039a5d49","Type":"ContainerStarted","Data":"6b9204403b2d29c4e5ca212d2c8ee4a110affc3ca692ce56f3998aa4da1af9a6"} Jun 06 20:19:37.669047 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.669027 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.769566 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.769545 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.870089 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.870050 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:37.970718 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:37.970632 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:38.029552 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.029515 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:38.071763 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.071729 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:38.172411 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.172370 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-207.ec2.internal\" not found" Jun 06 20:19:38.173564 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.173544 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:38.181407 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.181382 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" Jun 06 20:19:38.191404 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.191342 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:19:38.192463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.192386 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" Jun 06 20:19:38.200295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.200278 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:19:38.565112 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.565078 2575 apiserver.go:52] "Watching apiserver" Jun 06 20:19:38.574895 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.574864 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 20:19:38.576197 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.576165 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-c92rl","kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l","openshift-cluster-node-tuning-operator/tuned-dg9j9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal","openshift-multus/network-metrics-daemon-8zgpn","openshift-network-diagnostics/network-check-target-m6nwq","openshift-ovn-kubernetes/ovnkube-node-qpwws","kube-system/konnectivity-agent-5m2jq","openshift-dns/node-resolver-2fznv","openshift-image-registry/node-ca-ml7q8","openshift-multus/multus-4jnxs","openshift-multus/multus-additional-cni-plugins-cq6gn","openshift-network-operator/iptables-alerter-2wt7f"] Jun 06 20:19:38.577684 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.577658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:38.577816 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.577755 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:38.578826 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.578805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.580243 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.579980 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.581355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.581355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581248 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.581509 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.581509 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 20:19:38.581613 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581536 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 20:19:38.581777 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.581757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zkbp2\"" Jun 06 20:19:38.582454 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.582375 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 20:19:38.582454 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.582400 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcph8\"" Jun 06 20:19:38.582454 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.582419 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.582667 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.582569 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.582667 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.582575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.583312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.583287 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wscxr\"" Jun 06 20:19:38.583400 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.583325 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.583400 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.583350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.583696 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.583677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.583798 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.583760 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:38.584437 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.584410 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wfvtk\"" Jun 06 20:19:38.584820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.584763 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.584820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.584786 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 20:19:38.584820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.584808 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.585049 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.585030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.586555 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.586525 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.587177 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.587106 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bmtsl\"" Jun 06 20:19:38.587177 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.587134 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 20:19:38.587370 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.587204 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 20:19:38.588143 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.587971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.588722 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.588688 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 20:19:38.588810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.588688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dl4s6\"" Jun 06 20:19:38.588810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.588780 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 20:19:38.589075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.589057 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.589154 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.589062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.589154 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.589086 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 20:19:38.589676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.589659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.590240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.590220 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.590331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.590280 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 20:19:38.590331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.590305 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9f7q7\"" Jun 06 20:19:38.591117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.591207 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.591157 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:38.591388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591368 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.591469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591395 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 20:19:38.591469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591433 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 20:19:38.591469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591395 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 20:19:38.591832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591803 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 20:19:38.591921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591837 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:19:38.591921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591861 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 20:19:38.591921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.591909 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bkv9m\"" Jun 06 20:19:38.592663 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.592642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.592992 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.592976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-registration-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.593075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-sys-fs\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.593075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-systemd\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593110 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqpb\" (UniqueName: \"kubernetes.io/projected/ec1975cc-4883-4498-b7a7-f7e20aa052d3-kube-api-access-wdqpb\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.593184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89xdn\" (UniqueName: \"kubernetes.io/projected/9125843c-8115-4094-9711-4ffcd690547d-kube-api-access-89xdn\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.593184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-kubernetes\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec1975cc-4883-4498-b7a7-f7e20aa052d3-iptables-alerter-script\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9125843c-8115-4094-9711-4ffcd690547d-host\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-modprobe-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-lib-modules\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvl9l\" (UniqueName: \"kubernetes.io/projected/2234c2d4-85d2-4120-8801-daf396b4c2f1-kube-api-access-nvl9l\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-var-lib-kubelet\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-host\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-tuned\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-tmp\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1975cc-4883-4498-b7a7-f7e20aa052d3-host-slash\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9125843c-8115-4094-9711-4ffcd690547d-serviceca\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.593607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-device-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593635 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysconfig\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-socket-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-run\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-sys\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h7zc\" (UniqueName: \"kubernetes.io/projected/e906993e-bbf0-49ba-b9e2-05968464efaf-kube-api-access-7h7zc\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.594027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.593889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-conf\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.594832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.594798 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 20:19:38.594939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.594913 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nctw2\"" Jun 06 20:19:38.611413 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.611394 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xssmw" Jun 06 20:19:38.620098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.620075 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xssmw" Jun 06 20:19:38.649620 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.649597 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:38.682919 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.682902 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 20:19:38.695094 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-systemd\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.695189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhx65\" (UniqueName: \"kubernetes.io/projected/b33ff57f-5718-4121-93ca-261066c392d0-kube-api-access-rhx65\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.695189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.695189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-ovn\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-env-overrides\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqpb\" (UniqueName: \"kubernetes.io/projected/ec1975cc-4883-4498-b7a7-f7e20aa052d3-kube-api-access-wdqpb\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695221 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-systemd\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wnw\" (UniqueName: \"kubernetes.io/projected/1dafddc6-3e69-427f-a8fa-cc7d871211f2-kube-api-access-f9wnw\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-cnibin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec1975cc-4883-4498-b7a7-f7e20aa052d3-iptables-alerter-script\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.695388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-kubelet-config\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-multus\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-daemon-config\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-config\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-lib-modules\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvl9l\" (UniqueName: \"kubernetes.io/projected/2234c2d4-85d2-4120-8801-daf396b4c2f1-kube-api-access-nvl9l\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-dbus\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-cni-binary-copy\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-slash\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.695729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-tuned\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695776 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-lib-modules\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-tmp\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec1975cc-4883-4498-b7a7-f7e20aa052d3-iptables-alerter-script\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.695909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1975cc-4883-4498-b7a7-f7e20aa052d3-host-slash\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec1975cc-4883-4498-b7a7-f7e20aa052d3-host-slash\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696048 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-cnibin\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-script-lib\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-run\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.696219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-os-release\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-run\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-netns\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-etc-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-node-log\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgvr\" (UniqueName: \"kubernetes.io/projected/107990db-0354-4448-92be-6463717c5dae-kube-api-access-2qgvr\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-kubelet\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-hostroot\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rln\" (UniqueName: \"kubernetes.io/projected/5f4a33e4-312c-4562-811d-e0ed1512715c-kube-api-access-x8rln\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-systemd-units\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddzb\" (UniqueName: \"kubernetes.io/projected/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-kube-api-access-mddzb\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-registration-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-sys-fs\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.696934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-registration-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-conf-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-kubelet\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696853 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-sys-fs\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.696853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-log-socket\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb24586-bf13-4e8e-a385-45ead245cef8-konnectivity-ca\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-var-lib-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-k8s-cni-cncf-io\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-netns\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89xdn\" (UniqueName: \"kubernetes.io/projected/9125843c-8115-4094-9711-4ffcd690547d-kube-api-access-89xdn\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-kubernetes\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-system-cni-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-binary-copy\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697364 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-system-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697498 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.697633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9125843c-8115-4094-9711-4ffcd690547d-host\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-modprobe-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9125843c-8115-4094-9711-4ffcd690547d-host\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-socket-dir-parent\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697688 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-kubernetes\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697726 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697728 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-modprobe-d\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-etc-kubernetes\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-bin\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-var-lib-kubelet\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-var-lib-kubelet\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-host\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-os-release\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.697948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9125843c-8115-4094-9711-4ffcd690547d-serviceca\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-device-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.698439 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysconfig\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dafddc6-3e69-427f-a8fa-cc7d871211f2-hosts-file\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-systemd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-device-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-socket-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698207 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysconfig\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698208 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-sys\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-sys\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-host\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e906993e-bbf0-49ba-b9e2-05968464efaf-socket-dir\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h7zc\" (UniqueName: \"kubernetes.io/projected/e906993e-bbf0-49ba-b9e2-05968464efaf-kube-api-access-7h7zc\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-conf\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698342 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9125843c-8115-4094-9711-4ffcd690547d-serviceca\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dafddc6-3e69-427f-a8fa-cc7d871211f2-tmp-dir\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-bin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.699122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-multus-certs\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.699689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb24586-bf13-4e8e-a385-45ead245cef8-agent-certs\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.699689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-sysctl-conf\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-netd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.699689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-etc-tuned\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.699689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.698942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2234c2d4-85d2-4120-8801-daf396b4c2f1-tmp\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.701914 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.701894 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:38.702001 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.701921 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:38.702001 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.701933 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:38.702108 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.702006 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:19:39.201976931 +0000 UTC m=+3.013321519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:38.704167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.704149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvl9l\" (UniqueName: \"kubernetes.io/projected/2234c2d4-85d2-4120-8801-daf396b4c2f1-kube-api-access-nvl9l\") pod \"tuned-dg9j9\" (UID: \"2234c2d4-85d2-4120-8801-daf396b4c2f1\") " pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.704283 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.704250 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqpb\" (UniqueName: \"kubernetes.io/projected/ec1975cc-4883-4498-b7a7-f7e20aa052d3-kube-api-access-wdqpb\") pod \"iptables-alerter-2wt7f\" (UID: \"ec1975cc-4883-4498-b7a7-f7e20aa052d3\") " pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.705040 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.705017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89xdn\" (UniqueName: \"kubernetes.io/projected/9125843c-8115-4094-9711-4ffcd690547d-kube-api-access-89xdn\") pod \"node-ca-ml7q8\" (UID: \"9125843c-8115-4094-9711-4ffcd690547d\") " pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.705994 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.705975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h7zc\" (UniqueName: \"kubernetes.io/projected/e906993e-bbf0-49ba-b9e2-05968464efaf-kube-api-access-7h7zc\") pod \"aws-ebs-csi-driver-node-mv55l\" (UID: \"e906993e-bbf0-49ba-b9e2-05968464efaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.746373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.746349 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:38.799746 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb24586-bf13-4e8e-a385-45ead245cef8-konnectivity-ca\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-var-lib-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-k8s-cni-cncf-io\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-netns\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-system-cni-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-binary-copy\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799853 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-var-lib-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799862 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-netns\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.799875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799860 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-k8s-cni-cncf-io\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799906 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-system-cni-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-system-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.799982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-socket-dir-parent\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-etc-kubernetes\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-bin\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-os-release\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dafddc6-3e69-427f-a8fa-cc7d871211f2-hosts-file\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800085 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-system-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-etc-kubernetes\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-systemd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-bin\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-systemd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1dafddc6-3e69-427f-a8fa-cc7d871211f2-hosts-file\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-socket-dir-parent\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-os-release\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dafddc6-3e69-427f-a8fa-cc7d871211f2-tmp-dir\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-bin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.800227 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-multus-certs\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb24586-bf13-4e8e-a385-45ead245cef8-agent-certs\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.800296 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:39.300276439 +0000 UTC m=+3.111621022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-bin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-netd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800355 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhx65\" (UniqueName: \"kubernetes.io/projected/b33ff57f-5718-4121-93ca-261066c392d0-kube-api-access-rhx65\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800373 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb24586-bf13-4e8e-a385-45ead245cef8-konnectivity-ca\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-ovn\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-env-overrides\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800433 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-run-multus-certs\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wnw\" (UniqueName: \"kubernetes.io/projected/1dafddc6-3e69-427f-a8fa-cc7d871211f2-kube-api-access-f9wnw\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-cni-netd\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-cnibin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.800978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-kubelet-config\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-multus\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-cni-binary-copy\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-daemon-config\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-cni-multus\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800610 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-kubelet-config\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800553 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dafddc6-3e69-427f-a8fa-cc7d871211f2-tmp-dir\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-cnibin\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-ovn\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800756 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-run-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-config\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-dbus\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-cni-binary-copy\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.801797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-slash\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-env-overrides\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-slash\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800936 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e6820639-5c09-4428-8ce4-7f6e71097b20-dbus\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-cnibin\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.800987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-script-lib\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-os-release\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.801013 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:38.801069 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:39.30105342 +0000 UTC m=+3.112397998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-netns\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801108 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-cni-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-etc-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-cnibin\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.802542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-node-log\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-node-log\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801187 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgvr\" (UniqueName: \"kubernetes.io/projected/107990db-0354-4448-92be-6463717c5dae-kube-api-access-2qgvr\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801246 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-etc-openvswitch\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-daemon-config\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-kubelet\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801287 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-host-var-lib-kubelet\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-hostroot\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rln\" (UniqueName: \"kubernetes.io/projected/5f4a33e4-312c-4562-811d-e0ed1512715c-kube-api-access-x8rln\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-systemd-units\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/107990db-0354-4448-92be-6463717c5dae-os-release\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddzb\" (UniqueName: \"kubernetes.io/projected/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-kube-api-access-mddzb\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-run-netns\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f4a33e4-312c-4562-811d-e0ed1512715c-cni-binary-copy\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-conf-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-multus-conf-dir\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-kubelet\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.803276 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-log-socket\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-log-socket\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-systemd-units\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801603 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f4a33e4-312c-4562-811d-e0ed1512715c-hostroot\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801637 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-host-kubelet\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801670 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-script-lib\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801926 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovnkube-config\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.801962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/107990db-0354-4448-92be-6463717c5dae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.803020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb24586-bf13-4e8e-a385-45ead245cef8-agent-certs\") pod \"konnectivity-agent-5m2jq\" (UID: \"6bb24586-bf13-4e8e-a385-45ead245cef8\") " pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.804008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.803956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-ovn-node-metrics-cert\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.809524 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.809477 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhx65\" (UniqueName: \"kubernetes.io/projected/b33ff57f-5718-4121-93ca-261066c392d0-kube-api-access-rhx65\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:38.809910 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.809888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rln\" (UniqueName: \"kubernetes.io/projected/5f4a33e4-312c-4562-811d-e0ed1512715c-kube-api-access-x8rln\") pod \"multus-4jnxs\" (UID: \"5f4a33e4-312c-4562-811d-e0ed1512715c\") " pod="openshift-multus/multus-4jnxs" Jun 06 20:19:38.810070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.810051 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wnw\" (UniqueName: \"kubernetes.io/projected/1dafddc6-3e69-427f-a8fa-cc7d871211f2-kube-api-access-f9wnw\") pod \"node-resolver-2fznv\" (UID: \"1dafddc6-3e69-427f-a8fa-cc7d871211f2\") " pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.810298 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.810281 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddzb\" (UniqueName: \"kubernetes.io/projected/2c0f652c-036c-48a6-a1fa-dbd24f38dc00-kube-api-access-mddzb\") pod \"ovnkube-node-qpwws\" (UID: \"2c0f652c-036c-48a6-a1fa-dbd24f38dc00\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.810510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.810494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgvr\" (UniqueName: \"kubernetes.io/projected/107990db-0354-4448-92be-6463717c5dae-kube-api-access-2qgvr\") pod \"multus-additional-cni-plugins-cq6gn\" (UID: \"107990db-0354-4448-92be-6463717c5dae\") " pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.891532 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.891461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml7q8" Jun 06 20:19:38.899608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.899588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" Jun 06 20:19:38.908359 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.908337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" Jun 06 20:19:38.914049 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.914032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wt7f" Jun 06 20:19:38.920729 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.920695 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:19:38.925321 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.925303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" Jun 06 20:19:38.930794 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.930778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:19:38.939290 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.939274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fznv" Jun 06 20:19:38.943858 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:38.943842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jnxs" Jun 06 20:19:39.204529 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.204434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:39.204679 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.204588 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:39.204679 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.204603 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:39.204679 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.204612 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:39.204679 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.204673 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:19:40.204652249 +0000 UTC m=+4.015996817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:39.285390 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.285341 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107990db_0354_4448_92be_6463717c5dae.slice/crio-98be2b662e2f17f9c2df5e35859c34c7881b716a47c9d9a85b2f49e49e3793ae WatchSource:0}: Error finding container 98be2b662e2f17f9c2df5e35859c34c7881b716a47c9d9a85b2f49e49e3793ae: Status 404 returned error can't find the container with id 98be2b662e2f17f9c2df5e35859c34c7881b716a47c9d9a85b2f49e49e3793ae Jun 06 20:19:39.288196 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.288174 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0f652c_036c_48a6_a1fa_dbd24f38dc00.slice/crio-399d4342411bc57b42d121880ca41a14f5ffee6a25e6eb38b488ab7811f20054 WatchSource:0}: Error finding container 399d4342411bc57b42d121880ca41a14f5ffee6a25e6eb38b488ab7811f20054: Status 404 returned error can't find the container with id 399d4342411bc57b42d121880ca41a14f5ffee6a25e6eb38b488ab7811f20054 Jun 06 20:19:39.291308 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.291284 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2234c2d4_85d2_4120_8801_daf396b4c2f1.slice/crio-1b9c477fd928915c41565337e7734dea65a07cdf2f8dff07cc980edd525f7418 WatchSource:0}: Error finding container 1b9c477fd928915c41565337e7734dea65a07cdf2f8dff07cc980edd525f7418: Status 404 returned error can't find the container with id 1b9c477fd928915c41565337e7734dea65a07cdf2f8dff07cc980edd525f7418 Jun 06 20:19:39.293171 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.293149 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1975cc_4883_4498_b7a7_f7e20aa052d3.slice/crio-b2cb108b1343fa9928b0bb0789be1f3c3aa96acae7235a0bb1aa8d55ca783c90 WatchSource:0}: Error finding container b2cb108b1343fa9928b0bb0789be1f3c3aa96acae7235a0bb1aa8d55ca783c90: Status 404 returned error can't find the container with id b2cb108b1343fa9928b0bb0789be1f3c3aa96acae7235a0bb1aa8d55ca783c90 Jun 06 20:19:39.293989 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.293968 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9125843c_8115_4094_9711_4ffcd690547d.slice/crio-6b72a067f7d902e98dc16daf3951e266cb2067e0744f911431e9bd3cfd7979ae WatchSource:0}: Error finding container 6b72a067f7d902e98dc16daf3951e266cb2067e0744f911431e9bd3cfd7979ae: Status 404 returned error can't find the container with id 6b72a067f7d902e98dc16daf3951e266cb2067e0744f911431e9bd3cfd7979ae Jun 06 20:19:39.295452 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.295364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4a33e4_312c_4562_811d_e0ed1512715c.slice/crio-4ea7e5cf404022655ff3fb62533b1bb5ecd9038023134092a08537d077646aa9 WatchSource:0}: Error finding container 4ea7e5cf404022655ff3fb62533b1bb5ecd9038023134092a08537d077646aa9: Status 404 returned error can't find the container with id 4ea7e5cf404022655ff3fb62533b1bb5ecd9038023134092a08537d077646aa9 Jun 06 20:19:39.296421 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.296399 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dafddc6_3e69_427f_a8fa_cc7d871211f2.slice/crio-2330a5c589a0ed0908022b2114ee7a7ce551fff844fcf7b81f50051f44411bd8 WatchSource:0}: Error finding container 2330a5c589a0ed0908022b2114ee7a7ce551fff844fcf7b81f50051f44411bd8: Status 404 returned error can't find the container with id 2330a5c589a0ed0908022b2114ee7a7ce551fff844fcf7b81f50051f44411bd8 Jun 06 20:19:39.299443 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.297749 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb24586_bf13_4e8e_a385_45ead245cef8.slice/crio-9958098e60abf16611114da52a36c30617523e9ccdc9dd92e80e9849367a232c WatchSource:0}: Error finding container 9958098e60abf16611114da52a36c30617523e9ccdc9dd92e80e9849367a232c: Status 404 returned error can't find the container with id 9958098e60abf16611114da52a36c30617523e9ccdc9dd92e80e9849367a232c Jun 06 20:19:39.299443 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:19:39.298825 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode906993e_bbf0_49ba_b9e2_05968464efaf.slice/crio-633654c9b83e8c05f0bffed7ee2ec7f13e730f93dca92215645fa77ede358196 WatchSource:0}: Error finding container 633654c9b83e8c05f0bffed7ee2ec7f13e730f93dca92215645fa77ede358196: Status 404 returned error can't find the container with id 633654c9b83e8c05f0bffed7ee2ec7f13e730f93dca92215645fa77ede358196 Jun 06 20:19:39.304681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.304661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:39.304824 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.304723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:39.304935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.304818 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:39.304935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.304846 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:39.304935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.304875 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:40.304856323 +0000 UTC m=+4.116200899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:39.304935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:39.304918 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:40.304907262 +0000 UTC m=+4.116251829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:39.623004 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.622971 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:14:38 +0000 UTC" deadline="2028-02-22 02:17:59.397400552 +0000 UTC" Jun 06 20:19:39.623004 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.622998 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15005h58m19.774406041s" Jun 06 20:19:39.652364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.652331 2575 generic.go:356] "Generic (PLEG): container finished" podID="78ee8c279971671d1a011e53453b54ab" containerID="288d6f212cf6cb1dae8a208b2a780c0311f5cdf0963a63ea8f727b97f27671ea" exitCode=0 Jun 06 20:19:39.652607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.652410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerDied","Data":"288d6f212cf6cb1dae8a208b2a780c0311f5cdf0963a63ea8f727b97f27671ea"} Jun 06 20:19:39.653935 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.653911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" event={"ID":"3c0d397031f09076e54ac96b039a5d49","Type":"ContainerStarted","Data":"f811e0aa5ddb16be5945c5957b13f17fc185dc2b9572af1a0a281f44570ed25e"} Jun 06 20:19:39.655010 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.654987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" event={"ID":"e906993e-bbf0-49ba-b9e2-05968464efaf","Type":"ContainerStarted","Data":"633654c9b83e8c05f0bffed7ee2ec7f13e730f93dca92215645fa77ede358196"} Jun 06 20:19:39.656070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.656049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5m2jq" event={"ID":"6bb24586-bf13-4e8e-a385-45ead245cef8","Type":"ContainerStarted","Data":"9958098e60abf16611114da52a36c30617523e9ccdc9dd92e80e9849367a232c"} Jun 06 20:19:39.660169 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.660138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" event={"ID":"2234c2d4-85d2-4120-8801-daf396b4c2f1","Type":"ContainerStarted","Data":"1b9c477fd928915c41565337e7734dea65a07cdf2f8dff07cc980edd525f7418"} Jun 06 20:19:39.661427 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.661403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerStarted","Data":"98be2b662e2f17f9c2df5e35859c34c7881b716a47c9d9a85b2f49e49e3793ae"} Jun 06 20:19:39.662630 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.662602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jnxs" event={"ID":"5f4a33e4-312c-4562-811d-e0ed1512715c","Type":"ContainerStarted","Data":"4ea7e5cf404022655ff3fb62533b1bb5ecd9038023134092a08537d077646aa9"} Jun 06 20:19:39.663931 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.663907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fznv" event={"ID":"1dafddc6-3e69-427f-a8fa-cc7d871211f2","Type":"ContainerStarted","Data":"2330a5c589a0ed0908022b2114ee7a7ce551fff844fcf7b81f50051f44411bd8"} Jun 06 20:19:39.665127 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.665103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml7q8" event={"ID":"9125843c-8115-4094-9711-4ffcd690547d","Type":"ContainerStarted","Data":"6b72a067f7d902e98dc16daf3951e266cb2067e0744f911431e9bd3cfd7979ae"} Jun 06 20:19:39.666303 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.666285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wt7f" event={"ID":"ec1975cc-4883-4498-b7a7-f7e20aa052d3","Type":"ContainerStarted","Data":"b2cb108b1343fa9928b0bb0789be1f3c3aa96acae7235a0bb1aa8d55ca783c90"} Jun 06 20:19:39.667623 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.667547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"399d4342411bc57b42d121880ca41a14f5ffee6a25e6eb38b488ab7811f20054"} Jun 06 20:19:39.699939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:39.699886 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-207.ec2.internal" podStartSLOduration=1.699867075 podStartE2EDuration="1.699867075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:39.699431667 +0000 UTC m=+3.510776251" watchObservedRunningTime="2026-06-06 20:19:39.699867075 +0000 UTC m=+3.511211656" Jun 06 20:19:40.213691 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.213085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:40.213691 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.213245 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:40.213691 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.213264 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:40.213691 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.213278 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:40.213691 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.213337 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.213318036 +0000 UTC m=+6.024662611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.314041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.314111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.314263 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.314324 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.314305784 +0000 UTC m=+6.125650365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.314385 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:40.314779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.314416 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.314405232 +0000 UTC m=+6.125749811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:40.623905 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.623841 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:14:38 +0000 UTC" deadline="2028-01-30 01:10:47.05628641 +0000 UTC" Jun 06 20:19:40.623905 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.623903 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14452h51m6.432387669s" Jun 06 20:19:40.645903 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.645872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:40.646053 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.646017 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:40.646629 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.646409 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:40.646629 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.646505 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:40.646629 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.646540 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:40.646629 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:40.646602 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:40.682622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.682414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" event={"ID":"78ee8c279971671d1a011e53453b54ab","Type":"ContainerStarted","Data":"9000b3df1a14cdcb4b00fb8fed39d2ed5b7e94c75f781ac8501077625b111282"} Jun 06 20:19:40.697448 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:40.697285 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-207.ec2.internal" podStartSLOduration=2.6972660250000002 podStartE2EDuration="2.697266025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:40.696338177 +0000 UTC m=+4.507682766" watchObservedRunningTime="2026-06-06 20:19:40.697266025 +0000 UTC m=+4.508610611" Jun 06 20:19:42.229830 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.229792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:42.230280 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.229951 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:42.230280 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.229970 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:42.230280 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.229982 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:42.230280 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.230039 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:19:46.230020051 +0000 UTC m=+10.041364630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.331559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.331629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.331779 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.331842 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:46.33182335 +0000 UTC m=+10.143167919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.332231 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:42.332313 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.332281 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:46.33226623 +0000 UTC m=+10.143610793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:42.644780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.644747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:42.644965 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.644890 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:42.645393 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.645258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:42.645393 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.645356 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:42.645599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:42.645402 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:42.645599 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:42.645520 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:44.645148 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:44.645097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:44.645592 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:44.645216 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:44.645592 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:44.645099 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:44.645592 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:44.645369 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:44.645592 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:44.645415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:44.645592 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:44.645501 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:46.264574 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.264464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:46.265085 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.264628 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:46.265085 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.264647 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:46.265085 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.264660 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:46.265085 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.264737 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:19:54.264717878 +0000 UTC m=+18.076062454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:46.365332 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.365238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:46.365474 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.365343 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:46.365474 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.365415 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:54.365393801 +0000 UTC m=+18.176738365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:46.365474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.365438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:46.365632 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.365538 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:46.365632 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.365582 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:54.365569832 +0000 UTC m=+18.176914396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:46.645356 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.645324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:46.645537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.645477 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:46.645537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:46.645499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:46.645650 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.645589 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:46.645650 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.645596 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:46.645797 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:46.645661 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:48.644624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:48.644546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:48.644624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:48.644577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:48.645136 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:48.644661 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:48.645136 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:48.645114 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:48.645246 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:48.645158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:48.645297 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:48.645257 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:50.645088 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:50.645051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:50.645088 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:50.645088 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:50.645599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:50.645180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:50.645599 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:50.645191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:50.645599 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:50.645294 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:50.645599 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:50.645389 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:52.645328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:52.645295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:52.645328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:52.645318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:52.645867 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:52.645301 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:52.645867 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:52.645407 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:52.645867 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:52.645509 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:52.645867 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:52.645594 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:54.325157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.325121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:54.325573 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.325288 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:54.325573 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.325307 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:54.325573 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.325317 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:54.325573 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.325373 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:20:10.325355555 +0000 UTC m=+34.136700128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:54.425610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.425580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:54.425793 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.425628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:54.425793 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.425740 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:54.425793 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.425745 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:54.425913 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.425810 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:10.425789656 +0000 UTC m=+34.237134256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:54.425913 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.425832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:10.425823096 +0000 UTC m=+34.237167657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:54.645117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.645017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:54.645117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.645031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:54.645335 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:54.645017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:54.645335 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.645156 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:54.645335 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.645244 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:54.645335 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:54.645316 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:56.645075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:56.645041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:56.645501 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:56.645143 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:56.645501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:56.645234 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:56.645501 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:56.645340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:56.645501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:56.645387 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:56.645501 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:56.645461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:58.645093 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.644837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:19:58.645833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.644918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:19:58.645833 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:58.645159 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:19:58.645833 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:58.645225 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:19:58.645833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.644937 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:19:58.645833 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:19:58.645295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:19:58.725306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.725274 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jnxs" event={"ID":"5f4a33e4-312c-4562-811d-e0ed1512715c","Type":"ContainerStarted","Data":"70c5e0d481ae9a47270b752e3e12ea6cfe5be573ac729a6ac9738b45958c3914"} Jun 06 20:19:58.726952 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.726922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fznv" event={"ID":"1dafddc6-3e69-427f-a8fa-cc7d871211f2","Type":"ContainerStarted","Data":"834d3700b8bb75b7962551abd66e1569812ec24682f30a1654ecdbff5f6f95b4"} Jun 06 20:19:58.728599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.728571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml7q8" event={"ID":"9125843c-8115-4094-9711-4ffcd690547d","Type":"ContainerStarted","Data":"aca3ef9697c1f17405ebc849767b4de2d3beda646fdc59f190e0231730be86a6"} Jun 06 20:19:58.733633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.733602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:19:58.733968 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.733948 2575 generic.go:356] "Generic (PLEG): container finished" podID="2c0f652c-036c-48a6-a1fa-dbd24f38dc00" containerID="a82f861d7b97e4098efdca320f8b1d15405b8474da361e3efa83219f0085c77f" exitCode=1 Jun 06 20:19:58.734026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.733976 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"9c36bc81afa596315d8812ebb5930a9dd2f72d2d6d3f6de7721dc253bc754215"} Jun 06 20:19:58.734093 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.734077 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"8b4a3cd532c38a8c187590f023ced22ed182201d3bd94281090ec2524b5abb4f"} Jun 06 20:19:58.734147 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.734134 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerDied","Data":"a82f861d7b97e4098efdca320f8b1d15405b8474da361e3efa83219f0085c77f"} Jun 06 20:19:58.734197 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.734186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"e74a5bc1949b1650aed42c55fea1822a1824ffd6cb995694418b678d0f56cd6d"} Jun 06 20:19:58.735415 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.735394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" event={"ID":"e906993e-bbf0-49ba-b9e2-05968464efaf","Type":"ContainerStarted","Data":"7bbd8af97b810a287308e667b803342994571fecd6e1676463cb4b27c0fb62c6"} Jun 06 20:19:58.736619 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.736602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5m2jq" event={"ID":"6bb24586-bf13-4e8e-a385-45ead245cef8","Type":"ContainerStarted","Data":"2f5aefb37473ec5f49e3b667677590e0cf3edd1b1251816de05b7750cae8b89c"} Jun 06 20:19:58.737845 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.737817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" event={"ID":"2234c2d4-85d2-4120-8801-daf396b4c2f1","Type":"ContainerStarted","Data":"144ef643b255b5562a24dfb35abc70119b7fc1e90d8fddd0629172583c861f96"} Jun 06 20:19:58.739170 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.739152 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="de88e8e8d299fd1e40f51d2472d195fce691c929cf405c1a57808ef4881b8712" exitCode=0 Jun 06 20:19:58.739245 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.739178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"de88e8e8d299fd1e40f51d2472d195fce691c929cf405c1a57808ef4881b8712"} Jun 06 20:19:58.758157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.758122 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5m2jq" podStartSLOduration=4.349715734 podStartE2EDuration="22.758109464s" totalImagesPullingTime="18.40839373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:58.757844229 +0000 UTC m=+22.569188813" watchObservedRunningTime="2026-06-06 20:19:58.758109464 +0000 UTC m=+22.569454047" Jun 06 20:19:58.758271 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.758249 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4jnxs" podStartSLOduration=4.00659472 podStartE2EDuration="22.758244172s" totalImagesPullingTime="18.751649452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:58.742863417 +0000 UTC m=+22.554208001" watchObservedRunningTime="2026-06-06 20:19:58.758244172 +0000 UTC m=+22.569588752" Jun 06 20:19:58.772118 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.772070 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ml7q8" podStartSLOduration=4.083923523 podStartE2EDuration="22.772056324s" totalImagesPullingTime="18.688132801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:58.771617973 +0000 UTC m=+22.582962555" watchObservedRunningTime="2026-06-06 20:19:58.772056324 +0000 UTC m=+22.583400909" Jun 06 20:19:58.813471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.813421 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dg9j9" podStartSLOduration=4.083443097 podStartE2EDuration="22.813406013s" totalImagesPullingTime="18.729962916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:58.78918001 +0000 UTC m=+22.600524594" watchObservedRunningTime="2026-06-06 20:19:58.813406013 +0000 UTC m=+22.624750595" Jun 06 20:19:58.827447 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.827409 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2fznv" podStartSLOduration=4.104746724 podStartE2EDuration="22.827396826s" totalImagesPullingTime="18.722650102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:58.826922607 +0000 UTC m=+22.638267194" watchObservedRunningTime="2026-06-06 20:19:58.827396826 +0000 UTC m=+22.638741408" Jun 06 20:19:58.853046 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.853017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:19:58.911046 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:58.911013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:19:59.209791 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.209537 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 20:19:59.651035 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.650944 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T20:19:59.209686008Z","UUID":"33c4b6c0-8132-452a-a1f7-e8bdb09418ec","Handler":null,"Name":"","Endpoint":""} Jun 06 20:19:59.654245 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.654215 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 20:19:59.654366 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.654260 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 20:19:59.743865 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.743835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" event={"ID":"e906993e-bbf0-49ba-b9e2-05968464efaf","Type":"ContainerStarted","Data":"3c3cadeca13baa99e0deb50659889527789d1fe866e50d0de3fc4ba41e1d121e"} Jun 06 20:19:59.745594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.745550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wt7f" event={"ID":"ec1975cc-4883-4498-b7a7-f7e20aa052d3","Type":"ContainerStarted","Data":"cf02144f0fc5690dc499459d5b8d2124cac177316758c90bb88261fc862c14e3"} Jun 06 20:19:59.748501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.748480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:19:59.748860 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.748840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"8db6399db65020b6dd8388130cf81568fc5ea97d0c8fc03a307324136cb96360"} Jun 06 20:19:59.748959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.748916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"ec99e9d8e28e01f41ada5c5e98e297b24f75bacb468e9d9ed817f30959974fc6"} Jun 06 20:19:59.876402 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.876370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:19:59.977773 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:19:59.977634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:00.644789 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.644673 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:00.644789 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.644740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:00.645019 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.644817 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:00.645019 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:00.644932 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:00.645127 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:00.645075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:00.645181 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:00.645161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:00.753474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.753437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" event={"ID":"e906993e-bbf0-49ba-b9e2-05968464efaf","Type":"ContainerStarted","Data":"7f13b526ed47b826aff6dabbaad70ccc11b884d0d65682a6e65ff5bc8b8f27fb"} Jun 06 20:20:00.773951 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.773901 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2wt7f" podStartSLOduration=6.046840982 podStartE2EDuration="24.773886793s" totalImagesPullingTime="18.727045811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:19:59.759288811 +0000 UTC m=+23.570633398" watchObservedRunningTime="2026-06-06 20:20:00.773886793 +0000 UTC m=+24.585231376" Jun 06 20:20:00.774113 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.774038 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv55l" podStartSLOduration=4.206402099 podStartE2EDuration="24.774034458s" totalImagesPullingTime="20.567632359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:00.773154208 +0000 UTC m=+24.584498790" watchObservedRunningTime="2026-06-06 20:20:00.774034458 +0000 UTC m=+24.585379040" Jun 06 20:20:00.810890 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.810859 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:20:00.811604 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:00.811581 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:20:01.759064 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.759037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:20:01.759584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.759500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"982d7645640670c747fa4f253013400db81837e3d6cd302f6a707a00c342904f"} Jun 06 20:20:01.759987 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.759949 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:20:01.760537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.760517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5m2jq" Jun 06 20:20:01.766883 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.766862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:01.853182 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.853138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:01.954350 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:01.954323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:02.644642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.644611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:02.644642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.644641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:02.644904 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:02.644761 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:02.644904 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:02.644810 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:02.644904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.644835 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:02.645052 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:02.644920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:02.682932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.682905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:02.770648 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.770613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:02.839760 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:02.839732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:03.765360 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:03.765140 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="b5a1d58cdf0b2773ea8ad3c4065d8bb424427b26c5840ede82852f1d36296a4a" exitCode=0 Jun 06 20:20:03.765522 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:03.765214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"b5a1d58cdf0b2773ea8ad3c4065d8bb424427b26c5840ede82852f1d36296a4a"} Jun 06 20:20:03.769071 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:03.769053 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:20:03.769399 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:03.769373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"b7b2d24f857ec39c229edd68ab51ef40d45d645e704cd5345c97e375dbd82daa"} Jun 06 20:20:03.769788 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:03.769772 2575 scope.go:117] "RemoveContainer" containerID="a82f861d7b97e4098efdca320f8b1d15405b8474da361e3efa83219f0085c77f" Jun 06 20:20:04.644822 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.644789 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:04.645260 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.644788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:04.645260 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.644907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:04.645260 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:04.644911 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:04.645260 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:04.644995 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:04.645260 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:04.645061 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:04.775185 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.775138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:20:04.775502 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.775482 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" event={"ID":"2c0f652c-036c-48a6-a1fa-dbd24f38dc00","Type":"ContainerStarted","Data":"170ca52855ec68f486d1ca0e44552f4f1f7f3d982ab3953c9333509089d3eb36"} Jun 06 20:20:04.775652 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.775628 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:04.775780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.775677 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:04.775780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.775723 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:04.790555 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.790533 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:04.790770 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.790730 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:04.831615 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:04.829867 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" podStartSLOduration=10.044673244 podStartE2EDuration="28.829845951s" totalImagesPullingTime="18.785172707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:04.828200126 +0000 UTC m=+28.639544723" watchObservedRunningTime="2026-06-06 20:20:04.829845951 +0000 UTC m=+28.641190537" Jun 06 20:20:05.202533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.202284 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c92rl"] Jun 06 20:20:05.202732 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.202619 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:05.202808 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:05.202749 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:05.202957 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.202936 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m6nwq"] Jun 06 20:20:05.203047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.203023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:05.203172 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:05.203133 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:05.205212 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.205191 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8zgpn"] Jun 06 20:20:05.205282 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.205274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:05.205354 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:05.205339 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:05.298601 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.298573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:05.779351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.779319 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="0bf33190d5129ade3e449331db52934d9f33f853c07a3d0971ee980fbed6d80b" exitCode=0 Jun 06 20:20:05.779819 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:05.779410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"0bf33190d5129ade3e449331db52934d9f33f853c07a3d0971ee980fbed6d80b"} Jun 06 20:20:06.645186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:06.645150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:06.645345 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:06.645241 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:06.645345 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:06.645302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:06.645441 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:06.645385 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:06.645441 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:06.645408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:06.645542 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:06.645474 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:07.624624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:07.624593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:07.676823 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:07.676794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:07.785925 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:07.785897 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="82da8bd69518bc52fbc31ff756e7f17febcad35500a1eaa239a9c8ad411e1d64" exitCode=0 Jun 06 20:20:07.786036 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:07.785955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"82da8bd69518bc52fbc31ff756e7f17febcad35500a1eaa239a9c8ad411e1d64"} Jun 06 20:20:08.645238 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:08.645212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:08.645238 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:08.645248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:08.645749 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:08.645334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:08.645749 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:08.645430 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:08.645749 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:08.645451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:08.645749 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:08.645547 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:10.345504 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.345463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:10.346105 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.345632 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:20:10.346105 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.345655 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:20:10.346105 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.345665 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ffrc4 for pod openshift-network-diagnostics/network-check-target-m6nwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:20:10.346105 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.345742 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4 podName:9f47610e-a97c-4b65-8f6a-b121c98781fe nodeName:}" failed. No retries permitted until 2026-06-06 20:20:42.345722944 +0000 UTC m=+66.157067508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ffrc4" (UniqueName: "kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4") pod "network-check-target-m6nwq" (UID: "9f47610e-a97c-4b65-8f6a-b121c98781fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:20:10.446247 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.446212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:10.446421 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.446273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:10.446421 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.446369 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:20:10.446421 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.446390 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:20:10.446591 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.446445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret podName:e6820639-5c09-4428-8ce4-7f6e71097b20 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:42.446425572 +0000 UTC m=+66.257770134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret") pod "global-pull-secret-syncer-c92rl" (UID: "e6820639-5c09-4428-8ce4-7f6e71097b20") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:20:10.446591 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.446467 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:42.446456046 +0000 UTC m=+66.257800626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:20:10.645334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.645261 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:10.645544 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.645383 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c92rl" podUID="e6820639-5c09-4428-8ce4-7f6e71097b20" Jun 06 20:20:10.645544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.645263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:10.645544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:10.645417 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:10.645544 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.645480 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6nwq" podUID="9f47610e-a97c-4b65-8f6a-b121c98781fe" Jun 06 20:20:10.645735 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:10.645608 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:20:11.028034 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.027754 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-207.ec2.internal" event="NodeReady" Jun 06 20:20:11.028186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.028095 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 20:20:11.071603 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.071575 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w5v6s"] Jun 06 20:20:11.098759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.098736 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hg5g2"] Jun 06 20:20:11.098923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.098845 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.101539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.101518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hpmf7\"" Jun 06 20:20:11.101539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.101528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 20:20:11.101745 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.101598 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 20:20:11.101745 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.101693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 20:20:11.112793 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.112773 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5v6s"] Jun 06 20:20:11.112898 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.112811 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg5g2"] Jun 06 20:20:11.112940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.112901 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.115365 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.115339 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 20:20:11.115462 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.115394 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 20:20:11.115526 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.115488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wqmlq\"" Jun 06 20:20:11.157453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.157412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:11.251264 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpqcx\" (UniqueName: \"kubernetes.io/projected/f85be7f4-fd60-47aa-b6b0-0e533d639e10-kube-api-access-kpqcx\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.251264 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-tmp-dir\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.251510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6np2f\" (UniqueName: \"kubernetes.io/projected/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-kube-api-access-6np2f\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.251510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.251510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85be7f4-fd60-47aa-b6b0-0e533d639e10-cert\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.251510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.251502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-config-volume\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.253436 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.253405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:11.352607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-config-volume\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpqcx\" (UniqueName: \"kubernetes.io/projected/f85be7f4-fd60-47aa-b6b0-0e533d639e10-kube-api-access-kpqcx\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.353077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-tmp-dir\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6np2f\" (UniqueName: \"kubernetes.io/projected/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-kube-api-access-6np2f\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.352926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85be7f4-fd60-47aa-b6b0-0e533d639e10-cert\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.353355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.353170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-tmp-dir\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.353263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-config-volume\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.353355 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:11.353262 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:11.353355 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:11.353352 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:11.853324453 +0000 UTC m=+35.664669029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:11.357952 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.357929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f85be7f4-fd60-47aa-b6b0-0e533d639e10-cert\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.363790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.363764 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6np2f\" (UniqueName: \"kubernetes.io/projected/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-kube-api-access-6np2f\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.363942 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.363921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpqcx\" (UniqueName: \"kubernetes.io/projected/f85be7f4-fd60-47aa-b6b0-0e533d639e10-kube-api-access-kpqcx\") pod \"ingress-canary-w5v6s\" (UID: \"f85be7f4-fd60-47aa-b6b0-0e533d639e10\") " pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.409791 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.409753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5v6s" Jun 06 20:20:11.855701 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:11.855666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:11.855883 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:11.855865 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:11.855941 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:11.855933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:12.85591274 +0000 UTC m=+36.667257301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:12.155899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.155870 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5v6s"] Jun 06 20:20:12.160323 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:20:12.160298 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85be7f4_fd60_47aa_b6b0_0e533d639e10.slice/crio-fcf1338ed7cc0d8b1163eb32b83e025859d59586e04420dd6f057a847ff9e370 WatchSource:0}: Error finding container fcf1338ed7cc0d8b1163eb32b83e025859d59586e04420dd6f057a847ff9e370: Status 404 returned error can't find the container with id fcf1338ed7cc0d8b1163eb32b83e025859d59586e04420dd6f057a847ff9e370 Jun 06 20:20:12.645189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.645113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:12.645189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.645138 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:12.645667 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.645113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:12.649448 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649425 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rxmgp\"" Jun 06 20:20:12.649448 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649424 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wj9j\"" Jun 06 20:20:12.649759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649495 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:20:12.649759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649437 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:20:12.649759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649495 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:20:12.649759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.649424 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:20:12.798759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.798723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5v6s" event={"ID":"f85be7f4-fd60-47aa-b6b0-0e533d639e10","Type":"ContainerStarted","Data":"fcf1338ed7cc0d8b1163eb32b83e025859d59586e04420dd6f057a847ff9e370"} Jun 06 20:20:12.801995 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.801961 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="4bfb18de281cf7dfedb82469ec94069b27436ec528e4a135fce6fbf264efc06c" exitCode=0 Jun 06 20:20:12.802132 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.801999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"4bfb18de281cf7dfedb82469ec94069b27436ec528e4a135fce6fbf264efc06c"} Jun 06 20:20:12.866800 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:12.866774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:12.866924 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:12.866910 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:12.866985 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:12.866974 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:14.866955953 +0000 UTC m=+38.678300523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:13.807749 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:13.807676 2575 generic.go:356] "Generic (PLEG): container finished" podID="107990db-0354-4448-92be-6463717c5dae" containerID="d59b5eb71268efb1d458e63030c2c8c8762ef6bf0bd5646ca887069005ae1487" exitCode=0 Jun 06 20:20:13.808105 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:13.807748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerDied","Data":"d59b5eb71268efb1d458e63030c2c8c8762ef6bf0bd5646ca887069005ae1487"} Jun 06 20:20:13.928785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:13.928757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:14.026036 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.026004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:14.813299 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.813268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" event={"ID":"107990db-0354-4448-92be-6463717c5dae","Type":"ContainerStarted","Data":"405bbd2f415197e72bf1493ad2cdb2b650054810166ae68ff062559df9ed2d8a"} Jun 06 20:20:14.814650 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.814626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5v6s" event={"ID":"f85be7f4-fd60-47aa-b6b0-0e533d639e10","Type":"ContainerStarted","Data":"0751a23bf1a1afb1d795d7e5df54d89dafb59ef900951d618a8a48f997161ede"} Jun 06 20:20:14.838932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.838886 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cq6gn" podStartSLOduration=9.631072215 podStartE2EDuration="38.838870965s" totalImagesPullingTime="29.20779875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:14.838732583 +0000 UTC m=+38.650077168" watchObservedRunningTime="2026-06-06 20:20:14.838870965 +0000 UTC m=+38.650215547" Jun 06 20:20:14.853369 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.853327 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w5v6s" podStartSLOduration=2.175031428 podStartE2EDuration="3.853314178s" totalImagesPullingTime="1.67828275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:14.852610797 +0000 UTC m=+38.663955380" watchObservedRunningTime="2026-06-06 20:20:14.853314178 +0000 UTC m=+38.664658760" Jun 06 20:20:14.882171 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.882089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:14.882242 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:14.882222 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:14.882298 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:14.882280 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:18.882264726 +0000 UTC m=+42.693609303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:14.930907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.930879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:14.983980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:14.983953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:15.432666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:15.432633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:15.534821 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:15.534792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:18.050502 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:18.050468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:18.101603 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:18.101576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:18.910861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:18.910803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:18.911047 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:18.910946 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:18.911047 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:18.911008 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:26.910990913 +0000 UTC m=+50.722335491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:19.824645 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:19.824611 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:19.874001 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:19.873976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:26.961993 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:26.961953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:26.962528 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:26.962072 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:26.962528 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:26.962135 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:20:42.962120047 +0000 UTC m=+66.773464608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:36.797225 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:36.797194 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpwws" Jun 06 20:20:36.947299 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:36.947252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:36.997986 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:36.997961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:40.779185 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:40.779150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:40.836207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:40.836177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:20:42.370830 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.370794 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:42.373368 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.373351 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:20:42.383047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.383024 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:20:42.395250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.395231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrc4\" (UniqueName: \"kubernetes.io/projected/9f47610e-a97c-4b65-8f6a-b121c98781fe-kube-api-access-ffrc4\") pod \"network-check-target-m6nwq\" (UID: \"9f47610e-a97c-4b65-8f6a-b121c98781fe\") " pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:42.471816 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.471787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:42.471974 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.471844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:20:42.474294 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.474277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:20:42.474599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.474584 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:20:42.482494 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:42.482473 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:20:42.482572 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:42.482536 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:21:46.482520282 +0000 UTC m=+130.293864843 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : secret "metrics-daemon-secret" not found Jun 06 20:20:42.484515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.484494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e6820639-5c09-4428-8ce4-7f6e71097b20-original-pull-secret\") pod \"global-pull-secret-syncer-c92rl\" (UID: \"e6820639-5c09-4428-8ce4-7f6e71097b20\") " pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:42.658262 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.658194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c92rl" Jun 06 20:20:42.673541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.673519 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rxmgp\"" Jun 06 20:20:42.681494 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.681473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:42.791564 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.791479 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c92rl"] Jun 06 20:20:42.793976 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:20:42.793954 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6820639_5c09_4428_8ce4_7f6e71097b20.slice/crio-ac0202e3de86c82c7366691d078c37d1442a0544d2a704dd7d94a6561d3c20f4 WatchSource:0}: Error finding container ac0202e3de86c82c7366691d078c37d1442a0544d2a704dd7d94a6561d3c20f4: Status 404 returned error can't find the container with id ac0202e3de86c82c7366691d078c37d1442a0544d2a704dd7d94a6561d3c20f4 Jun 06 20:20:42.807453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.807427 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m6nwq"] Jun 06 20:20:42.810035 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:20:42.810004 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f47610e_a97c_4b65_8f6a_b121c98781fe.slice/crio-b32f940ff2fe28110aab8df57591f5317fd7ea8e71514804909e424ac3999927 WatchSource:0}: Error finding container b32f940ff2fe28110aab8df57591f5317fd7ea8e71514804909e424ac3999927: Status 404 returned error can't find the container with id b32f940ff2fe28110aab8df57591f5317fd7ea8e71514804909e424ac3999927 Jun 06 20:20:42.875325 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.875293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c92rl" event={"ID":"e6820639-5c09-4428-8ce4-7f6e71097b20","Type":"ContainerStarted","Data":"ac0202e3de86c82c7366691d078c37d1442a0544d2a704dd7d94a6561d3c20f4"} Jun 06 20:20:42.876210 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.876189 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m6nwq" event={"ID":"9f47610e-a97c-4b65-8f6a-b121c98781fe","Type":"ContainerStarted","Data":"b32f940ff2fe28110aab8df57591f5317fd7ea8e71514804909e424ac3999927"} Jun 06 20:20:42.974958 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:42.974904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:20:42.975043 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:42.975012 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:42.975084 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:20:42.975068 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:21:14.975054015 +0000 UTC m=+98.786398576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:20:47.890846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:47.890804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m6nwq" event={"ID":"9f47610e-a97c-4b65-8f6a-b121c98781fe","Type":"ContainerStarted","Data":"44e9551fde26b7e7e862c6bbf33add3b54068a1658271625b4844b452ccc8269"} Jun 06 20:20:47.891331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:47.890941 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:20:47.892117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:47.892091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c92rl" event={"ID":"e6820639-5c09-4428-8ce4-7f6e71097b20","Type":"ContainerStarted","Data":"d2096ec106e4a19086408ae586bb5cdff63f5cb54729256f421db710bfc22278"} Jun 06 20:20:47.906721 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:47.906669 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m6nwq" podStartSLOduration=67.718540599 podStartE2EDuration="1m11.906657409s" totalImagesPullingTime="4.18811681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:47.905399757 +0000 UTC m=+71.716744364" watchObservedRunningTime="2026-06-06 20:20:47.906657409 +0000 UTC m=+71.718001971" Jun 06 20:20:47.922927 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:20:47.922889 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c92rl" podStartSLOduration=67.715331286 podStartE2EDuration="1m11.922876148s" totalImagesPullingTime="4.207544862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:47.922242895 +0000 UTC m=+71.733587479" watchObservedRunningTime="2026-06-06 20:20:47.922876148 +0000 UTC m=+71.734220732" Jun 06 20:21:14.991975 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:21:14.991942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:21:14.992458 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:21:14.992111 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:21:14.992458 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:21:14.992210 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:22:18.992189065 +0000 UTC m=+162.803533640 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:21:18.896761 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:21:18.896732 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m6nwq" Jun 06 20:21:46.493035 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:21:46.492986 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:21:46.493438 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:21:46.493134 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:21:46.493438 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:21:46.493197 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs podName:b33ff57f-5718-4121-93ca-261066c392d0 nodeName:}" failed. No retries permitted until 2026-06-06 20:23:48.493182038 +0000 UTC m=+252.304526599 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs") pod "network-metrics-daemon-8zgpn" (UID: "b33ff57f-5718-4121-93ca-261066c392d0") : secret "metrics-daemon-secret" not found Jun 06 20:22:14.122351 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:14.122295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hg5g2" podUID="a4c56f4e-7be5-47c8-8f85-a3a5c40a783d" Jun 06 20:22:15.664935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:15.664891 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8zgpn" podUID="b33ff57f-5718-4121-93ca-261066c392d0" Jun 06 20:22:19.010149 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:19.010093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:22:19.010523 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:19.010238 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:22:19.010523 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:19.010299 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls podName:a4c56f4e-7be5-47c8-8f85-a3a5c40a783d nodeName:}" failed. No retries permitted until 2026-06-06 20:24:21.010283664 +0000 UTC m=+284.821628254 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls") pod "dns-default-hg5g2" (UID: "a4c56f4e-7be5-47c8-8f85-a3a5c40a783d") : secret "dns-default-metrics-tls" not found Jun 06 20:22:28.645130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:28.645054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5g2" Jun 06 20:22:29.644402 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:29.644351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:22:40.637082 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.637031 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd"] Jun 06 20:22:40.638996 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.638970 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.640194 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.640169 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr"] Jun 06 20:22:40.640494 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.640477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.640537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.640520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.641332 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.641313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-84mpw\"" Jun 06 20:22:40.642274 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.642256 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.643000 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.642983 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 06 20:22:40.643092 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.642989 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 06 20:22:40.644476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.644460 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 20:22:40.644537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.644515 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.645227 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.645202 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.645338 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.645253 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2s6xx\"" Jun 06 20:22:40.655354 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.655333 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd"] Jun 06 20:22:40.655991 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.655974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr"] Jun 06 20:22:40.731417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.731387 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst"] Jun 06 20:22:40.733196 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.733180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" Jun 06 20:22:40.735398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.735374 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l"] Jun 06 20:22:40.736058 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.736036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fqgf5\"" Jun 06 20:22:40.737407 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.737388 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx"] Jun 06 20:22:40.737520 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.737505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.739017 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.738999 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bbcrk"] Jun 06 20:22:40.739132 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.739117 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.740200 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740053 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.740200 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 06 20:22:40.740200 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740095 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5j47k\"" Jun 06 20:22:40.740547 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740525 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.740747 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740728 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 06 20:22:40.740929 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.740915 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.741229 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xtfh\" (UniqueName: \"kubernetes.io/projected/0c6d6275-d072-42ea-8635-256b99431c1d-kube-api-access-4xtfh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.741302 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741257 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.741351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c6d6275-d072-42ea-8635-256b99431c1d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.741405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.741405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c6d6275-d072-42ea-8635-256b99431c1d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.741512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741413 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 06 20:22:40.741512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741440 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wdwg7\"" Jun 06 20:22:40.741512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741447 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.741512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgh8x\" (UniqueName: \"kubernetes.io/projected/40e09f10-98a9-41a2-8573-ffa51f371f64-kube-api-access-bgh8x\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.741512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.741748 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.741621 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:40.741748 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.741691 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.241675085 +0000 UTC m=+185.053019649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:40.741914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.741898 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:40.742645 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.742629 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.742740 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.742696 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 06 20:22:40.743584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.743564 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 06 20:22:40.743584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.743580 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.743820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.743606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.743820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.743665 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qth6x\"" Jun 06 20:22:40.743820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.743717 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 06 20:22:40.752401 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.752038 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst"] Jun 06 20:22:40.754121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.754096 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l"] Jun 06 20:22:40.755313 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.755293 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 06 20:22:40.755409 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.755318 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx"] Jun 06 20:22:40.765545 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.765523 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bbcrk"] Jun 06 20:22:40.842596 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5nq\" (UniqueName: \"kubernetes.io/projected/38a3cc0c-4945-497c-b5cc-80f494d13b37-kube-api-access-fl5nq\") pod \"network-check-source-dbd9cf844-gcvst\" (UID: \"38a3cc0c-4945-497c-b5cc-80f494d13b37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c6d6275-d072-42ea-8635-256b99431c1d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-config\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc46f\" (UniqueName: \"kubernetes.io/projected/b3967c80-c5ee-4dc4-bea4-1db6236085a1-kube-api-access-kc46f\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c6d6275-d072-42ea-8635-256b99431c1d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.842810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-trusted-ca\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.842852 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgh8x\" (UniqueName: \"kubernetes.io/projected/40e09f10-98a9-41a2-8573-ffa51f371f64-kube-api-access-bgh8x\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.842917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xq4z\" (UniqueName: \"kubernetes.io/projected/bca633b8-7da5-44c0-9e94-dbdee55e8e20-kube-api-access-4xq4z\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.842987 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls podName:40e09f10-98a9-41a2-8573-ffa51f371f64 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.342927931 +0000 UTC m=+185.154272499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c9vfr" (UID: "40e09f10-98a9-41a2-8573-ffa51f371f64") : secret "samples-operator-tls" not found Jun 06 20:22:40.843086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.843048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3967c80-c5ee-4dc4-bea4-1db6236085a1-serving-cert\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.843382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.843099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xtfh\" (UniqueName: \"kubernetes.io/projected/0c6d6275-d072-42ea-8635-256b99431c1d-kube-api-access-4xtfh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.843382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.843166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca633b8-7da5-44c0-9e94-dbdee55e8e20-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.843476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.843393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c6d6275-d072-42ea-8635-256b99431c1d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.844945 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.844925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c6d6275-d072-42ea-8635-256b99431c1d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.858302 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.858270 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xtfh\" (UniqueName: \"kubernetes.io/projected/0c6d6275-d072-42ea-8635-256b99431c1d-kube-api-access-4xtfh\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tll9l\" (UID: \"0c6d6275-d072-42ea-8635-256b99431c1d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:40.858394 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.858358 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgh8x\" (UniqueName: \"kubernetes.io/projected/40e09f10-98a9-41a2-8573-ffa51f371f64-kube-api-access-bgh8x\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:40.921725 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.921653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:40.943429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca633b8-7da5-44c0-9e94-dbdee55e8e20-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.943499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5nq\" (UniqueName: \"kubernetes.io/projected/38a3cc0c-4945-497c-b5cc-80f494d13b37-kube-api-access-fl5nq\") pod \"network-check-source-dbd9cf844-gcvst\" (UID: \"38a3cc0c-4945-497c-b5cc-80f494d13b37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" Jun 06 20:22:40.943499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-config\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.943499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc46f\" (UniqueName: \"kubernetes.io/projected/b3967c80-c5ee-4dc4-bea4-1db6236085a1-kube-api-access-kc46f\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.943606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-trusted-ca\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.943606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.943687 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.943673 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:40.943758 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xq4z\" (UniqueName: \"kubernetes.io/projected/bca633b8-7da5-44c0-9e94-dbdee55e8e20-kube-api-access-4xq4z\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.943758 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:40.943757 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.443738062 +0000 UTC m=+185.255082629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:40.943857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.943785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3967c80-c5ee-4dc4-bea4-1db6236085a1-serving-cert\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.944250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.944230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-config\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.944383 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.944361 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bca633b8-7da5-44c0-9e94-dbdee55e8e20-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.944944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.944927 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3967c80-c5ee-4dc4-bea4-1db6236085a1-trusted-ca\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.945987 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.945969 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3967c80-c5ee-4dc4-bea4-1db6236085a1-serving-cert\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.951955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.951930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc46f\" (UniqueName: \"kubernetes.io/projected/b3967c80-c5ee-4dc4-bea4-1db6236085a1-kube-api-access-kc46f\") pod \"console-operator-668fdbf85c-bbcrk\" (UID: \"b3967c80-c5ee-4dc4-bea4-1db6236085a1\") " pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:40.952063 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.951972 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xq4z\" (UniqueName: \"kubernetes.io/projected/bca633b8-7da5-44c0-9e94-dbdee55e8e20-kube-api-access-4xq4z\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:40.952063 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:40.952038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5nq\" (UniqueName: \"kubernetes.io/projected/38a3cc0c-4945-497c-b5cc-80f494d13b37-kube-api-access-fl5nq\") pod \"network-check-source-dbd9cf844-gcvst\" (UID: \"38a3cc0c-4945-497c-b5cc-80f494d13b37\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" Jun 06 20:22:41.009364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.009320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:41.044396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.044369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" Jun 06 20:22:41.055989 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.055971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" Jun 06 20:22:41.067451 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.067425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:41.177588 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.177524 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst"] Jun 06 20:22:41.181026 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:22:41.181001 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a3cc0c_4945_497c_b5cc_80f494d13b37.slice/crio-db8c96bd300f79b4a2f258135b54503e8ebf7f538410d703263376344df5b2bf WatchSource:0}: Error finding container db8c96bd300f79b4a2f258135b54503e8ebf7f538410d703263376344df5b2bf: Status 404 returned error can't find the container with id db8c96bd300f79b4a2f258135b54503e8ebf7f538410d703263376344df5b2bf Jun 06 20:22:41.196381 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.196347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l"] Jun 06 20:22:41.200305 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:22:41.200278 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6d6275_d072_42ea_8635_256b99431c1d.slice/crio-7cc29088864d4d69880fdbcb74099649ca9ff6e2fdeb5547daf3e5d1c5343e3b WatchSource:0}: Error finding container 7cc29088864d4d69880fdbcb74099649ca9ff6e2fdeb5547daf3e5d1c5343e3b: Status 404 returned error can't find the container with id 7cc29088864d4d69880fdbcb74099649ca9ff6e2fdeb5547daf3e5d1c5343e3b Jun 06 20:22:41.214005 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.213977 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bbcrk"] Jun 06 20:22:41.217035 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:22:41.217013 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3967c80_c5ee_4dc4_bea4_1db6236085a1.slice/crio-23ea3bdcfcc9c7a168b3bbc4d6699f2847a38c3f18ad9008c79c32162d41e500 WatchSource:0}: Error finding container 23ea3bdcfcc9c7a168b3bbc4d6699f2847a38c3f18ad9008c79c32162d41e500: Status 404 returned error can't find the container with id 23ea3bdcfcc9c7a168b3bbc4d6699f2847a38c3f18ad9008c79c32162d41e500 Jun 06 20:22:41.246258 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.246227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:41.246394 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.246358 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:41.246446 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.246425 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.246404889 +0000 UTC m=+186.057749463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:41.347095 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.347059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:41.347269 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.347193 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:22:41.347269 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.347258 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls podName:40e09f10-98a9-41a2-8573-ffa51f371f64 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.347240884 +0000 UTC m=+186.158585450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c9vfr" (UID: "40e09f10-98a9-41a2-8573-ffa51f371f64") : secret "samples-operator-tls" not found Jun 06 20:22:41.447426 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:41.447339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:41.447607 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.447509 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:41.447607 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:41.447596 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.447576651 +0000 UTC m=+186.258921211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:42.165112 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.165076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" event={"ID":"b3967c80-c5ee-4dc4-bea4-1db6236085a1","Type":"ContainerStarted","Data":"23ea3bdcfcc9c7a168b3bbc4d6699f2847a38c3f18ad9008c79c32162d41e500"} Jun 06 20:22:42.166508 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.166481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" event={"ID":"38a3cc0c-4945-497c-b5cc-80f494d13b37","Type":"ContainerStarted","Data":"aa6f586772a2ff5bbc68ae8c6c7952bdf1e345170aeecf2675e6bb51cc0fd14f"} Jun 06 20:22:42.166625 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.166524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" event={"ID":"38a3cc0c-4945-497c-b5cc-80f494d13b37","Type":"ContainerStarted","Data":"db8c96bd300f79b4a2f258135b54503e8ebf7f538410d703263376344df5b2bf"} Jun 06 20:22:42.167481 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.167461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" event={"ID":"0c6d6275-d072-42ea-8635-256b99431c1d","Type":"ContainerStarted","Data":"7cc29088864d4d69880fdbcb74099649ca9ff6e2fdeb5547daf3e5d1c5343e3b"} Jun 06 20:22:42.185985 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.185946 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-gcvst" podStartSLOduration=2.185933027 podStartE2EDuration="2.185933027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:42.185148798 +0000 UTC m=+185.996493382" watchObservedRunningTime="2026-06-06 20:22:42.185933027 +0000 UTC m=+185.997277610" Jun 06 20:22:42.253766 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.253729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:42.253942 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.253908 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:42.254015 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.253987 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.253965634 +0000 UTC m=+188.065310200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:42.354420 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.354361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:42.354598 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.354488 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:22:42.354598 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.354560 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls podName:40e09f10-98a9-41a2-8573-ffa51f371f64 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.354540653 +0000 UTC m=+188.165885232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c9vfr" (UID: "40e09f10-98a9-41a2-8573-ffa51f371f64") : secret "samples-operator-tls" not found Jun 06 20:22:42.455641 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:42.455544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:42.455822 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.455718 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:42.455822 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:42.455790 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.45577405 +0000 UTC m=+188.267118621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:43.128978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:43.128929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:43.174990 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:43.174953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:44.174627 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.174537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" event={"ID":"0c6d6275-d072-42ea-8635-256b99431c1d","Type":"ContainerStarted","Data":"537a3f538a79f90f31f87f9853715e9f0a383dcb99a820abc9aea36854234803"} Jun 06 20:22:44.176055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.176037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/0.log" Jun 06 20:22:44.176414 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.176075 2575 generic.go:356] "Generic (PLEG): container finished" podID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" containerID="476cc73e6969b6d8e359fb281b90a1c412cf5dc9d16a7f39ca33dd39a48e1bab" exitCode=255 Jun 06 20:22:44.176414 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.176108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" event={"ID":"b3967c80-c5ee-4dc4-bea4-1db6236085a1","Type":"ContainerDied","Data":"476cc73e6969b6d8e359fb281b90a1c412cf5dc9d16a7f39ca33dd39a48e1bab"} Jun 06 20:22:44.176414 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.176284 2575 scope.go:117] "RemoveContainer" containerID="476cc73e6969b6d8e359fb281b90a1c412cf5dc9d16a7f39ca33dd39a48e1bab" Jun 06 20:22:44.190210 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.190162 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" podStartSLOduration=1.484362539 podStartE2EDuration="4.190146338s" totalImagesPullingTime="2.705783799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:44.189589551 +0000 UTC m=+188.000934135" watchObservedRunningTime="2026-06-06 20:22:44.190146338 +0000 UTC m=+188.001490922" Jun 06 20:22:44.270909 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.270875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:44.271066 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.271047 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:44.271163 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.271149 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.271127619 +0000 UTC m=+192.082472194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:44.371946 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.371911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:44.372066 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.372043 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:22:44.372120 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.372110 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls podName:40e09f10-98a9-41a2-8573-ffa51f371f64 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.372093487 +0000 UTC m=+192.183438047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c9vfr" (UID: "40e09f10-98a9-41a2-8573-ffa51f371f64") : secret "samples-operator-tls" not found Jun 06 20:22:44.472678 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.472602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:44.472821 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.472765 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:44.472867 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:44.472832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.472815881 +0000 UTC m=+192.284160441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:44.987184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:44.987146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:45.081985 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.081949 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:45.180459 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.180436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/1.log" Jun 06 20:22:45.181020 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.180758 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:45.181020 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.180900 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/0.log" Jun 06 20:22:45.181020 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.180944 2575 generic.go:356] "Generic (PLEG): container finished" podID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" exitCode=255 Jun 06 20:22:45.181020 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.181008 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" event={"ID":"b3967c80-c5ee-4dc4-bea4-1db6236085a1","Type":"ContainerDied","Data":"a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018"} Jun 06 20:22:45.181224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.181073 2575 scope.go:117] "RemoveContainer" containerID="476cc73e6969b6d8e359fb281b90a1c412cf5dc9d16a7f39ca33dd39a48e1bab" Jun 06 20:22:45.181224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.181221 2575 scope.go:117] "RemoveContainer" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" Jun 06 20:22:45.181409 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:45.181385 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:22:45.914525 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:45.914490 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:46.015299 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.015270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:46.184963 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.184884 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/1.log" Jun 06 20:22:46.185290 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.185208 2575 scope.go:117] "RemoveContainer" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" Jun 06 20:22:46.185365 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:46.185347 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:22:46.341694 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.341662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:46.615883 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.615852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:46.718618 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:46.718586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:47.147945 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:47.147911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:47.200401 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:47.200374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:47.662836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:47.662811 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fznv_1dafddc6-3e69-427f-a8fa-cc7d871211f2/dns-node-resolver/0.log" Jun 06 20:22:48.213093 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.213059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bzbd9"] Jun 06 20:22:48.216011 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.215990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.218394 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.218374 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 06 20:22:48.218507 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.218472 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 06 20:22:48.218574 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.218566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 06 20:22:48.219181 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.219163 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 06 20:22:48.219181 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.219167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vq4dj\"" Jun 06 20:22:48.224909 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.224890 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bzbd9"] Jun 06 20:22:48.247561 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.247528 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:48.297088 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.297062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:48.298051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.298027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:48.298165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.298079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-cabundle\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.298165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.298115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-key\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.298165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.298149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6qt\" (UniqueName: \"kubernetes.io/projected/75ba2e63-5605-4a3e-9d51-9f406dd67c70-kube-api-access-jx6qt\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.298165 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.298155 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:48.298310 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.298219 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.298207199 +0000 UTC m=+200.109551760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:48.398606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.398573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-cabundle\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.398755 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.398621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:48.398755 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.398638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-key\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.398755 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.398671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6qt\" (UniqueName: \"kubernetes.io/projected/75ba2e63-5605-4a3e-9d51-9f406dd67c70-kube-api-access-jx6qt\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.398755 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.398745 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 20:22:48.398941 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.398807 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls podName:40e09f10-98a9-41a2-8573-ffa51f371f64 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.398790047 +0000 UTC m=+200.210134607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-c9vfr" (UID: "40e09f10-98a9-41a2-8573-ffa51f371f64") : secret "samples-operator-tls" not found Jun 06 20:22:48.399403 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.399381 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-cabundle\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.400980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.400954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/75ba2e63-5605-4a3e-9d51-9f406dd67c70-signing-key\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.407037 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.407016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6qt\" (UniqueName: \"kubernetes.io/projected/75ba2e63-5605-4a3e-9d51-9f406dd67c70-kube-api-access-jx6qt\") pod \"service-ca-7d74d578b8-bzbd9\" (UID: \"75ba2e63-5605-4a3e-9d51-9f406dd67c70\") " pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.499546 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.499490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:48.499627 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.499582 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:48.499667 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:48.499629 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.499617044 +0000 UTC m=+200.310961605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:48.525223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.525204 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" Jun 06 20:22:48.640533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:48.640500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bzbd9"] Jun 06 20:22:48.643607 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:22:48.643582 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ba2e63_5605_4a3e_9d51_9f406dd67c70.slice/crio-c91539804f63d6261b689c6b2ce48e3e5d585b278863e371cc0a334b01e82540 WatchSource:0}: Error finding container c91539804f63d6261b689c6b2ce48e3e5d585b278863e371cc0a334b01e82540: Status 404 returned error can't find the container with id c91539804f63d6261b689c6b2ce48e3e5d585b278863e371cc0a334b01e82540 Jun 06 20:22:49.063374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:49.063351 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml7q8_9125843c-8115-4094-9711-4ffcd690547d/node-ca/0.log" Jun 06 20:22:49.072823 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:49.072786 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:49.194954 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:49.194918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" event={"ID":"75ba2e63-5605-4a3e-9d51-9f406dd67c70","Type":"ContainerStarted","Data":"c91539804f63d6261b689c6b2ce48e3e5d585b278863e371cc0a334b01e82540"} Jun 06 20:22:49.863087 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:49.863043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5v6s_f85be7f4-fd60-47aa-b6b0-0e533d639e10/serve-healthcheck-canary/0.log" Jun 06 20:22:50.464388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:50.464361 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tll9l_0c6d6275-d072-42ea-8635-256b99431c1d/kube-storage-version-migrator-operator/0.log" Jun 06 20:22:51.068541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.068510 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:51.068919 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.068572 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:22:51.068963 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.068934 2575 scope.go:117] "RemoveContainer" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" Jun 06 20:22:51.069115 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:51.069093 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:22:51.202128 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.202098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" event={"ID":"75ba2e63-5605-4a3e-9d51-9f406dd67c70","Type":"ContainerStarted","Data":"433ff442258ca660900b4fad29b7584f948439fe76d1272955463c87ebe2442d"} Jun 06 20:22:51.216278 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.216223 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-bzbd9" podStartSLOduration=1.5907389969999999 podStartE2EDuration="3.216207804s" totalImagesPullingTime="1.625468807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:51.215960763 +0000 UTC m=+195.027305347" watchObservedRunningTime="2026-06-06 20:22:51.216207804 +0000 UTC m=+195.027552389" Jun 06 20:22:51.808495 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.808466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:51.967463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:51.967433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:52.073229 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:52.073142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:52.169751 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:52.169683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:52.271577 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:52.271538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:52.369359 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:52.369269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:52.657847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:52.657767 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:53.657389 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:53.657359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:54.056867 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:54.056833 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:54.257750 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:54.257716 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:54.464527 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:54.464448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:54.859051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:54.859002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:54.911835 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:54.911806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:55.119057 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:55.118975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:55.655701 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:55.655673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:55.864797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:55.864764 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:55.964953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:55.964886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:56.257719 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.257639 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:56.362132 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.362099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:22:56.362301 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:56.362224 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 20:22:56.362301 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:56.362275 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert podName:9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22 nodeName:}" failed. No retries permitted until 2026-06-06 20:23:12.362262599 +0000 UTC m=+216.173607160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qlpfd" (UID: "9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22") : secret "networking-console-plugin-cert" not found Jun 06 20:22:56.459720 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.459689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:56.462747 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.462723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:56.465052 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.465029 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40e09f10-98a9-41a2-8573-ffa51f371f64-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-c9vfr\" (UID: \"40e09f10-98a9-41a2-8573-ffa51f371f64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:56.514385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.514323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:56.555495 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.555458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" Jun 06 20:22:56.563758 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.563735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:22:56.563872 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:56.563857 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:56.563935 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:22:56.563924 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls podName:bca633b8-7da5-44c0-9e94-dbdee55e8e20 nodeName:}" failed. No retries permitted until 2026-06-06 20:23:12.563905557 +0000 UTC m=+216.375250119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xtffx" (UID: "bca633b8-7da5-44c0-9e94-dbdee55e8e20") : secret "cluster-monitoring-operator-tls" not found Jun 06 20:22:56.685924 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:56.685892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr"] Jun 06 20:22:57.058299 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:57.058267 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:57.223716 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:57.223656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" event={"ID":"40e09f10-98a9-41a2-8573-ffa51f371f64","Type":"ContainerStarted","Data":"8c55d55e48a22c7e91900224fe64e8037f956d747d976467e19a25ef000161b3"} Jun 06 20:22:57.257100 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:57.257068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:57.861011 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:57.860976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:58.087818 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:58.087757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:58.257918 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:58.257892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:58.499241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:58.499173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:58.659194 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:58.659167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:58.861659 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:58.861628 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:59.231482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:59.231399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" event={"ID":"40e09f10-98a9-41a2-8573-ffa51f371f64","Type":"ContainerStarted","Data":"2f25ccff8c15886b4b7d985e3e58fe157e8f5d94b09713d54ad491c3a41e17d0"} Jun 06 20:22:59.231482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:59.231463 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" event={"ID":"40e09f10-98a9-41a2-8573-ffa51f371f64","Type":"ContainerStarted","Data":"78f51aae3f1c4212375a9657558d0faea11ba7d2273de8196535759c2efaa17b"} Jun 06 20:22:59.245887 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:59.245827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-c9vfr" podStartSLOduration=17.753419401 podStartE2EDuration="19.245808798s" totalImagesPullingTime="1.492389397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:59.24557862 +0000 UTC m=+203.056923204" watchObservedRunningTime="2026-06-06 20:22:59.245808798 +0000 UTC m=+203.057153388" Jun 06 20:22:59.256130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:59.256104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:22:59.660433 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:22:59.660401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:00.263998 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:00.263952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:00.460730 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:00.460677 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:00.659943 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:00.659908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:01.662054 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:01.662023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:01.860016 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:01.859979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:02.263765 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:02.263734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:02.458086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:02.458052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:02.658062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:02.658024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:06.645866 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:06.645830 2575 scope.go:117] "RemoveContainer" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" Jun 06 20:23:07.258476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.258450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:23:07.258863 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.258848 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/1.log" Jun 06 20:23:07.258923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.258880 2575 generic.go:356] "Generic (PLEG): container finished" podID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" containerID="38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936" exitCode=255 Jun 06 20:23:07.258923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.258915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" event={"ID":"b3967c80-c5ee-4dc4-bea4-1db6236085a1","Type":"ContainerDied","Data":"38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936"} Jun 06 20:23:07.258994 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.258959 2575 scope.go:117] "RemoveContainer" containerID="a186059b6a391cdcfb925d061de69768ecc31616763b09df47e751720c729018" Jun 06 20:23:07.259279 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:07.259255 2575 scope.go:117] "RemoveContainer" containerID="38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936" Jun 06 20:23:07.259452 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:07.259433 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:23:08.263686 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.263660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:23:08.701113 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.701083 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vch7b"] Jun 06 20:23:08.705342 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.705324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.707877 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.707856 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bf6nr\"" Jun 06 20:23:08.707973 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.707950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 20:23:08.708866 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.708842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 20:23:08.708969 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.708846 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 20:23:08.708969 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.708877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 20:23:08.716716 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.716686 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vch7b"] Jun 06 20:23:08.758410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.758391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.758533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.758430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-data-volume\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.758533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.758448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-crio-socket\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.758533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.758507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2m5w\" (UniqueName: \"kubernetes.io/projected/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-api-access-b2m5w\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.758682 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.758580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.768629 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.768609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69f9cdc847-7grqh"] Jun 06 20:23:08.771315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.771296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.773663 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.773646 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rp5vr\"" Jun 06 20:23:08.774151 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.774137 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 20:23:08.774405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.774389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 20:23:08.774462 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.774413 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 20:23:08.779370 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.779329 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 20:23:08.786066 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.786045 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f9cdc847-7grqh"] Jun 06 20:23:08.858928 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.858902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-tls\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.858941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-bound-sa-token\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.858984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2m5w\" (UniqueName: \"kubernetes.io/projected/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-api-access-b2m5w\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-trusted-ca\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xwmz\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-kube-api-access-9xwmz\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-certificates\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f442446c-6782-47a5-8ab5-d3b952b0540f-ca-trust-extracted\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-image-registry-private-configuration\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-data-volume\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-crio-socket\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-installation-pull-secrets\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.859539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859404 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-crio-socket\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859580 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859552 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-data-volume\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.859806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.859788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.861212 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.861196 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.866640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.866617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2m5w\" (UniqueName: \"kubernetes.io/projected/0aa08c1b-707e-4170-8ef6-afed3c14b4e6-kube-api-access-b2m5w\") pod \"insights-runtime-extractor-vch7b\" (UID: \"0aa08c1b-707e-4170-8ef6-afed3c14b4e6\") " pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:08.960398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960342 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-bound-sa-token\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-trusted-ca\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xwmz\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-kube-api-access-9xwmz\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-certificates\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f442446c-6782-47a5-8ab5-d3b952b0540f-ca-trust-extracted\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960692 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-image-registry-private-configuration\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960692 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-installation-pull-secrets\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960823 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960803 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f442446c-6782-47a5-8ab5-d3b952b0540f-ca-trust-extracted\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.960879 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.960844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-tls\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.961365 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.961347 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-certificates\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.961449 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.961406 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f442446c-6782-47a5-8ab5-d3b952b0540f-trusted-ca\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.962874 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.962857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-image-registry-private-configuration\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.962960 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.962934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-registry-tls\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.963057 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.963038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f442446c-6782-47a5-8ab5-d3b952b0540f-installation-pull-secrets\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.970180 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.970161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-bound-sa-token\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:08.970526 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:08.970507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xwmz\" (UniqueName: \"kubernetes.io/projected/f442446c-6782-47a5-8ab5-d3b952b0540f-kube-api-access-9xwmz\") pod \"image-registry-69f9cdc847-7grqh\" (UID: \"f442446c-6782-47a5-8ab5-d3b952b0540f\") " pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:09.013864 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.013843 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vch7b" Jun 06 20:23:09.061873 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.061813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:09.080780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.080759 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:09.125875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.125845 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:09.135501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.135460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vch7b"] Jun 06 20:23:09.140839 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:09.140813 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa08c1b_707e_4170_8ef6_afed3c14b4e6.slice/crio-306e578126562c08f0c94d97d65fa400d386dd4430d40dd458cbcbf3e9be2a57 WatchSource:0}: Error finding container 306e578126562c08f0c94d97d65fa400d386dd4430d40dd458cbcbf3e9be2a57: Status 404 returned error can't find the container with id 306e578126562c08f0c94d97d65fa400d386dd4430d40dd458cbcbf3e9be2a57 Jun 06 20:23:09.209859 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.209834 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f9cdc847-7grqh"] Jun 06 20:23:09.212493 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:09.212472 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf442446c_6782_47a5_8ab5_d3b952b0540f.slice/crio-91dd92030588c21a8ec33dcae1a4a65a46d83ff43d11e98df08771eaa36bb10e WatchSource:0}: Error finding container 91dd92030588c21a8ec33dcae1a4a65a46d83ff43d11e98df08771eaa36bb10e: Status 404 returned error can't find the container with id 91dd92030588c21a8ec33dcae1a4a65a46d83ff43d11e98df08771eaa36bb10e Jun 06 20:23:09.233059 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.233024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:09.268242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.268217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" event={"ID":"f442446c-6782-47a5-8ab5-d3b952b0540f","Type":"ContainerStarted","Data":"91dd92030588c21a8ec33dcae1a4a65a46d83ff43d11e98df08771eaa36bb10e"} Jun 06 20:23:09.269633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.269613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vch7b" event={"ID":"0aa08c1b-707e-4170-8ef6-afed3c14b4e6","Type":"ContainerStarted","Data":"5a1bae9b2ec11e4840379a27843595f6a580f51f4e8262e4a6d6db54d62d9803"} Jun 06 20:23:09.269749 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.269655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vch7b" event={"ID":"0aa08c1b-707e-4170-8ef6-afed3c14b4e6","Type":"ContainerStarted","Data":"306e578126562c08f0c94d97d65fa400d386dd4430d40dd458cbcbf3e9be2a57"} Jun 06 20:23:09.333242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:09.333208 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:10.274600 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:10.274501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" event={"ID":"f442446c-6782-47a5-8ab5-d3b952b0540f","Type":"ContainerStarted","Data":"82710354ece5b491ade120f45d923b50f0648e2c45db60925f6f7bbabb76393f"} Jun 06 20:23:10.274600 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:10.274571 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:10.276102 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:10.276079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vch7b" event={"ID":"0aa08c1b-707e-4170-8ef6-afed3c14b4e6","Type":"ContainerStarted","Data":"310ab1edfbf9d376c38280b3b63817f4e96124bbeca702acc7050b0b27aa65ca"} Jun 06 20:23:11.068231 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:11.068199 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:23:11.068410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:11.068289 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:23:11.068656 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:11.068639 2575 scope.go:117] "RemoveContainer" containerID="38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936" Jun 06 20:23:11.068860 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:11.068836 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:23:11.085512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:11.085458 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podStartSLOduration=3.085439098 podStartE2EDuration="3.085439098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:10.29345088 +0000 UTC m=+214.104795484" watchObservedRunningTime="2026-06-06 20:23:11.085439098 +0000 UTC m=+214.896783680" Jun 06 20:23:12.284927 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.284893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vch7b" event={"ID":"0aa08c1b-707e-4170-8ef6-afed3c14b4e6","Type":"ContainerStarted","Data":"80451e157267c3e99834a684b5cd3a612dfeb532decfcca105c5882c2a5feff8"} Jun 06 20:23:12.303479 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.303428 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vch7b" podStartSLOduration=2.208456363 podStartE2EDuration="4.3034142s" totalImagesPullingTime="2.094957837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:23:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:12.302339146 +0000 UTC m=+216.113683729" watchObservedRunningTime="2026-06-06 20:23:12.3034142 +0000 UTC m=+216.114758783" Jun 06 20:23:12.386521 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.386487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:23:12.388907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.388888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qlpfd\" (UID: \"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:23:12.450055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.450027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" Jun 06 20:23:12.568759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.568735 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd"] Jun 06 20:23:12.570675 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:12.570655 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e40d9cd_cfbb_4e2b_a45c_a9a40831bf22.slice/crio-bd3b35e29a8d409f9a43d7cb88889d2bb20e53c8268e1c0c54a20f7789515b76 WatchSource:0}: Error finding container bd3b35e29a8d409f9a43d7cb88889d2bb20e53c8268e1c0c54a20f7789515b76: Status 404 returned error can't find the container with id bd3b35e29a8d409f9a43d7cb88889d2bb20e53c8268e1c0c54a20f7789515b76 Jun 06 20:23:12.588316 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.588294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:23:12.590585 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.590561 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bca633b8-7da5-44c0-9e94-dbdee55e8e20-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xtffx\" (UID: \"bca633b8-7da5-44c0-9e94-dbdee55e8e20\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:23:12.862691 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.862611 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" Jun 06 20:23:12.987616 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:12.987580 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx"] Jun 06 20:23:12.990286 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:12.990265 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca633b8_7da5_44c0_9e94_dbdee55e8e20.slice/crio-39414303c694b1181c7b41274608b4d7c3dd6852d44f1acc5d94c105ffe7c11a WatchSource:0}: Error finding container 39414303c694b1181c7b41274608b4d7c3dd6852d44f1acc5d94c105ffe7c11a: Status 404 returned error can't find the container with id 39414303c694b1181c7b41274608b4d7c3dd6852d44f1acc5d94c105ffe7c11a Jun 06 20:23:13.289427 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:13.289341 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" event={"ID":"bca633b8-7da5-44c0-9e94-dbdee55e8e20","Type":"ContainerStarted","Data":"39414303c694b1181c7b41274608b4d7c3dd6852d44f1acc5d94c105ffe7c11a"} Jun 06 20:23:13.290639 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:13.290610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" event={"ID":"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22","Type":"ContainerStarted","Data":"bd3b35e29a8d409f9a43d7cb88889d2bb20e53c8268e1c0c54a20f7789515b76"} Jun 06 20:23:14.295976 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:14.295941 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" event={"ID":"9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22","Type":"ContainerStarted","Data":"74b7938b23613837bbf95654868a7e63caf1e44591ef0fdd14a1e48b5822d67c"} Jun 06 20:23:14.311896 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:14.311802 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qlpfd" podStartSLOduration=33.223230069 podStartE2EDuration="34.311782571s" totalImagesPullingTime="1.088552502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:14.311520543 +0000 UTC m=+218.122865137" watchObservedRunningTime="2026-06-06 20:23:14.311782571 +0000 UTC m=+218.123127156" Jun 06 20:23:14.397615 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:14.397581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:14.498221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:14.498190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:14.549994 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:14.549967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:15.305781 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.305740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" event={"ID":"bca633b8-7da5-44c0-9e94-dbdee55e8e20","Type":"ContainerStarted","Data":"9de9ac336735ec588dcfc1201ca78d624db0017e5154ecbc0a5a2f56e658db25"} Jun 06 20:23:15.325050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.324996 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xtffx" podStartSLOduration=33.274641342 podStartE2EDuration="35.324980484s" totalImagesPullingTime="2.050339142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:15.324683606 +0000 UTC m=+219.136028189" watchObservedRunningTime="2026-06-06 20:23:15.324980484 +0000 UTC m=+219.136325069" Jun 06 20:23:15.347182 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.347132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:15.448624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.448589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:15.507203 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.507170 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj"] Jun 06 20:23:15.510254 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.510237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:15.512412 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.512391 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 20:23:15.512531 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.512438 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kc778\"" Jun 06 20:23:15.519757 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.519736 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj"] Jun 06 20:23:15.526348 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.526326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:15.613224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.613131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pvwcj\" (UID: \"b34bf53b-3a43-458c-815c-99506161178a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:15.714596 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.714564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pvwcj\" (UID: \"b34bf53b-3a43-458c-815c-99506161178a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:15.714851 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:15.714731 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 06 20:23:15.714851 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:15.714809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates podName:b34bf53b-3a43-458c-815c-99506161178a nodeName:}" failed. No retries permitted until 2026-06-06 20:23:16.21479521 +0000 UTC m=+220.026139770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-pvwcj" (UID: "b34bf53b-3a43-458c-815c-99506161178a") : secret "prometheus-operator-admission-webhook-tls" not found Jun 06 20:23:15.844413 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:15.844383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:16.218785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:16.218754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pvwcj\" (UID: \"b34bf53b-3a43-458c-815c-99506161178a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:16.221063 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:16.221037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b34bf53b-3a43-458c-815c-99506161178a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pvwcj\" (UID: \"b34bf53b-3a43-458c-815c-99506161178a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:16.420295 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:16.420255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:16.536174 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:16.536143 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj"] Jun 06 20:23:16.538875 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:16.538842 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34bf53b_3a43_458c_815c_99506161178a.slice/crio-32a9374f8c31ffa6e7b2d5f5df7a05c9f38c7a07eb31e9dfedfa2a394e04cbf7 WatchSource:0}: Error finding container 32a9374f8c31ffa6e7b2d5f5df7a05c9f38c7a07eb31e9dfedfa2a394e04cbf7: Status 404 returned error can't find the container with id 32a9374f8c31ffa6e7b2d5f5df7a05c9f38c7a07eb31e9dfedfa2a394e04cbf7 Jun 06 20:23:17.313756 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:17.313698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" event={"ID":"b34bf53b-3a43-458c-815c-99506161178a","Type":"ContainerStarted","Data":"32a9374f8c31ffa6e7b2d5f5df7a05c9f38c7a07eb31e9dfedfa2a394e04cbf7"} Jun 06 20:23:18.318112 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.318076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" event={"ID":"b34bf53b-3a43-458c-815c-99506161178a","Type":"ContainerStarted","Data":"406e76bb593e613936a16192e411980882544bdb139b77d3b9c31da1b88e2653"} Jun 06 20:23:18.318473 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.318270 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:18.322972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.322944 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" Jun 06 20:23:18.332452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.332413 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pvwcj" podStartSLOduration=2.125101141 podStartE2EDuration="3.332400546s" totalImagesPullingTime="1.207299405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:18.331872097 +0000 UTC m=+222.143216679" watchObservedRunningTime="2026-06-06 20:23:18.332400546 +0000 UTC m=+222.143745129" Jun 06 20:23:18.539917 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.539874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:18.604925 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.604844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:18.728347 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:18.728317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:20.506871 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:20.506839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:21.645459 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:21.645432 2575 scope.go:117] "RemoveContainer" containerID="38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936" Jun 06 20:23:21.645869 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:21.645579 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-bbcrk_openshift-console-operator(b3967c80-c5ee-4dc4-bea4-1db6236085a1)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podUID="b3967c80-c5ee-4dc4-bea4-1db6236085a1" Jun 06 20:23:22.280817 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.280782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:22.382031 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.382004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:22.482434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.482403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:22.676359 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.676329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:22.903977 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.903941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:22.917953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.917924 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj"] Jun 06 20:23:22.920536 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.920520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:22.923000 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.922967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 06 20:23:22.923091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.923072 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 06 20:23:22.923821 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.923802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8fplz\"" Jun 06 20:23:22.923915 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.923805 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 20:23:22.932334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.932313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj"] Jun 06 20:23:22.939661 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.939633 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl"] Jun 06 20:23:22.941807 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.941776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:22.944084 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.944064 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hg8zn"] Jun 06 20:23:22.944581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.944563 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 06 20:23:22.944809 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.944793 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2hsnm\"" Jun 06 20:23:22.944946 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.944933 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 06 20:23:22.945104 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.945091 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 06 20:23:22.946742 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.946684 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:22.949142 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.949116 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7x6d4\"" Jun 06 20:23:22.949236 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.949165 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 20:23:22.949327 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.949311 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 20:23:22.949474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.949374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 20:23:22.955491 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:22.955473 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl"] Jun 06 20:23:23.000312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.000283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.064517 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.064484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.072250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-tls\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.072387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-textfile\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.072549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-root\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-wtmp\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-metrics-client-ca\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.072699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.072699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtm55\" (UniqueName: \"kubernetes.io/projected/9e86188d-8d78-47c2-b63f-95c454d59381-kube-api-access-jtm55\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287633ed-23e9-488a-a8c8-d14196b34ad5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b96fl\" (UniqueName: \"kubernetes.io/projected/4859efe4-968f-42ea-ac68-233297312f1e-kube-api-access-b96fl\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4859efe4-968f-42ea-ac68-233297312f1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-sys\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072893 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvr7h\" (UniqueName: \"kubernetes.io/projected/287633ed-23e9-488a-a8c8-d14196b34ad5-kube-api-access-pvr7h\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.072984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.072922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.165122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.165088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.174191 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-root\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174304 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-wtmp\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174304 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-metrics-client-ca\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174304 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-root\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtm55\" (UniqueName: \"kubernetes.io/projected/9e86188d-8d78-47c2-b63f-95c454d59381-kube-api-access-jtm55\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287633ed-23e9-488a-a8c8-d14196b34ad5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b96fl\" (UniqueName: \"kubernetes.io/projected/4859efe4-968f-42ea-ac68-233297312f1e-kube-api-access-b96fl\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174420 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4859efe4-968f-42ea-ac68-233297312f1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:23.174432 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 06 20:23:23.174461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-sys\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:23.174522 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls podName:4859efe4-968f-42ea-ac68-233297312f1e nodeName:}" failed. No retries permitted until 2026-06-06 20:23:23.674502866 +0000 UTC m=+227.485847442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-55hnl" (UID: "4859efe4-968f-42ea-ac68-233297312f1e") : secret "kube-state-metrics-tls" not found Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvr7h\" (UniqueName: \"kubernetes.io/projected/287633ed-23e9-488a-a8c8-d14196b34ad5-kube-api-access-pvr7h\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-tls\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-textfile\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.174885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.175373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4859efe4-968f-42ea-ac68-233297312f1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.175373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.174389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-wtmp\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.175373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e86188d-8d78-47c2-b63f-95c454d59381-sys\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.175373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/287633ed-23e9-488a-a8c8-d14196b34ad5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.175373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175139 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.176076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175782 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4859efe4-968f-42ea-ac68-233297312f1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.176076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-metrics-client-ca\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.176076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.175854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.176076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.176040 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-textfile\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.177322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.177300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.177939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.177919 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.178097 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.178066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/287633ed-23e9-488a-a8c8-d14196b34ad5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.178298 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.178278 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.178986 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.178940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e86188d-8d78-47c2-b63f-95c454d59381-node-exporter-tls\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.182047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.182026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b96fl\" (UniqueName: \"kubernetes.io/projected/4859efe4-968f-42ea-ac68-233297312f1e-kube-api-access-b96fl\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.186808 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.186787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvr7h\" (UniqueName: \"kubernetes.io/projected/287633ed-23e9-488a-a8c8-d14196b34ad5-kube-api-access-pvr7h\") pod \"openshift-state-metrics-65f78d5c66-j2sfj\" (UID: \"287633ed-23e9-488a-a8c8-d14196b34ad5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.187262 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.187236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtm55\" (UniqueName: \"kubernetes.io/projected/9e86188d-8d78-47c2-b63f-95c454d59381-kube-api-access-jtm55\") pod \"node-exporter-hg8zn\" (UID: \"9e86188d-8d78-47c2-b63f-95c454d59381\") " pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.230606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.230585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" Jun 06 20:23:23.259560 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.259533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg8zn" Jun 06 20:23:23.265526 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.265503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.270171 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:23.270148 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e86188d_8d78_47c2_b63f_95c454d59381.slice/crio-98a1a46ea7e132467aad06ea504b4ac5d5552bf41daa14560dd6a613f26a71b5 WatchSource:0}: Error finding container 98a1a46ea7e132467aad06ea504b4ac5d5552bf41daa14560dd6a613f26a71b5: Status 404 returned error can't find the container with id 98a1a46ea7e132467aad06ea504b4ac5d5552bf41daa14560dd6a613f26a71b5 Jun 06 20:23:23.336741 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.336693 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg8zn" event={"ID":"9e86188d-8d78-47c2-b63f-95c454d59381","Type":"ContainerStarted","Data":"98a1a46ea7e132467aad06ea504b4ac5d5552bf41daa14560dd6a613f26a71b5"} Jun 06 20:23:23.362102 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.362078 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj"] Jun 06 20:23:23.364736 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:23.364697 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287633ed_23e9_488a_a8c8_d14196b34ad5.slice/crio-277d08a8472f9b36aeffa094e08ef65d8791cb5a94eecea4bd5fe32667c97c8f WatchSource:0}: Error finding container 277d08a8472f9b36aeffa094e08ef65d8791cb5a94eecea4bd5fe32667c97c8f: Status 404 returned error can't find the container with id 277d08a8472f9b36aeffa094e08ef65d8791cb5a94eecea4bd5fe32667c97c8f Jun 06 20:23:23.364927 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.364910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.439975 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.439950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:23.678609 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.678574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.681211 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.681147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4859efe4-968f-42ea-ac68-233297312f1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-55hnl\" (UID: \"4859efe4-968f-42ea-ac68-233297312f1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.852825 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.852793 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" Jun 06 20:23:23.906994 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:23.906962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:24.006488 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.006365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:24.010988 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.010960 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:23:24.016806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.016770 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.019385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019165 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 20:23:24.019385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019227 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 20:23:24.019385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019249 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 20:23:24.019385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2rp92\"" Jun 06 20:23:24.019647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019578 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 20:23:24.019647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019586 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 20:23:24.019647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019593 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 20:23:24.019647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019584 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 20:23:24.019865 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 20:23:24.019945 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.019927 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 20:23:24.030976 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.030952 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:23:24.083860 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.083833 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084016 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.083888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084016 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.083997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdlp\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.084584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.084351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.105168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.105144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:24.185541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdlp\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.185983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.185952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.186313 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:23:24.186101 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle podName:f84b8df0-78bf-48ad-b814-981633d90e68 nodeName:}" failed. No retries permitted until 2026-06-06 20:23:24.686078986 +0000 UTC m=+228.497423569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68") : configmap references non-existent config key: ca-bundle.crt Jun 06 20:23:24.186410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.186386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.187023 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.187000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.187116 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.187052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.190056 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.190024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.190678 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.190633 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.190831 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.190747 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.190929 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.190886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.191224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.191193 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.191315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.191201 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.191463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.191424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.191886 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.191865 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.193041 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.193018 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.196415 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.196395 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdlp\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.199023 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.198805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl"] Jun 06 20:23:24.203908 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:24.203881 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4859efe4_968f_42ea_ac68_233297312f1e.slice/crio-cfc0a37fa205b96d15ba5e65cc76d2c0505e5d742645887bc8ae325ce83a6a69 WatchSource:0}: Error finding container cfc0a37fa205b96d15ba5e65cc76d2c0505e5d742645887bc8ae325ce83a6a69: Status 404 returned error can't find the container with id cfc0a37fa205b96d15ba5e65cc76d2c0505e5d742645887bc8ae325ce83a6a69 Jun 06 20:23:24.342177 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.342130 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" event={"ID":"4859efe4-968f-42ea-ac68-233297312f1e","Type":"ContainerStarted","Data":"cfc0a37fa205b96d15ba5e65cc76d2c0505e5d742645887bc8ae325ce83a6a69"} Jun 06 20:23:24.343983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.343952 2575 generic.go:356] "Generic (PLEG): container finished" podID="9e86188d-8d78-47c2-b63f-95c454d59381" containerID="9bbcf193a22c78669eac6cab896e67cd26f53dc93ae6ea4f7fa39c52a9f298a7" exitCode=0 Jun 06 20:23:24.344113 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.344045 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg8zn" event={"ID":"9e86188d-8d78-47c2-b63f-95c454d59381","Type":"ContainerDied","Data":"9bbcf193a22c78669eac6cab896e67cd26f53dc93ae6ea4f7fa39c52a9f298a7"} Jun 06 20:23:24.346310 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.346289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" event={"ID":"287633ed-23e9-488a-a8c8-d14196b34ad5","Type":"ContainerStarted","Data":"7b93ba7360e9f1ec5b26aed4c450d5b373551dea4ebbf3f06242376e48e10c71"} Jun 06 20:23:24.346410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.346342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" event={"ID":"287633ed-23e9-488a-a8c8-d14196b34ad5","Type":"ContainerStarted","Data":"3a8b2987de74ced96618bab177a153c1f63e79f184a852290b8bfdc75f5832c0"} Jun 06 20:23:24.346410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.346370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" event={"ID":"287633ed-23e9-488a-a8c8-d14196b34ad5","Type":"ContainerStarted","Data":"277d08a8472f9b36aeffa094e08ef65d8791cb5a94eecea4bd5fe32667c97c8f"} Jun 06 20:23:24.690594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.690563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.691449 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.691422 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:24.930336 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:24.930308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:23:25.083948 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.083921 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:23:25.085791 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:25.085764 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84b8df0_78bf_48ad_b814_981633d90e68.slice/crio-15e7b2c884e1bed832acfcb182ca3b09f721c5426436faed59cca710fb58535c WatchSource:0}: Error finding container 15e7b2c884e1bed832acfcb182ca3b09f721c5426436faed59cca710fb58535c: Status 404 returned error can't find the container with id 15e7b2c884e1bed832acfcb182ca3b09f721c5426436faed59cca710fb58535c Jun 06 20:23:25.351984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.351954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg8zn" event={"ID":"9e86188d-8d78-47c2-b63f-95c454d59381","Type":"ContainerStarted","Data":"0093e14323d35853ae9959017e3fd38e7f753de7db5ed031b5e32ae577a0207e"} Jun 06 20:23:25.352141 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.352013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg8zn" event={"ID":"9e86188d-8d78-47c2-b63f-95c454d59381","Type":"ContainerStarted","Data":"4381fd33fbac657c51c95b87a28b5138eb432df917a4d51f7ea77e21c51e03cb"} Jun 06 20:23:25.354119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.354095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" event={"ID":"287633ed-23e9-488a-a8c8-d14196b34ad5","Type":"ContainerStarted","Data":"bb08f5dac678afe60a0f92a2c84d6b3c9bca301965913e388c0c8800bd6559a8"} Jun 06 20:23:25.355316 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.355298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"15e7b2c884e1bed832acfcb182ca3b09f721c5426436faed59cca710fb58535c"} Jun 06 20:23:25.369087 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.369048 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hg8zn" podStartSLOduration=2.447577336 podStartE2EDuration="3.36903465s" totalImagesPullingTime="855.691953ms" totalInitContainerRuntime="65.765361ms" isStatefulPod=true podCreationTimestamp="2026-06-06 20:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:25.368077681 +0000 UTC m=+229.179422277" watchObservedRunningTime="2026-06-06 20:23:25.36903465 +0000 UTC m=+229.180379211" Jun 06 20:23:25.388604 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.388558 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-j2sfj" podStartSLOduration=2.131393473 podStartE2EDuration="3.388544067s" totalImagesPullingTime="1.257150594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:25.387862075 +0000 UTC m=+229.199206669" watchObservedRunningTime="2026-06-06 20:23:25.388544067 +0000 UTC m=+229.199888651" Jun 06 20:23:25.837176 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.837100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:25.892166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:25.892127 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:26.007172 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.007058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:26.107562 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.107514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:26.361492 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.361461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" event={"ID":"4859efe4-968f-42ea-ac68-233297312f1e","Type":"ContainerStarted","Data":"47cad98b9fa963437ee559ee1b62a4bfe02f2f2b76d10464873b380e74676c41"} Jun 06 20:23:26.361661 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.361547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" event={"ID":"4859efe4-968f-42ea-ac68-233297312f1e","Type":"ContainerStarted","Data":"893fb6097ffff2e1772171bc726f9333918248a9ac3e2e641b41d82908351523"} Jun 06 20:23:26.361661 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.361571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" event={"ID":"4859efe4-968f-42ea-ac68-233297312f1e","Type":"ContainerStarted","Data":"9d6e85e167ca81265011b7d7d8534c1d31d22bcdeabacfbb024531d63b0f7533"} Jun 06 20:23:26.381832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:26.381028 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-55hnl" podStartSLOduration=2.897267201 podStartE2EDuration="4.381010508s" totalImagesPullingTime="1.483743307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:26.37887383 +0000 UTC m=+230.190218444" watchObservedRunningTime="2026-06-06 20:23:26.381010508 +0000 UTC m=+230.192355091" Jun 06 20:23:27.212325 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.212288 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6664dd6b47-2x5j9"] Jun 06 20:23:27.215552 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.215529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.217768 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.217748 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 06 20:23:27.218751 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.218734 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gzj6p\"" Jun 06 20:23:27.218838 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.218771 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-510eu716svgqb\"" Jun 06 20:23:27.218838 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.218799 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:23:27.218838 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.218832 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 06 20:23:27.218999 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.218877 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 06 20:23:27.225626 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.225598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6664dd6b47-2x5j9"] Jun 06 20:23:27.312625 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312625 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-tls\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a4c4d148-aa69-4e79-8d24-f23214229b90-audit-log\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbrv\" (UniqueName: \"kubernetes.io/projected/a4c4d148-aa69-4e79-8d24-f23214229b90-kube-api-access-9jbrv\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-metrics-server-audit-profiles\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312843 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-client-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.312982 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.312844 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-client-certs\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.365845 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.365817 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552" exitCode=0 Jun 06 20:23:27.365971 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.365903 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552"} Jun 06 20:23:27.413578 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413550 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-metrics-server-audit-profiles\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-client-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-client-certs\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-tls\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a4c4d148-aa69-4e79-8d24-f23214229b90-audit-log\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.413861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.413764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbrv\" (UniqueName: \"kubernetes.io/projected/a4c4d148-aa69-4e79-8d24-f23214229b90-kube-api-access-9jbrv\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.414264 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.414237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a4c4d148-aa69-4e79-8d24-f23214229b90-audit-log\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.414452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.414431 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.414574 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.414556 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a4c4d148-aa69-4e79-8d24-f23214229b90-metrics-server-audit-profiles\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.416157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.416141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-tls\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.416265 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.416248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-secret-metrics-server-client-certs\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.416356 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.416338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a4c4d148-aa69-4e79-8d24-f23214229b90-client-ca-bundle\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.421417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.421394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbrv\" (UniqueName: \"kubernetes.io/projected/a4c4d148-aa69-4e79-8d24-f23214229b90-kube-api-access-9jbrv\") pod \"metrics-server-6664dd6b47-2x5j9\" (UID: \"a4c4d148-aa69-4e79-8d24-f23214229b90\") " pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.524984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.524910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:27.649693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.649328 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6664dd6b47-2x5j9"] Jun 06 20:23:27.652131 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:27.652103 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c4d148_aa69_4e79_8d24_f23214229b90.slice/crio-464997b746d764192fb794277e58b113078f0d123dc22587e886211ab0214ff0 WatchSource:0}: Error finding container 464997b746d764192fb794277e58b113078f0d123dc22587e886211ab0214ff0: Status 404 returned error can't find the container with id 464997b746d764192fb794277e58b113078f0d123dc22587e886211ab0214ff0 Jun 06 20:23:27.689621 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.689596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:27.803312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:27.803282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:28.373288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:28.373251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" event={"ID":"a4c4d148-aa69-4e79-8d24-f23214229b90","Type":"ContainerStarted","Data":"464997b746d764192fb794277e58b113078f0d123dc22587e886211ab0214ff0"} Jun 06 20:23:29.085904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.085867 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:29.086076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.085924 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:29.102382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.102326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:29.379031 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.378985 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72"} Jun 06 20:23:29.380888 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.380865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" event={"ID":"a4c4d148-aa69-4e79-8d24-f23214229b90","Type":"ContainerStarted","Data":"272f57a61162164bd4f5ba355f5f3ada42cfbe130db23c5f474d769271296f2d"} Jun 06 20:23:29.397481 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:29.397430 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" podStartSLOduration=0.802896941 podStartE2EDuration="2.397412147s" totalImagesPullingTime="1.594515206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:29.396589681 +0000 UTC m=+233.207934310" watchObservedRunningTime="2026-06-06 20:23:29.397412147 +0000 UTC m=+233.208756731" Jun 06 20:23:30.388571 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.388483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31"} Jun 06 20:23:30.388571 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.388567 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de"} Jun 06 20:23:30.388972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.388603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87"} Jun 06 20:23:30.388972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.388628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04"} Jun 06 20:23:30.388972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.388664 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerStarted","Data":"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc"} Jun 06 20:23:30.413990 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:30.413934 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.604305773 podStartE2EDuration="7.413919085s" totalImagesPullingTime="3.792469658s" totalInitContainerRuntime="17.143654ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:30.413391936 +0000 UTC m=+234.224736555" watchObservedRunningTime="2026-06-06 20:23:30.413919085 +0000 UTC m=+234.225263668" Jun 06 20:23:31.284312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:31.284274 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:31.284473 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:31.284329 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:35.645036 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:35.645005 2575 scope.go:117] "RemoveContainer" containerID="38f46432f8f224a525e2128c0d4cd8e078287aac43001759d204907ce6806936" Jun 06 20:23:36.413117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.413088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:23:36.413282 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.413208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" event={"ID":"b3967c80-c5ee-4dc4-bea4-1db6236085a1","Type":"ContainerStarted","Data":"71e8275c10614836471a2c5d273542539613b029e1d816d0bff38919f96c363b"} Jun 06 20:23:36.413489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.413474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:23:36.428833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.428791 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" podStartSLOduration=53.739295931 podStartE2EDuration="56.428774008s" totalImagesPullingTime="2.689478077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:36.428141971 +0000 UTC m=+240.239486554" watchObservedRunningTime="2026-06-06 20:23:36.428774008 +0000 UTC m=+240.240118593" Jun 06 20:23:36.466540 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.466517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-bbcrk" Jun 06 20:23:36.666609 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.666539 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-rckns"] Jun 06 20:23:36.670882 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.670859 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:36.673803 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.673772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 20:23:36.674310 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.674293 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 20:23:36.674573 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.674558 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gc2b6\"" Jun 06 20:23:36.699950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.699925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9c4w\" (UniqueName: \"kubernetes.io/projected/b09ec5c8-bf00-4107-a12b-c5be26a8698a-kube-api-access-f9c4w\") pod \"downloads-6657875f97-rckns\" (UID: \"b09ec5c8-bf00-4107-a12b-c5be26a8698a\") " pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:36.702690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.702668 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rckns"] Jun 06 20:23:36.707748 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.707725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:36.800770 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.800746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9c4w\" (UniqueName: \"kubernetes.io/projected/b09ec5c8-bf00-4107-a12b-c5be26a8698a-kube-api-access-f9c4w\") pod \"downloads-6657875f97-rckns\" (UID: \"b09ec5c8-bf00-4107-a12b-c5be26a8698a\") " pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:36.806687 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.806668 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:36.808790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.808767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9c4w\" (UniqueName: \"kubernetes.io/projected/b09ec5c8-bf00-4107-a12b-c5be26a8698a-kube-api-access-f9c4w\") pod \"downloads-6657875f97-rckns\" (UID: \"b09ec5c8-bf00-4107-a12b-c5be26a8698a\") " pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:36.937114 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.937032 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:36.980594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:36.980567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:37.109542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.109513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rckns"] Jun 06 20:23:37.113242 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:37.113218 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09ec5c8_bf00_4107_a12b_c5be26a8698a.slice/crio-165ed1c1a847ca43af5100ee565ff02a5dd65c9345bd35081845d619c500d4f3 WatchSource:0}: Error finding container 165ed1c1a847ca43af5100ee565ff02a5dd65c9345bd35081845d619c500d4f3: Status 404 returned error can't find the container with id 165ed1c1a847ca43af5100ee565ff02a5dd65c9345bd35081845d619c500d4f3 Jun 06 20:23:37.119175 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.119151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:37.169988 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.169959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:37.418072 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.418042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rckns" event={"ID":"b09ec5c8-bf00-4107-a12b-c5be26a8698a","Type":"ContainerStarted","Data":"165ed1c1a847ca43af5100ee565ff02a5dd65c9345bd35081845d619c500d4f3"} Jun 06 20:23:37.516376 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.516336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:37.618802 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.618770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:37.920857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:37.920824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:38.021793 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:38.021764 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:38.328549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:38.328511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:38.530051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:38.530014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:38.728149 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:38.728072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:38.891825 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:38.891793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:39.086879 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:39.086845 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:39.087290 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:39.086900 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:39.544859 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:39.544775 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:41.285903 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:41.285865 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:41.286344 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:41.285928 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:44.108498 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:44.108456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:44.164980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:44.164935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:47.525305 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.525265 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:47.525880 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.525345 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:23:47.564643 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.564610 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:23:47.567508 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.567489 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.570003 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.569972 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 20:23:47.570003 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.569987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 20:23:47.570204 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.570045 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 20:23:47.570288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.570275 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 20:23:47.570964 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.570923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 20:23:47.570964 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.570944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xcbg9\"" Jun 06 20:23:47.576198 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.576173 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:23:47.700890 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.700851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzd9k\" (UniqueName: \"kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.701065 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.700896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.701065 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.700929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.701065 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.700951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.701065 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.701006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.701286 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.701118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802067 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzd9k\" (UniqueName: \"kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802963 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.802963 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.802923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.803145 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.803084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.804950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.804931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.805246 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.805226 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.810234 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.810213 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzd9k\" (UniqueName: \"kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k\") pod \"console-dc969586f-k74mw\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:47.879967 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:47.879932 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:23:48.508694 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:48.508655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:23:48.511462 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:48.511438 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33ff57f-5718-4121-93ca-261066c392d0-metrics-certs\") pod \"network-metrics-daemon-8zgpn\" (UID: \"b33ff57f-5718-4121-93ca-261066c392d0\") " pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:23:48.547639 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:48.547613 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wj9j\"" Jun 06 20:23:48.556392 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:48.556374 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zgpn" Jun 06 20:23:49.086722 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.086675 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:49.086904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.086762 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:49.086904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.086811 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:23:49.087473 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.087393 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"82710354ece5b491ade120f45d923b50f0648e2c45db60925f6f7bbabb76393f"} pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" containerMessage="Container registry failed liveness probe, will be restarted" Jun 06 20:23:49.091773 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.091748 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:49.091940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:49.091797 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:52.422116 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:52.422030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:52.476901 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:52.476865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:52.944904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:52.944867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:52.994048 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:52.994014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:54.052725 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.052680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:54.104217 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.104173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:54.492166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.492119 2575 generic.go:356] "Generic (PLEG): container finished" podID="0c6d6275-d072-42ea-8635-256b99431c1d" containerID="537a3f538a79f90f31f87f9853715e9f0a383dcb99a820abc9aea36854234803" exitCode=0 Jun 06 20:23:54.492329 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.492171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" event={"ID":"0c6d6275-d072-42ea-8635-256b99431c1d","Type":"ContainerDied","Data":"537a3f538a79f90f31f87f9853715e9f0a383dcb99a820abc9aea36854234803"} Jun 06 20:23:54.492524 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.492505 2575 scope.go:117] "RemoveContainer" containerID="537a3f538a79f90f31f87f9853715e9f0a383dcb99a820abc9aea36854234803" Jun 06 20:23:54.514931 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.514844 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8zgpn"] Jun 06 20:23:54.518146 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:54.518115 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33ff57f_5718_4121_93ca_261066c392d0.slice/crio-dd6facaa63d56c82274b3fd87ada91a4c39d865d9d1b41eaa2fcebd7877c9360 WatchSource:0}: Error finding container dd6facaa63d56c82274b3fd87ada91a4c39d865d9d1b41eaa2fcebd7877c9360: Status 404 returned error can't find the container with id dd6facaa63d56c82274b3fd87ada91a4c39d865d9d1b41eaa2fcebd7877c9360 Jun 06 20:23:54.539445 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:54.539377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:23:54.551786 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:54.551758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c52370_7383_4c9a_b562_e70d62a44fe9.slice/crio-c1e36b9effaf12e7bffe0619611bde227166f14d7e0059f9e4598b996861469c WatchSource:0}: Error finding container c1e36b9effaf12e7bffe0619611bde227166f14d7e0059f9e4598b996861469c: Status 404 returned error can't find the container with id c1e36b9effaf12e7bffe0619611bde227166f14d7e0059f9e4598b996861469c Jun 06 20:23:55.501074 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.500995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc969586f-k74mw" event={"ID":"48c52370-7383-4c9a-b562-e70d62a44fe9","Type":"ContainerStarted","Data":"c1e36b9effaf12e7bffe0619611bde227166f14d7e0059f9e4598b996861469c"} Jun 06 20:23:55.503180 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.503123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zgpn" event={"ID":"b33ff57f-5718-4121-93ca-261066c392d0","Type":"ContainerStarted","Data":"dd6facaa63d56c82274b3fd87ada91a4c39d865d9d1b41eaa2fcebd7877c9360"} Jun 06 20:23:55.505956 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.505869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tll9l" event={"ID":"0c6d6275-d072-42ea-8635-256b99431c1d","Type":"ContainerStarted","Data":"42b7a941731a5576a64314c7eeba1c2c1bcb732ee17a8536d8caa517bef7acbb"} Jun 06 20:23:55.507618 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.507589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rckns" event={"ID":"b09ec5c8-bf00-4107-a12b-c5be26a8698a","Type":"ContainerStarted","Data":"b0d8ba9af85a764ddf95b091231fe75d46fc5817e8f071b9fc25a9477619f8e4"} Jun 06 20:23:55.508342 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.508250 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:55.519828 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.519784 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-rckns" Jun 06 20:23:55.537063 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:55.536987 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-rckns" podStartSLOduration=2.150270973 podStartE2EDuration="19.536968391s" totalImagesPullingTime="17.386697418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:55.535372873 +0000 UTC m=+259.346717480" watchObservedRunningTime="2026-06-06 20:23:55.536968391 +0000 UTC m=+259.348312976" Jun 06 20:23:56.516586 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.516543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zgpn" event={"ID":"b33ff57f-5718-4121-93ca-261066c392d0","Type":"ContainerStarted","Data":"c3d4912e33b86b33b23a0aa7754e5b7cc1fa0cb8011a410193212ae37fbf2b73"} Jun 06 20:23:56.517091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.516603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zgpn" event={"ID":"b33ff57f-5718-4121-93ca-261066c392d0","Type":"ContainerStarted","Data":"d432f66ea58eef6a98b1d97784ee3331ec42b4924cbaeb2ca27b2e2776f5df1a"} Jun 06 20:23:56.534066 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.532461 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8zgpn" podStartSLOduration=259.494330468 podStartE2EDuration="4m20.532442096s" totalImagesPullingTime="1.038111628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:56.531770026 +0000 UTC m=+260.343114611" watchObservedRunningTime="2026-06-06 20:23:56.532442096 +0000 UTC m=+260.343786683" Jun 06 20:23:56.615608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.615520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:56.671189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.671120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:56.949491 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.949455 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:23:56.982207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.982181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:23:56.982354 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.982277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:56.991593 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:56.991572 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 20:23:57.090976 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.090853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.090976 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.090942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.091230 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.091105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.091230 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.091135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.091230 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.091170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.091376 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.091225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwxkp\" (UniqueName: \"kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.091471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.091426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.151690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.151646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:23:57.191983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.191954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.192201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.192201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwxkp\" (UniqueName: \"kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.192201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.192201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.193082 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.193082 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.193082 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.193082 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.192883 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.193940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.193891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.194300 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.194249 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.199839 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.199176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.199839 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.199329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.206641 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.205318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwxkp\" (UniqueName: \"kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp\") pod \"console-757c99bc5-hqblv\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:57.294498 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:57.294464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:23:58.499944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:58.499877 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:23:58.503009 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:23:58.502968 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a90873_7110_44de_b238_868835af9ed1.slice/crio-8687b3305b6c2c762864196f6dec8cc9ec1da510ec14e9a09159e395911534ac WatchSource:0}: Error finding container 8687b3305b6c2c762864196f6dec8cc9ec1da510ec14e9a09159e395911534ac: Status 404 returned error can't find the container with id 8687b3305b6c2c762864196f6dec8cc9ec1da510ec14e9a09159e395911534ac Jun 06 20:23:58.530891 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:58.530863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757c99bc5-hqblv" event={"ID":"66a90873-7110-44de-b238-868835af9ed1","Type":"ContainerStarted","Data":"8687b3305b6c2c762864196f6dec8cc9ec1da510ec14e9a09159e395911534ac"} Jun 06 20:23:59.092596 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.092561 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:59.092801 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.092621 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:59.538130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.538090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757c99bc5-hqblv" event={"ID":"66a90873-7110-44de-b238-868835af9ed1","Type":"ContainerStarted","Data":"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d"} Jun 06 20:23:59.539836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.539804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc969586f-k74mw" event={"ID":"48c52370-7383-4c9a-b562-e70d62a44fe9","Type":"ContainerStarted","Data":"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874"} Jun 06 20:23:59.556186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.556111 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-757c99bc5-hqblv" podStartSLOduration=3.084843545 podStartE2EDuration="3.5560922s" totalImagesPullingTime="471.248655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:59.553719731 +0000 UTC m=+263.365064306" watchObservedRunningTime="2026-06-06 20:23:59.5560922 +0000 UTC m=+263.367436782" Jun 06 20:23:59.570688 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:23:59.570637 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc969586f-k74mw" podStartSLOduration=8.414030149 podStartE2EDuration="12.570622859s" totalImagesPullingTime="4.15659271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:59.56820963 +0000 UTC m=+263.379554214" watchObservedRunningTime="2026-06-06 20:23:59.570622859 +0000 UTC m=+263.381967442" Jun 06 20:24:03.754297 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:03.754264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:03.856636 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:03.856610 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:07.149214 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.149183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:07.205896 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.205865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:07.294626 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.294592 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:24:07.294810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.294685 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:24:07.296040 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.296017 2575 patch_prober.go:28] interesting pod/console-757c99bc5-hqblv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jun 06 20:24:07.296112 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.296092 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-757c99bc5-hqblv" podUID="66a90873-7110-44de-b238-868835af9ed1" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jun 06 20:24:07.531068 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.530993 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:24:07.534673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.534647 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6664dd6b47-2x5j9" Jun 06 20:24:07.880409 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.880378 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:24:07.880580 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.880425 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:24:07.881970 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.881946 2575 patch_prober.go:28] interesting pod/console-dc969586f-k74mw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 06 20:24:07.882091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.881987 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-dc969586f-k74mw" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 06 20:24:07.958142 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:07.958115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/init-config-reloader/0.log" Jun 06 20:24:08.158145 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:08.158072 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/alertmanager/0.log" Jun 06 20:24:08.359136 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:08.359108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/config-reloader/0.log" Jun 06 20:24:08.558103 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:08.558078 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/kube-rbac-proxy-web/0.log" Jun 06 20:24:08.758433 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:08.758403 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/kube-rbac-proxy/0.log" Jun 06 20:24:08.958328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:08.958260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/kube-rbac-proxy-metric/0.log" Jun 06 20:24:09.091038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.091002 2575 patch_prober.go:28] interesting pod/image-registry-69f9cdc847-7grqh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:24:09.091241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.091053 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:24:09.158011 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.157981 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f84b8df0-78bf-48ad-b814-981633d90e68/prom-label-proxy/0.log" Jun 06 20:24:09.359382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.359352 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xtffx_bca633b8-7da5-44c0-9e94-dbdee55e8e20/cluster-monitoring-operator/0.log" Jun 06 20:24:09.558637 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.558608 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-state-metrics/0.log" Jun 06 20:24:09.757779 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.757673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-rbac-proxy-main/0.log" Jun 06 20:24:09.957847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:09.957823 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-rbac-proxy-self/0.log" Jun 06 20:24:10.158200 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:10.158174 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6664dd6b47-2x5j9_a4c4d148-aa69-4e79-8d24-f23214229b90/metrics-server/0.log" Jun 06 20:24:10.560028 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:10.560000 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/init-textfile/0.log" Jun 06 20:24:10.758944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:10.758915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/node-exporter/0.log" Jun 06 20:24:10.957803 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:10.957737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/kube-rbac-proxy/0.log" Jun 06 20:24:12.357890 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:12.357865 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/kube-rbac-proxy-main/0.log" Jun 06 20:24:12.557540 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:12.557507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/kube-rbac-proxy-self/0.log" Jun 06 20:24:12.758943 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:12.758863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/openshift-state-metrics/0.log" Jun 06 20:24:14.109671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:14.109635 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" podUID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerName="registry" containerID="cri-o://82710354ece5b491ade120f45d923b50f0648e2c45db60925f6f7bbabb76393f" gracePeriod=30 Jun 06 20:24:14.757425 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:14.757401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-pvwcj_b34bf53b-3a43-458c-815c-99506161178a/prometheus-operator-admission-webhook/0.log" Jun 06 20:24:15.418429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:15.418389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:15.609162 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:15.609125 2575 generic.go:356] "Generic (PLEG): container finished" podID="f442446c-6782-47a5-8ab5-d3b952b0540f" containerID="82710354ece5b491ade120f45d923b50f0648e2c45db60925f6f7bbabb76393f" exitCode=0 Jun 06 20:24:15.609352 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:15.609190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" event={"ID":"f442446c-6782-47a5-8ab5-d3b952b0540f","Type":"ContainerDied","Data":"82710354ece5b491ade120f45d923b50f0648e2c45db60925f6f7bbabb76393f"} Jun 06 20:24:15.609352 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:15.609250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" event={"ID":"f442446c-6782-47a5-8ab5-d3b952b0540f","Type":"ContainerStarted","Data":"0f9eb70bb3864e8423016c83453071c93f5d9f4cfa58edc3c7c2f3c6bd23e1f2"} Jun 06 20:24:15.609481 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:15.609430 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:24:16.158270 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.158243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qlpfd_9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22/networking-console-plugin/0.log" Jun 06 20:24:16.350624 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.350592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:16.357601 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.357575 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:24:16.559803 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.559775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/3.log" Jun 06 20:24:16.748591 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.748559 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:16.757866 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.757846 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-757c99bc5-hqblv_66a90873-7110-44de-b238-868835af9ed1/console/0.log" Jun 06 20:24:16.801587 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.801561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:16.959206 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:16.959140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dc969586f-k74mw_48c52370-7383-4c9a-b562-e70d62a44fe9/console/0.log" Jun 06 20:24:17.160490 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.160461 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-rckns_b09ec5c8-bf00-4107-a12b-c5be26a8698a/download-server/0.log" Jun 06 20:24:17.298818 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.298793 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:24:17.302564 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.302547 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:24:17.355275 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.355245 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:24:17.447307 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.447274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:17.552387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.552314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:17.605959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.605931 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:17.865812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.865732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:17.912909 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:17.912886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:18.558126 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:18.558094 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fznv_1dafddc6-3e69-427f-a8fa-cc7d871211f2/dns-node-resolver/0.log" Jun 06 20:24:19.358301 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:19.358273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69f9cdc847-7grqh_f442446c-6782-47a5-8ab5-d3b952b0540f/registry/1.log" Jun 06 20:24:19.958138 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:19.958108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml7q8_9125843c-8115-4094-9711-4ffcd690547d/node-ca/0.log" Jun 06 20:24:20.758870 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:20.758844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5v6s_f85be7f4-fd60-47aa-b6b0-0e533d639e10/serve-healthcheck-canary/0.log" Jun 06 20:24:21.108471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.108444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:24:21.110645 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.110628 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4c56f4e-7be5-47c8-8f85-a3a5c40a783d-metrics-tls\") pod \"dns-default-hg5g2\" (UID: \"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d\") " pod="openshift-dns/dns-default-hg5g2" Jun 06 20:24:21.148387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.148359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wqmlq\"" Jun 06 20:24:21.156795 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.156773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg5g2" Jun 06 20:24:21.296730 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.296679 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg5g2"] Jun 06 20:24:21.299619 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:24:21.299582 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c56f4e_7be5_47c8_8f85_a3a5c40a783d.slice/crio-b2db58440fdd51b5eda86597b48223eadffcdca6fb27d19feee29f83833f0339 WatchSource:0}: Error finding container b2db58440fdd51b5eda86597b48223eadffcdca6fb27d19feee29f83833f0339: Status 404 returned error can't find the container with id b2db58440fdd51b5eda86597b48223eadffcdca6fb27d19feee29f83833f0339 Jun 06 20:24:21.572953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.572921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:21.635940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.635901 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5g2" event={"ID":"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d","Type":"ContainerStarted","Data":"b2db58440fdd51b5eda86597b48223eadffcdca6fb27d19feee29f83833f0339"} Jun 06 20:24:21.673070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:21.673039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:23.648506 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:23.648466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5g2" event={"ID":"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d","Type":"ContainerStarted","Data":"c92d8ae07b95890dca7e674ca4c537139dd5494bea8f4478f6701e3d84b19707"} Jun 06 20:24:24.055409 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:24.055370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:24.115789 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:24.115686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:24.655168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:24.655130 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg5g2" event={"ID":"a4c56f4e-7be5-47c8-8f85-a3a5c40a783d","Type":"ContainerStarted","Data":"47fcf18b92ff0b7ab1b9af264d14c263345fdb54e0cecaa717ca377640f870d1"} Jun 06 20:24:24.655599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:24.655262 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hg5g2" Jun 06 20:24:24.671511 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:24.671435 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hg5g2" podStartSLOduration=251.614312763 podStartE2EDuration="4m13.671411814s" totalImagesPullingTime="2.057099051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:24.670313773 +0000 UTC m=+288.481658350" watchObservedRunningTime="2026-06-06 20:24:24.671411814 +0000 UTC m=+288.482756397" Jun 06 20:24:30.640008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:30.639957 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:30.691950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:30.691914 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:34.663640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:34.663613 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hg5g2" Jun 06 20:24:36.607591 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.607560 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:24:36.608046 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.607751 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:24:36.614688 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.614659 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:24:36.614884 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.614861 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:24:36.617969 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.617949 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69f9cdc847-7grqh" Jun 06 20:24:36.620226 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.620210 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 20:24:36.738879 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.738699 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:36.917933 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.839270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:36.940056 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:36.940028 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:39.063360 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:39.063329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:39.120467 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:39.120415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:41.178541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:41.178504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:41.279539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:41.279494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:41.330512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:41.330482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:42.086286 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.086254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:42.376024 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.375929 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dc969586f-k74mw" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerName="console" containerID="cri-o://4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874" gracePeriod=15 Jun 06 20:24:42.616244 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.616214 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:24:42.712722 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712626 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.712722 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712661 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.712722 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.712944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712746 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.712944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712841 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.712944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.712874 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzd9k\" (UniqueName: \"kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k\") pod \"48c52370-7383-4c9a-b562-e70d62a44fe9\" (UID: \"48c52370-7383-4c9a-b562-e70d62a44fe9\") " Jun 06 20:24:42.713154 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.713124 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:42.713154 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.713140 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config" (OuterVolumeSpecName: "console-config") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:42.713293 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.713131 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca" (OuterVolumeSpecName: "service-ca") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:42.715099 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.715069 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:42.715099 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.715077 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k" (OuterVolumeSpecName: "kube-api-access-qzd9k") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "kube-api-access-qzd9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:24:42.715226 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.715150 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48c52370-7383-4c9a-b562-e70d62a44fe9" (UID: "48c52370-7383-4c9a-b562-e70d62a44fe9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:42.739047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.739014 2575 generic.go:356] "Generic (PLEG): container finished" podID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerID="4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874" exitCode=0 Jun 06 20:24:42.739171 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.739066 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc969586f-k74mw" Jun 06 20:24:42.739171 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.739102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc969586f-k74mw" event={"ID":"48c52370-7383-4c9a-b562-e70d62a44fe9","Type":"ContainerDied","Data":"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874"} Jun 06 20:24:42.739171 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.739170 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc969586f-k74mw" event={"ID":"48c52370-7383-4c9a-b562-e70d62a44fe9","Type":"ContainerDied","Data":"c1e36b9effaf12e7bffe0619611bde227166f14d7e0059f9e4598b996861469c"} Jun 06 20:24:42.739268 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.739189 2575 scope.go:117] "RemoveContainer" containerID="4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874" Jun 06 20:24:42.742370 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.742341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:42.747480 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.747464 2575 scope.go:117] "RemoveContainer" containerID="4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874" Jun 06 20:24:42.747777 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:42.747756 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874\": container with ID starting with 4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874 not found: ID does not exist" containerID="4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874" Jun 06 20:24:42.747833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.747784 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874"} err="failed to get container status \"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874\": rpc error: code = NotFound desc = could not find container \"4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874\": container with ID starting with 4adb752590d0af348618d97a51b4eb73c70304d7e379156c8637929155c39874 not found: ID does not exist" Jun 06 20:24:42.760531 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.760507 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:24:42.762979 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.762960 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc969586f-k74mw"] Jun 06 20:24:42.813950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.813921 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:42.813950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.813944 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzd9k\" (UniqueName: \"kubernetes.io/projected/48c52370-7383-4c9a-b562-e70d62a44fe9-kube-api-access-qzd9k\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:42.814115 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.813976 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-oauth-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:42.814115 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.813986 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48c52370-7383-4c9a-b562-e70d62a44fe9-console-oauth-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:42.814115 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.813995 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-service-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:42.814115 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:42.814003 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48c52370-7383-4c9a-b562-e70d62a44fe9-console-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:43.144013 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.143971 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:43.144374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144348 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="alertmanager" containerID="cri-o://2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" gracePeriod=120 Jun 06 20:24:43.144427 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144389 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-web" containerID="cri-o://b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" gracePeriod=120 Jun 06 20:24:43.144427 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144408 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-metric" containerID="cri-o://48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" gracePeriod=120 Jun 06 20:24:43.144533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144459 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="prom-label-proxy" containerID="cri-o://4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" gracePeriod=120 Jun 06 20:24:43.144533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144463 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="config-reloader" containerID="cri-o://69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" gracePeriod=120 Jun 06 20:24:43.144533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.144480 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy" containerID="cri-o://74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" gracePeriod=120 Jun 06 20:24:43.746955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.746922 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" exitCode=0 Jun 06 20:24:43.746955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.746946 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" exitCode=0 Jun 06 20:24:43.746955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.746952 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" exitCode=0 Jun 06 20:24:43.746955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.746957 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" exitCode=0 Jun 06 20:24:43.747410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.746994 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31"} Jun 06 20:24:43.747410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.747053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87"} Jun 06 20:24:43.747410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.747079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc"} Jun 06 20:24:43.747410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.747103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72"} Jun 06 20:24:43.776344 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.776313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:43.825584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:43.825558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:44.386124 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.386102 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.527901 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.527814 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.527901 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.527855 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.527901 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.527883 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.527916 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrdlp\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528031 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528086 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528117 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528151 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528204 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528244 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528297 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528339 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.528429 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.528376 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca\") pod \"f84b8df0-78bf-48ad-b814-981633d90e68\" (UID: \"f84b8df0-78bf-48ad-b814-981633d90e68\") " Jun 06 20:24:44.529980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.529007 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:44.529980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.529612 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:24:44.529980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.529925 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:44.530941 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.530836 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.530941 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.530900 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:24:44.530941 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.530902 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp" (OuterVolumeSpecName: "kube-api-access-wrdlp") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "kube-api-access-wrdlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:24:44.531174 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.530959 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.531327 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.531297 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.531556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.531519 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume" (OuterVolumeSpecName: "config-volume") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.532278 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.532254 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.532647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.532629 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out" (OuterVolumeSpecName: "config-out") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:24:44.535628 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.535607 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.542388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.542364 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config" (OuterVolumeSpecName: "web-config") pod "f84b8df0-78bf-48ad-b814-981633d90e68" (UID: "f84b8df0-78bf-48ad-b814-981633d90e68"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:44.629079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629039 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629074 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-alertmanager-main-db\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629084 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f84b8df0-78bf-48ad-b814-981633d90e68-metrics-client-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629094 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-tls-assets\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629103 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629111 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629119 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrdlp\" (UniqueName: \"kubernetes.io/projected/f84b8df0-78bf-48ad-b814-981633d90e68-kube-api-access-wrdlp\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629128 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629137 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-config-volume\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629145 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-web-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629152 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f84b8df0-78bf-48ad-b814-981633d90e68-config-out\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629160 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-cluster-tls-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.629306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.629168 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f84b8df0-78bf-48ad-b814-981633d90e68-secret-alertmanager-main-tls\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:24:44.650247 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.650218 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" path="/var/lib/kubelet/pods/48c52370-7383-4c9a-b562-e70d62a44fe9/volumes" Jun 06 20:24:44.754055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754025 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" exitCode=0 Jun 06 20:24:44.754055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754048 2575 generic.go:356] "Generic (PLEG): container finished" podID="f84b8df0-78bf-48ad-b814-981633d90e68" containerID="b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" exitCode=0 Jun 06 20:24:44.754489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754098 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.754489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754102 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de"} Jun 06 20:24:44.754489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04"} Jun 06 20:24:44.754489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f84b8df0-78bf-48ad-b814-981633d90e68","Type":"ContainerDied","Data":"15e7b2c884e1bed832acfcb182ca3b09f721c5426436faed59cca710fb58535c"} Jun 06 20:24:44.754489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.754237 2575 scope.go:117] "RemoveContainer" containerID="4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" Jun 06 20:24:44.761833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.761816 2575 scope.go:117] "RemoveContainer" containerID="48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" Jun 06 20:24:44.768809 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.768792 2575 scope.go:117] "RemoveContainer" containerID="74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" Jun 06 20:24:44.773879 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.773857 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:44.776374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.776341 2575 scope.go:117] "RemoveContainer" containerID="b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" Jun 06 20:24:44.780838 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.780788 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:44.784523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.784502 2575 scope.go:117] "RemoveContainer" containerID="69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" Jun 06 20:24:44.794042 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.794009 2575 scope.go:117] "RemoveContainer" containerID="2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" Jun 06 20:24:44.804419 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.804395 2575 scope.go:117] "RemoveContainer" containerID="44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552" Jun 06 20:24:44.804853 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.804830 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:44.805237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805218 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerName="console" Jun 06 20:24:44.805237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805238 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerName="console" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805257 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805268 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805278 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-metric" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805287 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-metric" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805298 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-web" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805307 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-web" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805321 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="prom-label-proxy" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805329 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="prom-label-proxy" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805343 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="init-config-reloader" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="init-config-reloader" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805362 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="alertmanager" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805371 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="alertmanager" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805389 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="config-reloader" Jun 06 20:24:44.805396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805397 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="config-reloader" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805478 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-web" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805489 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy-metric" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805501 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="prom-label-proxy" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805510 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c52370-7383-4c9a-b562-e70d62a44fe9" containerName="console" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805519 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="config-reloader" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805527 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="kube-rbac-proxy" Jun 06 20:24:44.806130 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.805536 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" containerName="alertmanager" Jun 06 20:24:44.809361 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.809339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.811978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.811926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2rp92\"" Jun 06 20:24:44.811978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.811939 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 20:24:44.811978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.811972 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 20:24:44.812173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.811931 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 20:24:44.812173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.812039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 20:24:44.812173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.811926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 20:24:44.812314 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.812293 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 20:24:44.812488 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.812463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 20:24:44.812574 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.812557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 20:24:44.813568 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.813550 2575 scope.go:117] "RemoveContainer" containerID="4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" Jun 06 20:24:44.814077 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.814055 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31\": container with ID starting with 4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31 not found: ID does not exist" containerID="4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" Jun 06 20:24:44.814175 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814088 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31"} err="failed to get container status \"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31\": rpc error: code = NotFound desc = could not find container \"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31\": container with ID starting with 4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31 not found: ID does not exist" Jun 06 20:24:44.814175 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814110 2575 scope.go:117] "RemoveContainer" containerID="48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" Jun 06 20:24:44.814394 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.814376 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de\": container with ID starting with 48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de not found: ID does not exist" containerID="48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" Jun 06 20:24:44.814452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814402 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de"} err="failed to get container status \"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de\": rpc error: code = NotFound desc = could not find container \"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de\": container with ID starting with 48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de not found: ID does not exist" Jun 06 20:24:44.814452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814420 2575 scope.go:117] "RemoveContainer" containerID="74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" Jun 06 20:24:44.814725 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.814668 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87\": container with ID starting with 74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87 not found: ID does not exist" containerID="74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" Jun 06 20:24:44.814802 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814728 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87"} err="failed to get container status \"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87\": rpc error: code = NotFound desc = could not find container \"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87\": container with ID starting with 74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87 not found: ID does not exist" Jun 06 20:24:44.814802 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.814751 2575 scope.go:117] "RemoveContainer" containerID="b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" Jun 06 20:24:44.815044 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.815025 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04\": container with ID starting with b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04 not found: ID does not exist" containerID="b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" Jun 06 20:24:44.815122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815051 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04"} err="failed to get container status \"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04\": rpc error: code = NotFound desc = could not find container \"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04\": container with ID starting with b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04 not found: ID does not exist" Jun 06 20:24:44.815122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815071 2575 scope.go:117] "RemoveContainer" containerID="69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" Jun 06 20:24:44.815350 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.815327 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc\": container with ID starting with 69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc not found: ID does not exist" containerID="69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" Jun 06 20:24:44.815417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815358 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc"} err="failed to get container status \"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc\": rpc error: code = NotFound desc = could not find container \"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc\": container with ID starting with 69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc not found: ID does not exist" Jun 06 20:24:44.815417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815379 2575 scope.go:117] "RemoveContainer" containerID="2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" Jun 06 20:24:44.815822 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.815693 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72\": container with ID starting with 2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72 not found: ID does not exist" containerID="2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" Jun 06 20:24:44.815906 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815841 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72"} err="failed to get container status \"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72\": rpc error: code = NotFound desc = could not find container \"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72\": container with ID starting with 2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72 not found: ID does not exist" Jun 06 20:24:44.815906 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.815861 2575 scope.go:117] "RemoveContainer" containerID="44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552" Jun 06 20:24:44.816326 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:24:44.816299 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552\": container with ID starting with 44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552 not found: ID does not exist" containerID="44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552" Jun 06 20:24:44.816401 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.816330 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552"} err="failed to get container status \"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552\": rpc error: code = NotFound desc = could not find container \"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552\": container with ID starting with 44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552 not found: ID does not exist" Jun 06 20:24:44.816401 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.816344 2575 scope.go:117] "RemoveContainer" containerID="4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31" Jun 06 20:24:44.816670 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.816644 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31"} err="failed to get container status \"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31\": rpc error: code = NotFound desc = could not find container \"4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31\": container with ID starting with 4467609a6e3e0a26d0a461f3d868818c629587cc43685440f395ebeb85d0bc31 not found: ID does not exist" Jun 06 20:24:44.816758 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.816671 2575 scope.go:117] "RemoveContainer" containerID="48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de" Jun 06 20:24:44.817013 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.816979 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de"} err="failed to get container status \"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de\": rpc error: code = NotFound desc = could not find container \"48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de\": container with ID starting with 48576a3f581fcfbd156891ac481d06409088f626bbec73b50e727cc6302697de not found: ID does not exist" Jun 06 20:24:44.817013 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817007 2575 scope.go:117] "RemoveContainer" containerID="74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87" Jun 06 20:24:44.817252 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817233 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 20:24:44.817914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817628 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87"} err="failed to get container status \"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87\": rpc error: code = NotFound desc = could not find container \"74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87\": container with ID starting with 74cb07ed2c747880f1cceb67630dc32c61f8e1e05486983772ba0e17f0875b87 not found: ID does not exist" Jun 06 20:24:44.817914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817652 2575 scope.go:117] "RemoveContainer" containerID="b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04" Jun 06 20:24:44.818148 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817913 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04"} err="failed to get container status \"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04\": rpc error: code = NotFound desc = could not find container \"b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04\": container with ID starting with b201ff0e3e11c44ba3818906255a6c75ea9ebbd04bbb89fd59f15d1ebd209e04 not found: ID does not exist" Jun 06 20:24:44.818148 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.817931 2575 scope.go:117] "RemoveContainer" containerID="69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc" Jun 06 20:24:44.818248 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.818164 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc"} err="failed to get container status \"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc\": rpc error: code = NotFound desc = could not find container \"69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc\": container with ID starting with 69bda22320e600599626ef1f50913f323840affbfd6e000c884d24cf9d9b1fdc not found: ID does not exist" Jun 06 20:24:44.818248 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.818189 2575 scope.go:117] "RemoveContainer" containerID="2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72" Jun 06 20:24:44.818441 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.818424 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72"} err="failed to get container status \"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72\": rpc error: code = NotFound desc = could not find container \"2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72\": container with ID starting with 2872e7d619222386c0efa94836c25a608f12db090e9eb01a58139572b5671a72 not found: ID does not exist" Jun 06 20:24:44.818500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.818442 2575 scope.go:117] "RemoveContainer" containerID="44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552" Jun 06 20:24:44.818740 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.818695 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552"} err="failed to get container status \"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552\": rpc error: code = NotFound desc = could not find container \"44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552\": container with ID starting with 44ec62e6fd67c22f5420f51611b7850b53825371c2315268fd25830fc3441552 not found: ID does not exist" Jun 06 20:24:44.825004 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.824983 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:44.930846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.930803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.930846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.930857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgt9\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-kube-api-access-5jgt9\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.930883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.930945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-web-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:44.931241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:44.931193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-config-out\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032421 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032421 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-web-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032421 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032461 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032606 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-config-out\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.032669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.033150 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgt9\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-kube-api-access-5jgt9\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.033150 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.032967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035518 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035518 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035739 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035739 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035860 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035726 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.035860 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.035786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-web-config\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.036075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.036052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.036174 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.036143 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd961aa1-a739-4b41-8f66-8af16f08218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.036382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.036349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.036486 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.036358 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd961aa1-a739-4b41-8f66-8af16f08218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.037260 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.037241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd961aa1-a739-4b41-8f66-8af16f08218e-config-out\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.040590 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.040572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgt9\" (UniqueName: \"kubernetes.io/projected/bd961aa1-a739-4b41-8f66-8af16f08218e-kube-api-access-5jgt9\") pod \"alertmanager-main-0\" (UID: \"bd961aa1-a739-4b41-8f66-8af16f08218e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.120384 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.120343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 20:24:45.257316 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.257288 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 20:24:45.761178 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.761139 2575 generic.go:356] "Generic (PLEG): container finished" podID="bd961aa1-a739-4b41-8f66-8af16f08218e" containerID="1ca9637240a0b2099e5e645772eacf2110bcb5b4ff2f43bcd5dfd87ae9227a1a" exitCode=0 Jun 06 20:24:45.761610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.761212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerDied","Data":"1ca9637240a0b2099e5e645772eacf2110bcb5b4ff2f43bcd5dfd87ae9227a1a"} Jun 06 20:24:45.761610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:45.761277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"93db7dd76c7c6af36a5bbfca619271a6dea7ede40aeb62f689a7a8f4a4735d28"} Jun 06 20:24:46.651810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.651777 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f84b8df0-78bf-48ad-b814-981633d90e68" path="/var/lib/kubelet/pods/f84b8df0-78bf-48ad-b814-981633d90e68/volumes" Jun 06 20:24:46.769659 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"759925a8128b07e505da45805a34c300da9814049ae76e9e3dc8e0162451b57f"} Jun 06 20:24:46.770086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769690 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"dee26319bf2c4988ca571e5abfcaa3c7803debc9d38ae893f3cc2867a3795280"} Jun 06 20:24:46.770086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"740407a53d3974f7a4f16d45ba6195373d1d3548cc5f52835e24e0f7f223237f"} Jun 06 20:24:46.770086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769770 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"0529c1d7632027a868349dda0bbce421f44f6fdcaa4a8f23ffdbc1f1fadf4733"} Jun 06 20:24:46.770086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"aae8dcd52dc86175146a1a652aead53135f885219b91f042ebc31f84eaca7fb8"} Jun 06 20:24:46.770086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.769816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd961aa1-a739-4b41-8f66-8af16f08218e","Type":"ContainerStarted","Data":"db3bfa890046f9bbbb10f5774fa2d06119c260a76c0c3180bece3aa41ba14a8c"} Jun 06 20:24:46.801885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:46.801802 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.78619132 podStartE2EDuration="2.801781837s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.590517ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:46.796113359 +0000 UTC m=+310.607457937" watchObservedRunningTime="2026-06-06 20:24:46.801781837 +0000 UTC m=+310.613126421" Jun 06 20:24:47.161820 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.161786 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c956957d5-dg85l"] Jun 06 20:24:47.164932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.164903 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.167471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167445 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 06 20:24:47.167607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167571 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 06 20:24:47.167686 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167664 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-78czb\"" Jun 06 20:24:47.167775 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 06 20:24:47.167834 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167813 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 06 20:24:47.167918 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.167899 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 06 20:24:47.172261 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.172243 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 06 20:24:47.178240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.178220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c956957d5-dg85l"] Jun 06 20:24:47.252306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-metrics-client-ca\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-federate-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqqc\" (UniqueName: \"kubernetes.io/projected/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-kube-api-access-2xqqc\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-serving-certs-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252668 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.252668 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.252537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.352972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.352929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.352972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.352978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-metrics-client-ca\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-federate-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqqc\" (UniqueName: \"kubernetes.io/projected/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-kube-api-access-2xqqc\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-serving-certs-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.353221 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.353185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.354142 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.354111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-metrics-client-ca\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.354266 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.354116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-serving-certs-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.354418 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.354386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.356126 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.356095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.356250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.356227 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-federate-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.356316 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.356237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-secret-telemeter-client\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.356316 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.356289 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-telemeter-client-tls\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.360871 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.360851 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqqc\" (UniqueName: \"kubernetes.io/projected/9a3f0b1c-30b9-446a-ba18-dc30575dbea6-kube-api-access-2xqqc\") pod \"telemeter-client-7c956957d5-dg85l\" (UID: \"9a3f0b1c-30b9-446a-ba18-dc30575dbea6\") " pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.476403 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.476322 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" Jun 06 20:24:47.607485 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.607463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c956957d5-dg85l"] Jun 06 20:24:47.609821 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:24:47.609792 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3f0b1c_30b9_446a_ba18_dc30575dbea6.slice/crio-23802b2e6c0f2aabd1b3c7b3c9ce388f44c231648463809aba5a7f31f78846d5 WatchSource:0}: Error finding container 23802b2e6c0f2aabd1b3c7b3c9ce388f44c231648463809aba5a7f31f78846d5: Status 404 returned error can't find the container with id 23802b2e6c0f2aabd1b3c7b3c9ce388f44c231648463809aba5a7f31f78846d5 Jun 06 20:24:47.611797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.611780 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:24:47.775337 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:47.775249 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" event={"ID":"9a3f0b1c-30b9-446a-ba18-dc30575dbea6","Type":"ContainerStarted","Data":"23802b2e6c0f2aabd1b3c7b3c9ce388f44c231648463809aba5a7f31f78846d5"} Jun 06 20:24:50.794514 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:50.794473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" event={"ID":"9a3f0b1c-30b9-446a-ba18-dc30575dbea6","Type":"ContainerStarted","Data":"3bb7df18f5e27e3633857273fa7e697ef0fe23f226c817a40c397e21b6078058"} Jun 06 20:24:50.794912 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:50.794534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" event={"ID":"9a3f0b1c-30b9-446a-ba18-dc30575dbea6","Type":"ContainerStarted","Data":"06c185e073eb439d0938b5161b9be6f955be26f05e9eb791266f25deae492163"} Jun 06 20:24:50.794912 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:50.794553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" event={"ID":"9a3f0b1c-30b9-446a-ba18-dc30575dbea6","Type":"ContainerStarted","Data":"98ab778a0a6b783690ca1a3b5fe4a31712792a8acb17ae824dc5623f0ea17958"} Jun 06 20:24:50.815292 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:50.815245 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c956957d5-dg85l" podStartSLOduration=1.588409554 podStartE2EDuration="3.815229225s" totalImagesPullingTime="2.226819671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:50.813485958 +0000 UTC m=+314.624830558" watchObservedRunningTime="2026-06-06 20:24:50.815229225 +0000 UTC m=+314.626573807" Jun 06 20:24:51.624513 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.624477 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:24:51.626930 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.626909 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.637415 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.637386 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:24:51.683325 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.683299 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:51.782237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.782206 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:51.794163 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794261 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794421 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794538 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.794895 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.794576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsvd\" (UniqueName: \"kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895406 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsvd\" (UniqueName: \"kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895406 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895406 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895675 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895675 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895675 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.895880 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.895680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.896223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.896195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.896365 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.896344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.896438 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.896415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.896489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.896420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.898089 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.898068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.898168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.898154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.902837 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.902819 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsvd\" (UniqueName: \"kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd\") pod \"console-886658c87-br4r9\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:51.937725 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:51.937685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:24:52.069207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:52.069172 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:24:52.072018 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:24:52.071986 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830a7c47_7aa2_4903_a6c6_f7d1f21f561e.slice/crio-b53586698ba90961fe9621c7c2b230897634dbcdcbf3090a8b9d80878c902190 WatchSource:0}: Error finding container b53586698ba90961fe9621c7c2b230897634dbcdcbf3090a8b9d80878c902190: Status 404 returned error can't find the container with id b53586698ba90961fe9621c7c2b230897634dbcdcbf3090a8b9d80878c902190 Jun 06 20:24:52.800603 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:52.800567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:24:52.804557 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:52.804524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886658c87-br4r9" event={"ID":"830a7c47-7aa2-4903-a6c6-f7d1f21f561e","Type":"ContainerStarted","Data":"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58"} Jun 06 20:24:52.804674 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:52.804568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886658c87-br4r9" event={"ID":"830a7c47-7aa2-4903-a6c6-f7d1f21f561e","Type":"ContainerStarted","Data":"b53586698ba90961fe9621c7c2b230897634dbcdcbf3090a8b9d80878c902190"} Jun 06 20:24:52.824262 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:24:52.824215 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-886658c87-br4r9" podStartSLOduration=1.824200683 podStartE2EDuration="1.824200683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:52.822766208 +0000 UTC m=+316.634110792" watchObservedRunningTime="2026-06-06 20:24:52.824200683 +0000 UTC m=+316.635545266" Jun 06 20:25:01.938152 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:01.938119 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:25:01.938560 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:01.938200 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:25:01.942778 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:01.942757 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:25:02.852025 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:02.851999 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:25:02.898553 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:02.898517 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:25:02.999070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:02.999043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:03.056373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:03.056343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:03.110382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:03.110308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:27.926766 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:27.926641 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-757c99bc5-hqblv" podUID="66a90873-7110-44de-b238-868835af9ed1" containerName="console" containerID="cri-o://417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d" gracePeriod=15 Jun 06 20:25:28.170675 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.170654 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:25:28.274098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274014 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274054 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274081 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274105 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274132 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwxkp\" (UniqueName: \"kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274167 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274328 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config\") pod \"66a90873-7110-44de-b238-868835af9ed1\" (UID: \"66a90873-7110-44de-b238-868835af9ed1\") " Jun 06 20:25:28.274557 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274485 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:25:28.274664 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274639 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:25:28.274745 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274648 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca" (OuterVolumeSpecName: "service-ca") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:25:28.274796 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274767 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-oauth-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.274796 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274787 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.274865 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274802 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-service-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.274865 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.274768 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config" (OuterVolumeSpecName: "console-config") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:25:28.276239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.276207 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp" (OuterVolumeSpecName: "kube-api-access-zwxkp") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "kube-api-access-zwxkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:25:28.276599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.276572 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:25:28.276599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.276585 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66a90873-7110-44de-b238-868835af9ed1" (UID: "66a90873-7110-44de-b238-868835af9ed1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:25:28.375785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.375759 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.375785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.375781 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66a90873-7110-44de-b238-868835af9ed1-console-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.375785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.375790 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66a90873-7110-44de-b238-868835af9ed1-console-oauth-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.375972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.375799 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwxkp\" (UniqueName: \"kubernetes.io/projected/66a90873-7110-44de-b238-868835af9ed1-kube-api-access-zwxkp\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:25:28.965460 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.965359 2575 generic.go:356] "Generic (PLEG): container finished" podID="66a90873-7110-44de-b238-868835af9ed1" containerID="417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d" exitCode=0 Jun 06 20:25:28.965460 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.965400 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757c99bc5-hqblv" Jun 06 20:25:28.965460 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.965411 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757c99bc5-hqblv" event={"ID":"66a90873-7110-44de-b238-868835af9ed1","Type":"ContainerDied","Data":"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d"} Jun 06 20:25:28.965460 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.965461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757c99bc5-hqblv" event={"ID":"66a90873-7110-44de-b238-868835af9ed1","Type":"ContainerDied","Data":"8687b3305b6c2c762864196f6dec8cc9ec1da510ec14e9a09159e395911534ac"} Jun 06 20:25:28.966038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.965488 2575 scope.go:117] "RemoveContainer" containerID="417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d" Jun 06 20:25:28.973557 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.973541 2575 scope.go:117] "RemoveContainer" containerID="417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d" Jun 06 20:25:28.973802 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:25:28.973782 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d\": container with ID starting with 417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d not found: ID does not exist" containerID="417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d" Jun 06 20:25:28.973875 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.973811 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d"} err="failed to get container status \"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d\": rpc error: code = NotFound desc = could not find container \"417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d\": container with ID starting with 417e2960852aa362316e43add4b967192b855d2fc2f1ea319b87e8d3c11f8a7d not found: ID does not exist" Jun 06 20:25:28.981053 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.981033 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:25:28.984576 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:28.984547 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-757c99bc5-hqblv"] Jun 06 20:25:30.654240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:30.654200 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a90873-7110-44de-b238-868835af9ed1" path="/var/lib/kubelet/pods/66a90873-7110-44de-b238-868835af9ed1/volumes" Jun 06 20:25:35.890382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:35.890341 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:35.991576 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:35.991542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:40.247092 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:40.247052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:57.297465 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:57.297425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:25:57.352677 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:25:57.352646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:09.246450 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:09.246416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:09.301183 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:09.301155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:17.464334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.464290 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:26:17.464861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.464732 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a90873-7110-44de-b238-868835af9ed1" containerName="console" Jun 06 20:26:17.464861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.464751 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a90873-7110-44de-b238-868835af9ed1" containerName="console" Jun 06 20:26:17.464861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.464844 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a90873-7110-44de-b238-868835af9ed1" containerName="console" Jun 06 20:26:17.467947 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.467930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.479408 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.479386 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:26:17.519271 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.519241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:17.566980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.566955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:17.596554 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596638 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596561 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596638 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596604 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596727 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596727 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596804 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmtct\" (UniqueName: \"kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.596804 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.596759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698158 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698158 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.698311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtct\" (UniqueName: \"kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.699038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.698994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.699480 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.699453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.699673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.699645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.699983 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.699958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.700206 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.700188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.702339 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.702313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.707027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.707003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.708073 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.708054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmtct\" (UniqueName: \"kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct\") pod \"console-74f78db9cd-sxx5g\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.777927 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.777855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:17.909899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:17.909864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:26:17.912874 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:26:17.912846 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66 WatchSource:0}: Error finding container 8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66: Status 404 returned error can't find the container with id 8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66 Jun 06 20:26:18.164262 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:18.164227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f78db9cd-sxx5g" event={"ID":"745ed170-9537-4144-8bdc-785013c1d205","Type":"ContainerStarted","Data":"1aa84883dd3936e13e2db303619acc491c13b75f8b345227bffd63ec251ccb16"} Jun 06 20:26:18.164474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:18.164284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f78db9cd-sxx5g" event={"ID":"745ed170-9537-4144-8bdc-785013c1d205","Type":"ContainerStarted","Data":"8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66"} Jun 06 20:26:18.180373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:18.180321 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f78db9cd-sxx5g" podStartSLOduration=1.18030422 podStartE2EDuration="1.18030422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:26:18.17987692 +0000 UTC m=+401.991221503" watchObservedRunningTime="2026-06-06 20:26:18.18030422 +0000 UTC m=+401.991648781" Jun 06 20:26:24.061312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:24.061270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:24.162357 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:24.162325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:24.210457 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:24.210411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:24.334644 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:24.334561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:27.778516 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:27.778479 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:27.778930 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:27.778540 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:27.783539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:27.783514 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:28.209433 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:28.209404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:26:28.253660 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:28.253629 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:26:28.355077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:28.355044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:28.455500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:28.455466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:28.509862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:28.509787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:26:53.274475 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.274374 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-886658c87-br4r9" podUID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" containerName="console" containerID="cri-o://5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58" gracePeriod=15 Jun 06 20:26:53.520853 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.520828 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:26:53.596322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596296 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596348 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596367 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596420 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klsvd\" (UniqueName: \"kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596449 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596499 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596499 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596535 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config\") pod \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\" (UID: \"830a7c47-7aa2-4903-a6c6-f7d1f21f561e\") " Jun 06 20:26:53.596865 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596838 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca" (OuterVolumeSpecName: "service-ca") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:26:53.596917 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596868 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:26:53.596917 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596880 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config" (OuterVolumeSpecName: "console-config") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:26:53.597001 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.596955 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:26:53.598458 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.598432 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:26:53.598561 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.598475 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd" (OuterVolumeSpecName: "kube-api-access-klsvd") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "kube-api-access-klsvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:26:53.598561 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.598512 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "830a7c47-7aa2-4903-a6c6-f7d1f21f561e" (UID: "830a7c47-7aa2-4903-a6c6-f7d1f21f561e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:26:53.698188 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698152 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698188 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698185 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698188 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698195 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-service-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698204 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klsvd\" (UniqueName: \"kubernetes.io/projected/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-kube-api-access-klsvd\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698213 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698222 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-oauth-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:53.698374 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:53.698230 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/830a7c47-7aa2-4903-a6c6-f7d1f21f561e-console-oauth-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:26:54.319135 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.319101 2575 generic.go:356] "Generic (PLEG): container finished" podID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" containerID="5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58" exitCode=0 Jun 06 20:26:54.319523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.319144 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886658c87-br4r9" Jun 06 20:26:54.319523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.319182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886658c87-br4r9" event={"ID":"830a7c47-7aa2-4903-a6c6-f7d1f21f561e","Type":"ContainerDied","Data":"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58"} Jun 06 20:26:54.319523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.319232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886658c87-br4r9" event={"ID":"830a7c47-7aa2-4903-a6c6-f7d1f21f561e","Type":"ContainerDied","Data":"b53586698ba90961fe9621c7c2b230897634dbcdcbf3090a8b9d80878c902190"} Jun 06 20:26:54.319523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.319251 2575 scope.go:117] "RemoveContainer" containerID="5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58" Jun 06 20:26:54.330819 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.330798 2575 scope.go:117] "RemoveContainer" containerID="5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58" Jun 06 20:26:54.331064 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:26:54.331043 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58\": container with ID starting with 5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58 not found: ID does not exist" containerID="5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58" Jun 06 20:26:54.331127 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.331076 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58"} err="failed to get container status \"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58\": rpc error: code = NotFound desc = could not find container \"5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58\": container with ID starting with 5e338a337c0a0e98549fe6692dac7fb7192adb17890a204c0dd62ace0b669a58 not found: ID does not exist" Jun 06 20:26:54.341836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.341816 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:26:54.345789 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.345757 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-886658c87-br4r9"] Jun 06 20:26:54.650121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:26:54.650036 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" path="/var/lib/kubelet/pods/830a7c47-7aa2-4903-a6c6-f7d1f21f561e/volumes" Jun 06 20:27:28.612434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:28.612392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:28.707496 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:28.707463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:29.213409 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.213374 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm"] Jun 06 20:27:29.213728 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.213689 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" containerName="console" Jun 06 20:27:29.213728 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.213717 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" containerName="console" Jun 06 20:27:29.213809 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.213776 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="830a7c47-7aa2-4903-a6c6-f7d1f21f561e" containerName="console" Jun 06 20:27:29.216886 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.216871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.219357 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.219334 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:27:29.219608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.219587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:27:29.220287 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.220274 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:27:29.224544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.224516 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm"] Jun 06 20:27:29.295533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.295497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.295726 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.295552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.295726 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.295638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wcjq\" (UniqueName: \"kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.397004 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.396964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.397138 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.397023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.397138 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.397061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wcjq\" (UniqueName: \"kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.397357 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.397336 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.397394 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.397378 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.406203 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.406177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wcjq\" (UniqueName: \"kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.526604 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.526517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:29.657825 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:29.654845 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm"] Jun 06 20:27:29.659395 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:27:29.659367 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214 WatchSource:0}: Error finding container 430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214: Status 404 returned error can't find the container with id 430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214 Jun 06 20:27:30.468163 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:30.468127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerStarted","Data":"430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214"} Jun 06 20:27:37.503690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:37.503656 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerID="d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963" exitCode=0 Jun 06 20:27:37.504061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:37.503739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerDied","Data":"d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963"} Jun 06 20:27:37.891316 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:37.891280 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:40.045844 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:40.045750 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:40.046186 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:40.046034 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:40.524587 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:40.524532 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerID="f083255df32d4bf086d8669d48dec092b38d76eaf85c04da9e65a0a74d3194a5" exitCode=0 Jun 06 20:27:40.524811 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:40.524616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerDied","Data":"f083255df32d4bf086d8669d48dec092b38d76eaf85c04da9e65a0a74d3194a5"} Jun 06 20:27:45.676896 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:45.676864 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:46.556523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:46.556484 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerStarted","Data":"56b9ad3d7ca94e85372f754a04ebaa2677517448abee344ffb9912e0a2537449"} Jun 06 20:27:46.572999 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:46.572951 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" podStartSLOduration=2.590361735 podStartE2EDuration="17.572934291s" totalImagesPullingTime="14.982572556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:27:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:27:46.571236579 +0000 UTC m=+490.382581164" watchObservedRunningTime="2026-06-06 20:27:46.572934291 +0000 UTC m=+490.384278874" Jun 06 20:27:47.563220 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:47.563181 2575 generic.go:356] "Generic (PLEG): container finished" podID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerID="56b9ad3d7ca94e85372f754a04ebaa2677517448abee344ffb9912e0a2537449" exitCode=0 Jun 06 20:27:47.563581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:47.563242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerDied","Data":"56b9ad3d7ca94e85372f754a04ebaa2677517448abee344ffb9912e0a2537449"} Jun 06 20:27:47.899963 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:47.899880 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:48.702556 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.702534 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:48.766411 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.766378 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util\") pod \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " Jun 06 20:27:48.766569 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.766425 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle\") pod \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " Jun 06 20:27:48.766569 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.766450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wcjq\" (UniqueName: \"kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq\") pod \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\" (UID: \"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4\") " Jun 06 20:27:48.767123 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.767097 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle" (OuterVolumeSpecName: "bundle") pod "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" (UID: "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:27:48.768661 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.768636 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq" (OuterVolumeSpecName: "kube-api-access-9wcjq") pod "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" (UID: "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4"). InnerVolumeSpecName "kube-api-access-9wcjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:27:48.770825 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.770802 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util" (OuterVolumeSpecName: "util") pod "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" (UID: "bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:27:48.867172 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.867066 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:27:48.867172 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.867115 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wcjq\" (UniqueName: \"kubernetes.io/projected/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-kube-api-access-9wcjq\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:27:48.867172 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:48.867130 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:27:49.573322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:49.573284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" event={"ID":"bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4","Type":"ContainerDied","Data":"430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214"} Jun 06 20:27:49.573322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:49.573304 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d52mwm" Jun 06 20:27:49.573500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:49.573338 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="430c7c786766e59228624c90108ba2f82ef17f3cd5d9cd22cf74e1d92c302214" Jun 06 20:27:55.187122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:55.187082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:56.022485 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:56.022448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:57.091018 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.090987 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx"] Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091294 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="pull" Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091304 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="pull" Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091327 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="extract" Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091333 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="extract" Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091346 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="util" Jun 06 20:27:57.091373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="util" Jun 06 20:27:57.091571 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.091399 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb5a5b4c-d7b3-41d5-9741-5e618ba6abe4" containerName="extract" Jun 06 20:27:57.093614 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.093596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.096111 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.096089 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:27:57.096242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.096123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gn5hd\"" Jun 06 20:27:57.096242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.096123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 06 20:27:57.107955 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.107932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx"] Jun 06 20:27:57.128340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.128314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmfd\" (UniqueName: \"kubernetes.io/projected/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-kube-api-access-xxmfd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.128456 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.128349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.228822 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.228775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmfd\" (UniqueName: \"kubernetes.io/projected/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-kube-api-access-xxmfd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.228822 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.228828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.229168 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.229152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.237667 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.237643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmfd\" (UniqueName: \"kubernetes.io/projected/7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce-kube-api-access-xxmfd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-lp8fx\" (UID: \"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.403037 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.402954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" Jun 06 20:27:57.533760 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.533729 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx"] Jun 06 20:27:57.537450 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:27:57.537424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffb7ca9_b0c5_4269_9bb0_160b09a5fcce.slice/crio-fcaa86af1f3aab794bdd66630dc687af60e99b62e662b217a5e2d8439ef3d730 WatchSource:0}: Error finding container fcaa86af1f3aab794bdd66630dc687af60e99b62e662b217a5e2d8439ef3d730: Status 404 returned error can't find the container with id fcaa86af1f3aab794bdd66630dc687af60e99b62e662b217a5e2d8439ef3d730 Jun 06 20:27:57.608480 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:57.608446 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" event={"ID":"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce","Type":"ContainerStarted","Data":"fcaa86af1f3aab794bdd66630dc687af60e99b62e662b217a5e2d8439ef3d730"} Jun 06 20:27:57.940487 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:27:57.940457 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:27:58.798724 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:58.798579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:58.896958 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:58.896891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:27:59.621273 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:59.621240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" event={"ID":"7ffb7ca9-b0c5-4269-9bb0-160b09a5fcce","Type":"ContainerStarted","Data":"9dcf4c694470eb0301fd4f0bd80a9445c63ae4fd61c08d448f52403b80a2870e"} Jun 06 20:27:59.641434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:59.641382 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-lp8fx" podStartSLOduration=0.964078955 podStartE2EDuration="2.641366126s" totalImagesPullingTime="1.677287171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:27:59.639076491 +0000 UTC m=+503.450421074" watchObservedRunningTime="2026-06-06 20:27:59.641366126 +0000 UTC m=+503.452710713" Jun 06 20:27:59.959315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:27:59.959231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:00.071612 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:00.071574 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:00.195281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:00.195249 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:00.292660 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:00.292584 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:00.647652 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:00.647621 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:01.812507 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.812476 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s"] Jun 06 20:28:01.815024 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.815007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.817294 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.817270 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:28:01.817413 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.817358 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:28:01.818330 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.818308 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:28:01.823985 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.823966 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s"] Jun 06 20:28:01.870408 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.870384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.870534 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.870427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.870534 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.870472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p8m\" (UniqueName: \"kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.971032 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.970992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.971207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.971072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p8m\" (UniqueName: \"kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.971207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.971161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.971491 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.971468 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.971574 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.971492 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:01.979019 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:01.978993 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p8m\" (UniqueName: \"kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:02.124175 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:02.124081 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:02.250554 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:02.250507 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s"] Jun 06 20:28:02.252786 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:02.252759 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde08df54_38ed_4b48_9171_098721244568.slice/crio-53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f WatchSource:0}: Error finding container 53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f: Status 404 returned error can't find the container with id 53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f Jun 06 20:28:02.635315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:02.635278 2575 generic.go:356] "Generic (PLEG): container finished" podID="de08df54-38ed-4b48-9171-098721244568" containerID="d6d29999ca910369ea4fd06baf5ef7bd5fb382e757810ba9a9d3f3f3c30654d9" exitCode=0 Jun 06 20:28:02.635477 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:02.635326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" event={"ID":"de08df54-38ed-4b48-9171-098721244568","Type":"ContainerDied","Data":"d6d29999ca910369ea4fd06baf5ef7bd5fb382e757810ba9a9d3f3f3c30654d9"} Jun 06 20:28:02.635477 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:02.635373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" event={"ID":"de08df54-38ed-4b48-9171-098721244568","Type":"ContainerStarted","Data":"53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f"} Jun 06 20:28:03.633212 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:03.633178 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:04.047868 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:04.047790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:05.568445 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.568405 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hnckt"] Jun 06 20:28:05.570915 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.570893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.573217 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.573191 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 20:28:05.573982 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.573957 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 20:28:05.574079 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.573957 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xzst9\"" Jun 06 20:28:05.580952 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.580931 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hnckt"] Jun 06 20:28:05.603338 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.603313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.603449 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.603368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbsx\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-kube-api-access-scbsx\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.650824 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.650791 2575 generic.go:356] "Generic (PLEG): container finished" podID="de08df54-38ed-4b48-9171-098721244568" containerID="507506345f0a9c9cb685af5caa8c6cf6930417fbc56d0dc6aff867de84316565" exitCode=0 Jun 06 20:28:05.650925 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.650840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" event={"ID":"de08df54-38ed-4b48-9171-098721244568","Type":"ContainerDied","Data":"507506345f0a9c9cb685af5caa8c6cf6930417fbc56d0dc6aff867de84316565"} Jun 06 20:28:05.704830 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.704805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.704926 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.704854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbsx\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-kube-api-access-scbsx\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.713086 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.713062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.713394 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.713377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbsx\" (UniqueName: \"kubernetes.io/projected/e7db5b03-417a-45d6-8bd9-52ac85ecac76-kube-api-access-scbsx\") pod \"cert-manager-cainjector-5d99449ffd-hnckt\" (UID: \"e7db5b03-417a-45d6-8bd9-52ac85ecac76\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:05.889247 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:05.889182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" Jun 06 20:28:06.012494 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.012471 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hnckt"] Jun 06 20:28:06.014483 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:06.014457 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7db5b03_417a_45d6_8bd9_52ac85ecac76.slice/crio-bd0230af846aed82dc762c4495132d787ce002ec293270b8c19c78efae0292e7 WatchSource:0}: Error finding container bd0230af846aed82dc762c4495132d787ce002ec293270b8c19c78efae0292e7: Status 404 returned error can't find the container with id bd0230af846aed82dc762c4495132d787ce002ec293270b8c19c78efae0292e7 Jun 06 20:28:06.196398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.196320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:06.245274 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.245244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:06.656678 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.656649 2575 generic.go:356] "Generic (PLEG): container finished" podID="de08df54-38ed-4b48-9171-098721244568" containerID="a6331b12ae1400154af5092cec09bc2a9b2f7c4815e7784f2af0d387a77a5144" exitCode=0 Jun 06 20:28:06.657062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.656747 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" event={"ID":"de08df54-38ed-4b48-9171-098721244568","Type":"ContainerDied","Data":"a6331b12ae1400154af5092cec09bc2a9b2f7c4815e7784f2af0d387a77a5144"} Jun 06 20:28:06.657803 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:06.657779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" event={"ID":"e7db5b03-417a-45d6-8bd9-52ac85ecac76","Type":"ContainerStarted","Data":"bd0230af846aed82dc762c4495132d787ce002ec293270b8c19c78efae0292e7"} Jun 06 20:28:07.987513 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:07.987434 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:08.452515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.452492 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:08.530912 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.530890 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6p8m\" (UniqueName: \"kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m\") pod \"de08df54-38ed-4b48-9171-098721244568\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " Jun 06 20:28:08.531037 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.530924 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util\") pod \"de08df54-38ed-4b48-9171-098721244568\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " Jun 06 20:28:08.531124 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.531106 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle\") pod \"de08df54-38ed-4b48-9171-098721244568\" (UID: \"de08df54-38ed-4b48-9171-098721244568\") " Jun 06 20:28:08.531479 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.531455 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle" (OuterVolumeSpecName: "bundle") pod "de08df54-38ed-4b48-9171-098721244568" (UID: "de08df54-38ed-4b48-9171-098721244568"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:28:08.532888 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.532864 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m" (OuterVolumeSpecName: "kube-api-access-m6p8m") pod "de08df54-38ed-4b48-9171-098721244568" (UID: "de08df54-38ed-4b48-9171-098721244568"). InnerVolumeSpecName "kube-api-access-m6p8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:28:08.535673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.535650 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util" (OuterVolumeSpecName: "util") pod "de08df54-38ed-4b48-9171-098721244568" (UID: "de08df54-38ed-4b48-9171-098721244568"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:28:08.632563 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.632530 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6p8m\" (UniqueName: \"kubernetes.io/projected/de08df54-38ed-4b48-9171-098721244568-kube-api-access-m6p8m\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:08.632563 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.632559 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:08.632563 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.632568 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/de08df54-38ed-4b48-9171-098721244568-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:08.670105 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.670082 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" Jun 06 20:28:08.670105 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.670101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmjv8s" event={"ID":"de08df54-38ed-4b48-9171-098721244568","Type":"ContainerDied","Data":"53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f"} Jun 06 20:28:08.670312 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.670159 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53ce44845a49c79b1f1ba0da6b9ba388284a47ca88d19889dfc525898246d27f" Jun 06 20:28:08.671959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.671933 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" event={"ID":"e7db5b03-417a-45d6-8bd9-52ac85ecac76","Type":"ContainerStarted","Data":"c311be2dfaea832781835862cd70585d8280668111fbb4e0ab161be33919380b"} Jun 06 20:28:08.688314 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:08.688221 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hnckt" podStartSLOduration=1.234493962 podStartE2EDuration="3.688207599s" totalImagesPullingTime="2.453713637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:28:08.686378498 +0000 UTC m=+512.497723082" watchObservedRunningTime="2026-06-06 20:28:08.688207599 +0000 UTC m=+512.499552183" Jun 06 20:28:11.228622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:11.228587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:11.456680 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:11.456643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:13.472150 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:13.472116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:13.541899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:13.541868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:14.843977 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.843942 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w"] Jun 06 20:28:14.844315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844280 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="util" Jun 06 20:28:14.844315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844290 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="util" Jun 06 20:28:14.844315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844303 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="pull" Jun 06 20:28:14.844315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844309 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="pull" Jun 06 20:28:14.844315 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844316 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="extract" Jun 06 20:28:14.844497 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844322 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="extract" Jun 06 20:28:14.844497 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.844378 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="de08df54-38ed-4b48-9171-098721244568" containerName="extract" Jun 06 20:28:14.846529 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.846510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:14.848954 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.848930 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 20:28:14.849754 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.849738 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:28:14.849754 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.849746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-c492m\"" Jun 06 20:28:14.857683 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.857653 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w"] Jun 06 20:28:14.989399 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.989367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vn8x\" (UniqueName: \"kubernetes.io/projected/2d8e592d-30e6-495c-a8a7-dd30531f63a6-kube-api-access-2vn8x\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:14.989399 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:14.989399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8e592d-30e6-495c-a8a7-dd30531f63a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.090696 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.090665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vn8x\" (UniqueName: \"kubernetes.io/projected/2d8e592d-30e6-495c-a8a7-dd30531f63a6-kube-api-access-2vn8x\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.090696 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.090714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8e592d-30e6-495c-a8a7-dd30531f63a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.091158 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.091140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8e592d-30e6-495c-a8a7-dd30531f63a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.102836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.102811 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vn8x\" (UniqueName: \"kubernetes.io/projected/2d8e592d-30e6-495c-a8a7-dd30531f63a6-kube-api-access-2vn8x\") pod \"openshift-lws-operator-fd8ccff4c-wsh6w\" (UID: \"2d8e592d-30e6-495c-a8a7-dd30531f63a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.156622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.156597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" Jun 06 20:28:15.307577 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.307538 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w"] Jun 06 20:28:15.310536 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:15.310496 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d8e592d_30e6_495c_a8a7_dd30531f63a6.slice/crio-7610d8ef68b0ca19eeda4f8953b3b0ef2df1510db027d85f0213e05d044e938b WatchSource:0}: Error finding container 7610d8ef68b0ca19eeda4f8953b3b0ef2df1510db027d85f0213e05d044e938b: Status 404 returned error can't find the container with id 7610d8ef68b0ca19eeda4f8953b3b0ef2df1510db027d85f0213e05d044e938b Jun 06 20:28:15.676779 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:15.676747 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:15.703590 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:15.703552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" event={"ID":"2d8e592d-30e6-495c-a8a7-dd30531f63a6","Type":"ContainerStarted","Data":"7610d8ef68b0ca19eeda4f8953b3b0ef2df1510db027d85f0213e05d044e938b"} Jun 06 20:28:17.998632 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:17.998593 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:18.722045 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:18.722007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" event={"ID":"2d8e592d-30e6-495c-a8a7-dd30531f63a6","Type":"ContainerStarted","Data":"ba8c7068145c278208e2f18e417456f914b66ff8d3d8fc61cb5c8ba2cce1f2dd"} Jun 06 20:28:18.739143 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:18.739086 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wsh6w" podStartSLOduration=1.75157016 podStartE2EDuration="4.739064255s" totalImagesPullingTime="2.987494095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:28:18.736302845 +0000 UTC m=+522.547647428" watchObservedRunningTime="2026-06-06 20:28:18.739064255 +0000 UTC m=+522.550408841" Jun 06 20:28:19.373537 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:19.373502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:19.474131 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:19.474102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:21.079934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.079858 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr"] Jun 06 20:28:21.082334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.082317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.084575 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.084547 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:28:21.084673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.084621 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:28:21.085515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.085496 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:28:21.092804 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.092235 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr"] Jun 06 20:28:21.237513 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.237478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:21.243676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.243647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.243810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.243697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.243810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.243798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59clq\" (UniqueName: \"kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.345035 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.344950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.345035 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.345001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.345206 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.345036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59clq\" (UniqueName: \"kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.345344 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.345326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.345430 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.345413 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.352862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.352837 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59clq\" (UniqueName: \"kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.395658 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.395633 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:21.525639 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.525612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr"] Jun 06 20:28:21.528425 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:21.528398 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285ee6de_1dbf_43e4_9b9d_c61fda97bad9.slice/crio-2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34 WatchSource:0}: Error finding container 2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34: Status 404 returned error can't find the container with id 2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34 Jun 06 20:28:21.737939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.737903 2575 generic.go:356] "Generic (PLEG): container finished" podID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerID="30eea67bc8dcbf637184d6b3825eecb97ad200c1f338e38f3e478e06a2edd0a9" exitCode=0 Jun 06 20:28:21.738129 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.737987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" event={"ID":"285ee6de-1dbf-43e4-9b9d-c61fda97bad9","Type":"ContainerDied","Data":"30eea67bc8dcbf637184d6b3825eecb97ad200c1f338e38f3e478e06a2edd0a9"} Jun 06 20:28:21.738129 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:21.738077 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" event={"ID":"285ee6de-1dbf-43e4-9b9d-c61fda97bad9","Type":"ContainerStarted","Data":"2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34"} Jun 06 20:28:22.744862 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:22.744824 2575 generic.go:356] "Generic (PLEG): container finished" podID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerID="d21540e7725964820fe9324fcff8b2abb0b732d35e2ed9d56aacf9bcdf533856" exitCode=0 Jun 06 20:28:22.745291 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:22.744917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" event={"ID":"285ee6de-1dbf-43e4-9b9d-c61fda97bad9","Type":"ContainerDied","Data":"d21540e7725964820fe9324fcff8b2abb0b732d35e2ed9d56aacf9bcdf533856"} Jun 06 20:28:23.751915 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:23.751884 2575 generic.go:356] "Generic (PLEG): container finished" podID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerID="e6320aab55b0ef231d4253c6106f63cbe97bfcbdfe3f8a44d955a5a35dcfde50" exitCode=0 Jun 06 20:28:23.752292 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:23.751954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" event={"ID":"285ee6de-1dbf-43e4-9b9d-c61fda97bad9","Type":"ContainerDied","Data":"e6320aab55b0ef231d4253c6106f63cbe97bfcbdfe3f8a44d955a5a35dcfde50"} Jun 06 20:28:24.894548 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.894522 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:24.979258 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.979226 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59clq\" (UniqueName: \"kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq\") pod \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " Jun 06 20:28:24.979431 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.979364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle\") pod \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " Jun 06 20:28:24.979431 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.979402 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util\") pod \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\" (UID: \"285ee6de-1dbf-43e4-9b9d-c61fda97bad9\") " Jun 06 20:28:24.980126 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.980087 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle" (OuterVolumeSpecName: "bundle") pod "285ee6de-1dbf-43e4-9b9d-c61fda97bad9" (UID: "285ee6de-1dbf-43e4-9b9d-c61fda97bad9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:28:24.981627 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.981600 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq" (OuterVolumeSpecName: "kube-api-access-59clq") pod "285ee6de-1dbf-43e4-9b9d-c61fda97bad9" (UID: "285ee6de-1dbf-43e4-9b9d-c61fda97bad9"). InnerVolumeSpecName "kube-api-access-59clq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:28:24.984841 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:24.984821 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util" (OuterVolumeSpecName: "util") pod "285ee6de-1dbf-43e4-9b9d-c61fda97bad9" (UID: "285ee6de-1dbf-43e4-9b9d-c61fda97bad9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:28:25.080619 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.080585 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:25.080619 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.080613 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:25.080619 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.080622 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59clq\" (UniqueName: \"kubernetes.io/projected/285ee6de-1dbf-43e4-9b9d-c61fda97bad9-kube-api-access-59clq\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:28:25.729837 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.729805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:25.763090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.763056 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" event={"ID":"285ee6de-1dbf-43e4-9b9d-c61fda97bad9","Type":"ContainerDied","Data":"2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34"} Jun 06 20:28:25.763252 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.763098 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdppfzr" Jun 06 20:28:25.763252 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:25.763106 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7256c49b39cb64ede0a1d9ee348513735bf1ff543c2a5559c6bc7a28b85f34" Jun 06 20:28:28.041717 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:28.041678 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:30.658494 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:30.658462 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a5b4c_d7b3_41d5_9741_5e618ba6abe4.slice/crio-d61f21e828adc50c68f7ba8fd53c7847b336a4261a8af71476f69119170ba963.scope\": RecentStats: unable to find data in memory cache]" Jun 06 20:28:37.028144 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:37.028107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:37.127969 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:37.127936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:37.650915 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:37.650877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:37.931637 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:37.931559 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.034852 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.034823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.062112 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062084 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8"] Jun 06 20:28:38.062420 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062408 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="extract" Jun 06 20:28:38.062463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062422 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="extract" Jun 06 20:28:38.062463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062440 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="pull" Jun 06 20:28:38.062463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062446 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="pull" Jun 06 20:28:38.062463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062459 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="util" Jun 06 20:28:38.062594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062465 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="util" Jun 06 20:28:38.062594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.062522 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="285ee6de-1dbf-43e4-9b9d-c61fda97bad9" containerName="extract" Jun 06 20:28:38.065306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.065283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.067924 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.067902 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 20:28:38.068028 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.067927 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 20:28:38.068090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.068030 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 20:28:38.068152 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.068084 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vbcvb\"" Jun 06 20:28:38.068217 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.068201 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 20:28:38.083993 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.083964 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8"] Jun 06 20:28:38.092969 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.092940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.093084 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.092985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.093084 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.093014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.093084 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.093076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.093240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.093160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvppp\" (UniqueName: \"kubernetes.io/projected/d553bb8e-bbf6-4878-a7c4-068ab15d5683-kube-api-access-bvppp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.165578 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.165545 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.194026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.193966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.194026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.193995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.194026 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.194011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.194196 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.194052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.194196 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.194091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvppp\" (UniqueName: \"kubernetes.io/projected/d553bb8e-bbf6-4878-a7c4-068ab15d5683-kube-api-access-bvppp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.194441 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.194409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.196416 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.196390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d553bb8e-bbf6-4878-a7c4-068ab15d5683-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.196932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.196910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.197015 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.196956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d553bb8e-bbf6-4878-a7c4-068ab15d5683-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.203519 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.203500 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvppp\" (UniqueName: \"kubernetes.io/projected/d553bb8e-bbf6-4878-a7c4-068ab15d5683-kube-api-access-bvppp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-rhcx8\" (UID: \"d553bb8e-bbf6-4878-a7c4-068ab15d5683\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.269899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.269875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.369452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.369418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.378501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.378477 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:38.467665 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.467633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.536779 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:38.536730 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd553bb8e_bbf6_4878_a7c4_068ab15d5683.slice/crio-67062ab99f8001d10e4352f99014012c5824ae52917d24fb4d59ad65b84b08f0 WatchSource:0}: Error finding container 67062ab99f8001d10e4352f99014012c5824ae52917d24fb4d59ad65b84b08f0: Status 404 returned error can't find the container with id 67062ab99f8001d10e4352f99014012c5824ae52917d24fb4d59ad65b84b08f0 Jun 06 20:28:38.540103 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.540075 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8"] Jun 06 20:28:38.587456 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.587427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.681426 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.681399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:38.832550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:38.832519 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" event={"ID":"d553bb8e-bbf6-4878-a7c4-068ab15d5683","Type":"ContainerStarted","Data":"67062ab99f8001d10e4352f99014012c5824ae52917d24fb4d59ad65b84b08f0"} Jun 06 20:28:41.540780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:41.540755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:41.632831 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:41.632791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:41.850291 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:41.850258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" event={"ID":"d553bb8e-bbf6-4878-a7c4-068ab15d5683","Type":"ContainerStarted","Data":"49b7bb1fce3cf3fce0eef501824f3fdf75d3419c5b22c301dc5c71072a4775cf"} Jun 06 20:28:42.856676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:42.856638 2575 generic.go:356] "Generic (PLEG): container finished" podID="d553bb8e-bbf6-4878-a7c4-068ab15d5683" containerID="49b7bb1fce3cf3fce0eef501824f3fdf75d3419c5b22c301dc5c71072a4775cf" exitCode=0 Jun 06 20:28:42.857101 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:42.856733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" event={"ID":"d553bb8e-bbf6-4878-a7c4-068ab15d5683","Type":"ContainerDied","Data":"49b7bb1fce3cf3fce0eef501824f3fdf75d3419c5b22c301dc5c71072a4775cf"} Jun 06 20:28:43.868328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:43.868287 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" event={"ID":"d553bb8e-bbf6-4878-a7c4-068ab15d5683","Type":"ContainerStarted","Data":"541e727caf92bd10fdf205cb09f78720cf35b5004270554a00c99e759a6e4973"} Jun 06 20:28:43.868846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:43.868417 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:43.939286 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:43.939234 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" podStartSLOduration=1.729270096 podStartE2EDuration="5.939218353s" totalImagesPullingTime="3.205497088s" totalInitContainerRuntime="1.004451169s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:28:43.936139945 +0000 UTC m=+547.747484561" watchObservedRunningTime="2026-06-06 20:28:43.939218353 +0000 UTC m=+547.750562936" Jun 06 20:28:49.102748 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:49.102696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:54.876097 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:54.876068 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-rhcx8" Jun 06 20:28:56.708355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:56.708322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:56.882080 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:56.882038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.016119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.016026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.110351 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.110317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.214222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.214188 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54c798458-s9w8l"] Jun 06 20:28:57.217683 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.217640 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.220531 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.220509 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 20:28:57.220531 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.220525 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 20:28:57.220721 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.220556 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8smvb\"" Jun 06 20:28:57.220721 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.220587 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 20:28:57.221331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.221313 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 20:28:57.228844 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.228814 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54c798458-s9w8l"] Jun 06 20:28:57.365057 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.365022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tmp\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.365222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.365063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxkx\" (UniqueName: \"kubernetes.io/projected/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-kube-api-access-2bxkx\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.365222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.365112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tls-certs\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.367640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.367597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.397197 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.397167 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zqd7v"] Jun 06 20:28:57.400410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.400390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.402802 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.402782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 06 20:28:57.402904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.402874 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cn8dn\"" Jun 06 20:28:57.410274 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.410251 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zqd7v"] Jun 06 20:28:57.461405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.461373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.466560 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.466536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.466693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.466597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tmp\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.466693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.466654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxkx\" (UniqueName: \"kubernetes.io/projected/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-kube-api-access-2bxkx\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.466693 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.466683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnvp\" (UniqueName: \"kubernetes.io/projected/716db496-970c-434b-985a-5c812ec067e5-kube-api-access-wrnvp\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.466912 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.466756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tls-certs\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.468911 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.468888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tmp\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.469179 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.469162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-tls-certs\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.474696 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.474674 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxkx\" (UniqueName: \"kubernetes.io/projected/06e30aa4-eaeb-4f9a-9f09-3cca3af8459a-kube-api-access-2bxkx\") pod \"kube-auth-proxy-54c798458-s9w8l\" (UID: \"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a\") " pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.528330 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.528303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" Jun 06 20:28:57.560515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.560489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.567926 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.567904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.568044 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.567966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnvp\" (UniqueName: \"kubernetes.io/projected/716db496-970c-434b-985a-5c812ec067e5-kube-api-access-wrnvp\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.568106 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:57.568055 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 06 20:28:57.568161 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:28:57.568125 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert podName:716db496-970c-434b-985a-5c812ec067e5 nodeName:}" failed. No retries permitted until 2026-06-06 20:28:58.068108234 +0000 UTC m=+561.879452797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert") pod "odh-model-controller-6dc94f689f-zqd7v" (UID: "716db496-970c-434b-985a-5c812ec067e5") : secret "odh-model-controller-webhook-cert" not found Jun 06 20:28:57.579442 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.579171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnvp\" (UniqueName: \"kubernetes.io/projected/716db496-970c-434b-985a-5c812ec067e5-kube-api-access-wrnvp\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:57.660607 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.660581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.666688 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.666666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54c798458-s9w8l"] Jun 06 20:28:57.668395 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:57.668362 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e30aa4_eaeb_4f9a_9f09_3cca3af8459a.slice/crio-37857cbed2ee81bc89881c0ff1c865e99cae0710e5d672fb083b58fbadcd914f WatchSource:0}: Error finding container 37857cbed2ee81bc89881c0ff1c865e99cae0710e5d672fb083b58fbadcd914f: Status 404 returned error can't find the container with id 37857cbed2ee81bc89881c0ff1c865e99cae0710e5d672fb083b58fbadcd914f Jun 06 20:28:57.766891 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.766852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:57.936541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:57.936457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" event={"ID":"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a","Type":"ContainerStarted","Data":"37857cbed2ee81bc89881c0ff1c865e99cae0710e5d672fb083b58fbadcd914f"} Jun 06 20:28:58.029476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.029445 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-g2g2n"] Jun 06 20:28:58.033807 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.033788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.036236 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.036218 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 06 20:28:58.044135 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.044111 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-g2g2n"] Jun 06 20:28:58.046334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.046311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:58.071180 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.071148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:58.073464 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.073447 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/716db496-970c-434b-985a-5c812ec067e5-cert\") pod \"odh-model-controller-6dc94f689f-zqd7v\" (UID: \"716db496-970c-434b-985a-5c812ec067e5\") " pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:58.133227 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.133197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:28:58.171929 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.171893 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nbz\" (UniqueName: \"kubernetes.io/projected/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-kube-api-access-t9nbz\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.172094 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.172012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-tls-certs\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.273243 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.273155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-tls-certs\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.273412 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.273284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nbz\" (UniqueName: \"kubernetes.io/projected/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-kube-api-access-t9nbz\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.276050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.276016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-tls-certs\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.281185 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.281160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nbz\" (UniqueName: \"kubernetes.io/projected/cdbf77ee-7fc9-41df-a74e-d9ab9aecc720-kube-api-access-t9nbz\") pod \"model-serving-api-5dd488fc48-g2g2n\" (UID: \"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720\") " pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.311470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.311432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:28:58.346854 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.346819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:28:58.527185 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.527159 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-g2g2n"] Jun 06 20:28:58.529894 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:58.529865 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbf77ee_7fc9_41df_a74e_d9ab9aecc720.slice/crio-d12e5411ab3fb99b4957b4396465a3ef3420a3786160c267a7f2e720593682d3 WatchSource:0}: Error finding container d12e5411ab3fb99b4957b4396465a3ef3420a3786160c267a7f2e720593682d3: Status 404 returned error can't find the container with id d12e5411ab3fb99b4957b4396465a3ef3420a3786160c267a7f2e720593682d3 Jun 06 20:28:58.693654 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.693625 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zqd7v"] Jun 06 20:28:58.695649 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:28:58.695616 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716db496_970c_434b_985a_5c812ec067e5.slice/crio-cb90e7ff33e2371eda03f85dcf882ab8906c0037cfea35a9ff8ebdf1295d85a1 WatchSource:0}: Error finding container cb90e7ff33e2371eda03f85dcf882ab8906c0037cfea35a9ff8ebdf1295d85a1: Status 404 returned error can't find the container with id cb90e7ff33e2371eda03f85dcf882ab8906c0037cfea35a9ff8ebdf1295d85a1 Jun 06 20:28:58.952727 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.952637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" event={"ID":"716db496-970c-434b-985a-5c812ec067e5","Type":"ContainerStarted","Data":"cb90e7ff33e2371eda03f85dcf882ab8906c0037cfea35a9ff8ebdf1295d85a1"} Jun 06 20:28:58.954566 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:58.954536 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" event={"ID":"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720","Type":"ContainerStarted","Data":"d12e5411ab3fb99b4957b4396465a3ef3420a3786160c267a7f2e720593682d3"} Jun 06 20:28:59.228694 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.226205 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q"] Jun 06 20:28:59.231032 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.231007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.234923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.234815 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:28:59.234923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.234885 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:28:59.234923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.234901 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:28:59.236418 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.236338 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q"] Jun 06 20:28:59.386622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.386339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ndqt\" (UniqueName: \"kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.386622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.386405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.386622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.386474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.488836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.487576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.488836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.487738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ndqt\" (UniqueName: \"kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.488836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.487788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.488836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.488194 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.488836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.488463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.498121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.498090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ndqt\" (UniqueName: \"kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:28:59.550720 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:28:59.550401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:29:02.662046 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.657204 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q"] Jun 06 20:29:02.980077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.980042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" event={"ID":"cdbf77ee-7fc9-41df-a74e-d9ab9aecc720","Type":"ContainerStarted","Data":"2f143e86bc8e76f7c281ef0e950f23861585eb04af7e270118d5cc88a653d5d5"} Jun 06 20:29:02.980284 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.980110 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:29:02.981885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.981832 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" event={"ID":"06e30aa4-eaeb-4f9a-9f09-3cca3af8459a","Type":"ContainerStarted","Data":"793c36044caaea910cbdfd74be4b89ef1caf3f0dcb252a9a7ddd5abae81387c3"} Jun 06 20:29:02.983557 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.983520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" event={"ID":"716db496-970c-434b-985a-5c812ec067e5","Type":"ContainerStarted","Data":"8e9844245e8b84fb745383275bde20171be8eb271aec2a8fff38f8593e75e367"} Jun 06 20:29:02.983667 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.983583 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:29:02.984921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.984898 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerID="929380483dddf3d523ee233e979c12970302aa1d321560af861f5d7217d52c87" exitCode=0 Jun 06 20:29:02.985005 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.984932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" event={"ID":"e88e9602-5ab8-49f0-bcaa-64209477f96d","Type":"ContainerDied","Data":"929380483dddf3d523ee233e979c12970302aa1d321560af861f5d7217d52c87"} Jun 06 20:29:02.985005 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.984956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" event={"ID":"e88e9602-5ab8-49f0-bcaa-64209477f96d","Type":"ContainerStarted","Data":"053aff3fd2807fd31b467abb44dcb8530eae5c0147c6f9ed71daf5ee624b4eeb"} Jun 06 20:29:02.997306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:02.997268 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" podStartSLOduration=0.991417707 podStartE2EDuration="4.99725403s" totalImagesPullingTime="4.005836323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:02.996311101 +0000 UTC m=+566.807655684" watchObservedRunningTime="2026-06-06 20:29:02.99725403 +0000 UTC m=+566.808598612" Jun 06 20:29:03.035988 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:03.035854 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54c798458-s9w8l" podStartSLOduration=1.167978933 podStartE2EDuration="6.035837429s" totalImagesPullingTime="4.867858496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:03.033310294 +0000 UTC m=+566.844654877" watchObservedRunningTime="2026-06-06 20:29:03.035837429 +0000 UTC m=+566.847182003" Jun 06 20:29:03.055095 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:03.055031 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" podStartSLOduration=2.20136736 podStartE2EDuration="6.055011273s" totalImagesPullingTime="3.853643913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:03.052496189 +0000 UTC m=+566.863840778" watchObservedRunningTime="2026-06-06 20:29:03.055011273 +0000 UTC m=+566.866355859" Jun 06 20:29:03.992331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:03.992246 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerID="37ba5dbf988e8c760fdaa82101d9319286f0dbf6e5699a53bb514018f5f4d44a" exitCode=0 Jun 06 20:29:03.992763 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:03.992353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" event={"ID":"e88e9602-5ab8-49f0-bcaa-64209477f96d","Type":"ContainerDied","Data":"37ba5dbf988e8c760fdaa82101d9319286f0dbf6e5699a53bb514018f5f4d44a"} Jun 06 20:29:05.000942 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:05.000904 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerID="d8209e60686508e02f9476b994825341d58515b832bba542e9419f162d24577b" exitCode=0 Jun 06 20:29:05.001331 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:05.000988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" event={"ID":"e88e9602-5ab8-49f0-bcaa-64209477f96d","Type":"ContainerDied","Data":"d8209e60686508e02f9476b994825341d58515b832bba542e9419f162d24577b"} Jun 06 20:29:06.157500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.157478 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:29:06.261071 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.260994 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util\") pod \"e88e9602-5ab8-49f0-bcaa-64209477f96d\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " Jun 06 20:29:06.261071 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.261044 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ndqt\" (UniqueName: \"kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt\") pod \"e88e9602-5ab8-49f0-bcaa-64209477f96d\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " Jun 06 20:29:06.261249 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.261095 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle\") pod \"e88e9602-5ab8-49f0-bcaa-64209477f96d\" (UID: \"e88e9602-5ab8-49f0-bcaa-64209477f96d\") " Jun 06 20:29:06.262171 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.262138 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle" (OuterVolumeSpecName: "bundle") pod "e88e9602-5ab8-49f0-bcaa-64209477f96d" (UID: "e88e9602-5ab8-49f0-bcaa-64209477f96d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:29:06.263240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.263207 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt" (OuterVolumeSpecName: "kube-api-access-7ndqt") pod "e88e9602-5ab8-49f0-bcaa-64209477f96d" (UID: "e88e9602-5ab8-49f0-bcaa-64209477f96d"). InnerVolumeSpecName "kube-api-access-7ndqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:29:06.266805 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.266783 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util" (OuterVolumeSpecName: "util") pod "e88e9602-5ab8-49f0-bcaa-64209477f96d" (UID: "e88e9602-5ab8-49f0-bcaa-64209477f96d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:29:06.362762 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.362700 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:06.362762 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.362748 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e88e9602-5ab8-49f0-bcaa-64209477f96d-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:06.362762 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.362758 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ndqt\" (UniqueName: \"kubernetes.io/projected/e88e9602-5ab8-49f0-bcaa-64209477f96d-kube-api-access-7ndqt\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:06.559038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.559004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:06.566889 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.566860 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-vbzf4"] Jun 06 20:29:06.567268 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567253 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="pull" Jun 06 20:29:06.567324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567270 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="pull" Jun 06 20:29:06.567324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567283 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="util" Jun 06 20:29:06.567324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567288 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="util" Jun 06 20:29:06.567324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567304 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="extract" Jun 06 20:29:06.567324 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567312 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="extract" Jun 06 20:29:06.567469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.567367 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88e9602-5ab8-49f0-bcaa-64209477f96d" containerName="extract" Jun 06 20:29:06.570639 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.570608 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.574373 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.574262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 06 20:29:06.574629 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.574610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dvl76\"" Jun 06 20:29:06.580901 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.580880 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x"] Jun 06 20:29:06.586009 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.585989 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-vbzf4"] Jun 06 20:29:06.586252 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.586202 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.589753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.589732 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 06 20:29:06.589964 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.589767 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bnrgb\"" Jun 06 20:29:06.600259 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.600238 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x"] Jun 06 20:29:06.637411 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.637380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:06.666485 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.666444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.666637 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.666575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzk9\" (UniqueName: \"kubernetes.io/projected/426e7b3e-9c14-4782-a31b-a01dc0e4746e-kube-api-access-drzk9\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.767087 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.767049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2f7x\" (UniqueName: \"kubernetes.io/projected/cf293818-d4ef-4cc9-a203-46a04b9bd81f-kube-api-access-g2f7x\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.767281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.767221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzk9\" (UniqueName: \"kubernetes.io/projected/426e7b3e-9c14-4782-a31b-a01dc0e4746e-kube-api-access-drzk9\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.767619 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.767595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf293818-d4ef-4cc9-a203-46a04b9bd81f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.767806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.767695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.767892 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:29:06.767803 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 06 20:29:06.767892 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:29:06.767876 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert podName:426e7b3e-9c14-4782-a31b-a01dc0e4746e nodeName:}" failed. No retries permitted until 2026-06-06 20:29:07.267856186 +0000 UTC m=+571.079200751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert") pod "kserve-controller-manager-69fc866d76-vbzf4" (UID: "426e7b3e-9c14-4782-a31b-a01dc0e4746e") : secret "kserve-webhook-server-cert" not found Jun 06 20:29:06.788308 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.788283 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzk9\" (UniqueName: \"kubernetes.io/projected/426e7b3e-9c14-4782-a31b-a01dc0e4746e-kube-api-access-drzk9\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:06.823184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.823106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:06.869167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.869142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2f7x\" (UniqueName: \"kubernetes.io/projected/cf293818-d4ef-4cc9-a203-46a04b9bd81f-kube-api-access-g2f7x\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.869303 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.869201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf293818-d4ef-4cc9-a203-46a04b9bd81f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.871503 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.871483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf293818-d4ef-4cc9-a203-46a04b9bd81f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.877119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.877094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2f7x\" (UniqueName: \"kubernetes.io/projected/cf293818-d4ef-4cc9-a203-46a04b9bd81f-kube-api-access-g2f7x\") pod \"llmisvc-controller-manager-864bfd7bc9-78c9x\" (UID: \"cf293818-d4ef-4cc9-a203-46a04b9bd81f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.901184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.901145 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:06.908414 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:06.908385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:07.009220 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.009119 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:07.016588 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.016558 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" Jun 06 20:29:07.016588 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.016576 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nw66q" event={"ID":"e88e9602-5ab8-49f0-bcaa-64209477f96d","Type":"ContainerDied","Data":"053aff3fd2807fd31b467abb44dcb8530eae5c0147c6f9ed71daf5ee624b4eeb"} Jun 06 20:29:07.016817 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.016673 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="053aff3fd2807fd31b467abb44dcb8530eae5c0147c6f9ed71daf5ee624b4eeb" Jun 06 20:29:07.040377 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.040346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x"] Jun 06 20:29:07.043435 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:07.043403 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf293818_d4ef_4cc9_a203_46a04b9bd81f.slice/crio-bfec6bde418a8f6bcf05413adc9dabe61f55c9078925b7822e3ec9f4881e4862 WatchSource:0}: Error finding container bfec6bde418a8f6bcf05413adc9dabe61f55c9078925b7822e3ec9f4881e4862: Status 404 returned error can't find the container with id bfec6bde418a8f6bcf05413adc9dabe61f55c9078925b7822e3ec9f4881e4862 Jun 06 20:29:07.274401 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.274289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:07.276690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.276670 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426e7b3e-9c14-4782-a31b-a01dc0e4746e-cert\") pod \"kserve-controller-manager-69fc866d76-vbzf4\" (UID: \"426e7b3e-9c14-4782-a31b-a01dc0e4746e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:07.484022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.483978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:07.654266 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:07.654237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-vbzf4"] Jun 06 20:29:07.679381 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:07.679353 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426e7b3e_9c14_4782_a31b_a01dc0e4746e.slice/crio-e8abf52c0ed4951dfc04b708066dda4f2b011f10b980b966dc335f39bc893aca WatchSource:0}: Error finding container e8abf52c0ed4951dfc04b708066dda4f2b011f10b980b966dc335f39bc893aca: Status 404 returned error can't find the container with id e8abf52c0ed4951dfc04b708066dda4f2b011f10b980b966dc335f39bc893aca Jun 06 20:29:08.027405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:08.027356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" event={"ID":"cf293818-d4ef-4cc9-a203-46a04b9bd81f","Type":"ContainerStarted","Data":"bfec6bde418a8f6bcf05413adc9dabe61f55c9078925b7822e3ec9f4881e4862"} Jun 06 20:29:08.028644 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:08.028615 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" event={"ID":"426e7b3e-9c14-4782-a31b-a01dc0e4746e","Type":"ContainerStarted","Data":"e8abf52c0ed4951dfc04b708066dda4f2b011f10b980b966dc335f39bc893aca"} Jun 06 20:29:11.045785 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.045746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" event={"ID":"cf293818-d4ef-4cc9-a203-46a04b9bd81f","Type":"ContainerStarted","Data":"03a59f50b9eac44ccbd66373317ac0463e452d67c05179805e933e8b2cd69d52"} Jun 06 20:29:11.046226 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.045812 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:11.047396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.047370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" event={"ID":"426e7b3e-9c14-4782-a31b-a01dc0e4746e","Type":"ContainerStarted","Data":"c369d75729e21f7f526959311f992b06a2733b353df79e8c695e9c77bdffd72a"} Jun 06 20:29:11.047504 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.047462 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:11.063384 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.063329 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" podStartSLOduration=1.563181187 podStartE2EDuration="5.063311279s" totalImagesPullingTime="3.500130092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:11.061018651 +0000 UTC m=+574.872363234" watchObservedRunningTime="2026-06-06 20:29:11.063311279 +0000 UTC m=+574.874655863" Jun 06 20:29:11.079419 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:11.079376 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" podStartSLOduration=2.212951419 podStartE2EDuration="5.07936191s" totalImagesPullingTime="2.866410491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:11.077070412 +0000 UTC m=+574.888414990" watchObservedRunningTime="2026-06-06 20:29:11.07936191 +0000 UTC m=+574.890706493" Jun 06 20:29:13.994790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:13.994761 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zqd7v" Jun 06 20:29:13.996765 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:13.996746 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-g2g2n" Jun 06 20:29:17.691012 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:17.690961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:18.754935 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:18.754905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:19.773918 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.773884 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884"] Jun 06 20:29:19.784735 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.784692 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.786799 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.786775 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884"] Jun 06 20:29:19.787102 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.787081 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:29:19.787205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.787081 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:29:19.788022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.788005 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:29:19.893730 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.893671 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv5sh\" (UniqueName: \"kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.893908 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.893796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.893908 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.893822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.994847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.994812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv5sh\" (UniqueName: \"kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.995027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.994910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.995027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.994938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.995329 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.995307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:19.995405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:19.995327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:20.003981 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:20.003955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv5sh\" (UniqueName: \"kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:20.018336 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:20.018305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:20.097485 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:20.097448 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:20.117390 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:20.117358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:20.232551 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:20.232524 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884"] Jun 06 20:29:20.234093 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:20.234060 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881982e4_7056_4caf_9c5f_ab72f46ea9a7.slice/crio-7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe WatchSource:0}: Error finding container 7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe: Status 404 returned error can't find the container with id 7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe Jun 06 20:29:21.100855 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.100817 2575 generic.go:356] "Generic (PLEG): container finished" podID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerID="c98317806d02dab3055a429e5479c5110f64c61e34c0b3aecd08689d6e7dbe52" exitCode=0 Jun 06 20:29:21.101223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.100907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" event={"ID":"881982e4-7056-4caf-9c5f-ab72f46ea9a7","Type":"ContainerDied","Data":"c98317806d02dab3055a429e5479c5110f64c61e34c0b3aecd08689d6e7dbe52"} Jun 06 20:29:21.101223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.100954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" event={"ID":"881982e4-7056-4caf-9c5f-ab72f46ea9a7","Type":"ContainerStarted","Data":"7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe"} Jun 06 20:29:21.836752 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.836701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:21.995726 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.983751 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf"] Jun 06 20:29:21.995726 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.989316 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.001857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.997558 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 06 20:29:22.001857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.997824 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7dfht\"" Jun 06 20:29:22.001857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:21.998020 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 06 20:29:22.008678 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.008650 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf"] Jun 06 20:29:22.010117 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.010090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/39676b95-4dd9-416b-add6-d9775e0bb2b2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.010246 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.010144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8hg\" (UniqueName: \"kubernetes.io/projected/39676b95-4dd9-416b-add6-d9775e0bb2b2-kube-api-access-qt8hg\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.107423 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.107330 2575 generic.go:356] "Generic (PLEG): container finished" podID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerID="e5a8fe9cae85bbb8d370620b0ceb93365353c77f8b1dc4b7cf7c404324659328" exitCode=0 Jun 06 20:29:22.107423 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.107395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" event={"ID":"881982e4-7056-4caf-9c5f-ab72f46ea9a7","Type":"ContainerDied","Data":"e5a8fe9cae85bbb8d370620b0ceb93365353c77f8b1dc4b7cf7c404324659328"} Jun 06 20:29:22.111726 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.111676 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8hg\" (UniqueName: \"kubernetes.io/projected/39676b95-4dd9-416b-add6-d9775e0bb2b2-kube-api-access-qt8hg\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.111839 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.111815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/39676b95-4dd9-416b-add6-d9775e0bb2b2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.114614 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.114593 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/39676b95-4dd9-416b-add6-d9775e0bb2b2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.131115 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.131087 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8hg\" (UniqueName: \"kubernetes.io/projected/39676b95-4dd9-416b-add6-d9775e0bb2b2-kube-api-access-qt8hg\") pod \"servicemesh-operator3-57f65f65fb-m5mtf\" (UID: \"39676b95-4dd9-416b-add6-d9775e0bb2b2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.308039 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.308006 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:22.453918 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:22.453892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf"] Jun 06 20:29:22.455351 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:22.455323 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39676b95_4dd9_416b_add6_d9775e0bb2b2.slice/crio-cdb2aa94a6edb385f5c9721ce765266f1d25f8915c56864d3908da8efdf546b3 WatchSource:0}: Error finding container cdb2aa94a6edb385f5c9721ce765266f1d25f8915c56864d3908da8efdf546b3: Status 404 returned error can't find the container with id cdb2aa94a6edb385f5c9721ce765266f1d25f8915c56864d3908da8efdf546b3 Jun 06 20:29:23.116388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:23.116343 2575 generic.go:356] "Generic (PLEG): container finished" podID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerID="467ff74a8396c7db7678e8785952787ba8fcd4a00fd465acaa3a34a37eadf751" exitCode=0 Jun 06 20:29:23.116858 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:23.116430 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" event={"ID":"881982e4-7056-4caf-9c5f-ab72f46ea9a7","Type":"ContainerDied","Data":"467ff74a8396c7db7678e8785952787ba8fcd4a00fd465acaa3a34a37eadf751"} Jun 06 20:29:23.118386 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:23.118350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" event={"ID":"39676b95-4dd9-416b-add6-d9775e0bb2b2","Type":"ContainerStarted","Data":"cdb2aa94a6edb385f5c9721ce765266f1d25f8915c56864d3908da8efdf546b3"} Jun 06 20:29:24.704745 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.704717 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:24.746978 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.746946 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv5sh\" (UniqueName: \"kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh\") pod \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " Jun 06 20:29:24.747119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.747054 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util\") pod \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " Jun 06 20:29:24.747119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.747097 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle\") pod \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\" (UID: \"881982e4-7056-4caf-9c5f-ab72f46ea9a7\") " Jun 06 20:29:24.748000 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.747974 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle" (OuterVolumeSpecName: "bundle") pod "881982e4-7056-4caf-9c5f-ab72f46ea9a7" (UID: "881982e4-7056-4caf-9c5f-ab72f46ea9a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:29:24.749201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.749172 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh" (OuterVolumeSpecName: "kube-api-access-dv5sh") pod "881982e4-7056-4caf-9c5f-ab72f46ea9a7" (UID: "881982e4-7056-4caf-9c5f-ab72f46ea9a7"). InnerVolumeSpecName "kube-api-access-dv5sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:29:24.752507 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.752472 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util" (OuterVolumeSpecName: "util") pod "881982e4-7056-4caf-9c5f-ab72f46ea9a7" (UID: "881982e4-7056-4caf-9c5f-ab72f46ea9a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:29:24.848578 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.848557 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:24.848671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.848581 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/881982e4-7056-4caf-9c5f-ab72f46ea9a7-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:24.848671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:24.848590 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv5sh\" (UniqueName: \"kubernetes.io/projected/881982e4-7056-4caf-9c5f-ab72f46ea9a7-kube-api-access-dv5sh\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:29:25.133644 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.133611 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" Jun 06 20:29:25.133836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.133609 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahv884" event={"ID":"881982e4-7056-4caf-9c5f-ab72f46ea9a7","Type":"ContainerDied","Data":"7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe"} Jun 06 20:29:25.133836 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.133781 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f6b626dc0d04cb2798d2c1494b29e5421b31ab4cd9b008db65b9cc3905001fe" Jun 06 20:29:25.136096 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.136067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" event={"ID":"39676b95-4dd9-416b-add6-d9775e0bb2b2","Type":"ContainerStarted","Data":"633d7d565c7ff507a52573d283b07e0d28a2688e3b6756c4fd0a799a1f80ff17"} Jun 06 20:29:25.136242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.136132 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:25.158091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:25.158039 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" podStartSLOduration=1.861051588 podStartE2EDuration="4.158020805s" totalImagesPullingTime="2.296969217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:25.15705267 +0000 UTC m=+588.968397256" watchObservedRunningTime="2026-06-06 20:29:25.158020805 +0000 UTC m=+588.969365392" Jun 06 20:29:29.982346 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982296 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww"] Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="pull" Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982738 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="pull" Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982761 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="util" Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982767 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="util" Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982779 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="extract" Jun 06 20:29:29.982847 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982785 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="extract" Jun 06 20:29:29.983151 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.982859 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="881982e4-7056-4caf-9c5f-ab72f46ea9a7" containerName="extract" Jun 06 20:29:29.986302 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.986280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:29.986914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.986888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:29.988940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.988912 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 06 20:29:29.988940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.988923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 06 20:29:29.988940 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.988935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 20:29:29.989201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.988965 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 06 20:29:29.989201 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.989020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9grhs\"" Jun 06 20:29:29.998025 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:29.998003 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww"] Jun 06 20:29:30.068204 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.068166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:30.097390 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbc6841b-017b-4246-8971-857d671e5f15-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwt46\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-kube-api-access-cwt46\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097617 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.097651 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.097628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198764 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198764 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198764 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198951 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198951 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbc6841b-017b-4246-8971-857d671e5f15-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.198951 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.198881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwt46\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-kube-api-access-cwt46\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.199379 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.199352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.201250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.201227 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.201630 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.201610 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbc6841b-017b-4246-8971-857d671e5f15-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.201728 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.201685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.201786 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.201696 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cbc6841b-017b-4246-8971-857d671e5f15-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.209231 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.209202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.214121 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.214095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwt46\" (UniqueName: \"kubernetes.io/projected/cbc6841b-017b-4246-8971-857d671e5f15-kube-api-access-cwt46\") pod \"istiod-openshift-gateway-75c67f8887-jgjww\" (UID: \"cbc6841b-017b-4246-8971-857d671e5f15\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.296167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.296065 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:30.439629 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.439585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww"] Jun 06 20:29:30.440839 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:30.440794 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc6841b_017b_4246_8971_857d671e5f15.slice/crio-887f9ed3303585538b08163f3dfe1bda7730939492c4b77cb85a7c20abd7d161 WatchSource:0}: Error finding container 887f9ed3303585538b08163f3dfe1bda7730939492c4b77cb85a7c20abd7d161: Status 404 returned error can't find the container with id 887f9ed3303585538b08163f3dfe1bda7730939492c4b77cb85a7c20abd7d161 Jun 06 20:29:30.553761 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:30.553729 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:31.170909 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:31.170872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" event={"ID":"cbc6841b-017b-4246-8971-857d671e5f15","Type":"ContainerStarted","Data":"887f9ed3303585538b08163f3dfe1bda7730939492c4b77cb85a7c20abd7d161"} Jun 06 20:29:32.419692 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:32.419650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:32.521213 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:32.521179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:32.747157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:32.747118 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:29:32.747224 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:32.747189 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:29:33.184344 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.184310 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" event={"ID":"cbc6841b-017b-4246-8971-857d671e5f15","Type":"ContainerStarted","Data":"6ec9c699918c2fca769c1c99c67ecfd013e7e63e04e2e0958a82c4203dfc75f0"} Jun 06 20:29:33.184547 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.184466 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:33.186104 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.186080 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-jgjww container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 06 20:29:33.186206 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.186131 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" podUID="cbc6841b-017b-4246-8971-857d671e5f15" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:29:33.216332 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.216260 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" podStartSLOduration=1.9123196999999998 podStartE2EDuration="4.216240771s" totalImagesPullingTime="2.303921071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:33.215543084 +0000 UTC m=+597.026887667" watchObservedRunningTime="2026-06-06 20:29:33.216240771 +0000 UTC m=+597.027585354" Jun 06 20:29:33.448594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.448475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:33.549239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.549165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:33.819908 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:33.819881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:34.038833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:34.038792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:34.191159 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:34.191086 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-jgjww" Jun 06 20:29:34.815435 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:34.815407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:35.055255 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.055220 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-jxxvm"] Jun 06 20:29:35.075010 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.074930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:35.117552 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.116878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-jxxvm"] Jun 06 20:29:35.117552 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.117003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.126371 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.126348 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 20:29:35.126533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.126371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nkcqd\"" Jun 06 20:29:35.247612 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.247572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d032e3a0-0461-46a8-b678-dad2210a9740-redirect-config\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.247846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.247618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnx6j\" (UniqueName: \"kubernetes.io/projected/d032e3a0-0461-46a8-b678-dad2210a9740-kube-api-access-mnx6j\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.348422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.348340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d032e3a0-0461-46a8-b678-dad2210a9740-redirect-config\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.348422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.348384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnx6j\" (UniqueName: \"kubernetes.io/projected/d032e3a0-0461-46a8-b678-dad2210a9740-kube-api-access-mnx6j\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.349044 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.349022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d032e3a0-0461-46a8-b678-dad2210a9740-redirect-config\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.356341 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.356318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnx6j\" (UniqueName: \"kubernetes.io/projected/d032e3a0-0461-46a8-b678-dad2210a9740-kube-api-access-mnx6j\") pod \"dashboard-redirect-7c6d865764-jxxvm\" (UID: \"d032e3a0-0461-46a8-b678-dad2210a9740\") " pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.434588 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.434551 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" Jun 06 20:29:35.599984 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:35.599915 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-jxxvm"] Jun 06 20:29:35.602282 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:35.602256 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd032e3a0_0461_46a8_b678_dad2210a9740.slice/crio-45cf7ea2c11252d0ea7a3df4862677d9c9c180e721cafe04276c2839ff47beae WatchSource:0}: Error finding container 45cf7ea2c11252d0ea7a3df4862677d9c9c180e721cafe04276c2839ff47beae: Status 404 returned error can't find the container with id 45cf7ea2c11252d0ea7a3df4862677d9c9c180e721cafe04276c2839ff47beae Jun 06 20:29:36.143166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.143134 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m5mtf" Jun 06 20:29:36.203249 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.203215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" event={"ID":"d032e3a0-0461-46a8-b678-dad2210a9740","Type":"ContainerStarted","Data":"45cf7ea2c11252d0ea7a3df4862677d9c9c180e721cafe04276c2839ff47beae"} Jun 06 20:29:36.677357 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.677330 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:29:36.679255 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.679231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:29:36.687679 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.687579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:29:36.690070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:36.690050 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:29:38.216872 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:38.216828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" event={"ID":"d032e3a0-0461-46a8-b678-dad2210a9740","Type":"ContainerStarted","Data":"f6b2f683c1c91438530977d73ea8c844aa4bb0e0009adcac9cbed1d5e02c4254"} Jun 06 20:29:38.232459 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:38.232410 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c6d865764-jxxvm" podStartSLOduration=0.846552306 podStartE2EDuration="3.232395097s" totalImagesPullingTime="2.385842791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:38.230841912 +0000 UTC m=+602.042186496" watchObservedRunningTime="2026-06-06 20:29:38.232395097 +0000 UTC m=+602.043739680" Jun 06 20:29:42.054880 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:42.054845 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-78c9x" Jun 06 20:29:42.058062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:42.058040 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-vbzf4" Jun 06 20:29:58.258487 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:58.258407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:58.317699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:58.317662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:58.437540 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:58.437503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.189487 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.189456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.390780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.390748 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7564f966fc-g4jmf"] Jun 06 20:29:59.397904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.397883 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.407070 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.407044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7564f966fc-g4jmf"] Jun 06 20:29:59.408530 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.408504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.474062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.473975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-console-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-trusted-ca-bundle\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvtn\" (UniqueName: \"kubernetes.io/projected/2cfd7f24-f83d-4209-9632-61e30d075e58-kube-api-access-ctvtn\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-oauth-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-oauth-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.474281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.474174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-service-ca\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.507996 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.507965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.574837 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.574811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvtn\" (UniqueName: \"kubernetes.io/projected/2cfd7f24-f83d-4209-9632-61e30d075e58-kube-api-access-ctvtn\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.574956 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.574847 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-oauth-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.574956 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.574867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-oauth-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575029 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.574993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-service-ca\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-console-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-trusted-ca-bundle\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575643 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-oauth-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575792 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-service-ca\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.575967 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-console-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.576042 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.575967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cfd7f24-f83d-4209-9632-61e30d075e58-trusted-ca-bundle\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.577545 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.577526 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-oauth-config\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.577642 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.577571 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cfd7f24-f83d-4209-9632-61e30d075e58-console-serving-cert\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.582384 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.582360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvtn\" (UniqueName: \"kubernetes.io/projected/2cfd7f24-f83d-4209-9632-61e30d075e58-kube-api-access-ctvtn\") pod \"console-7564f966fc-g4jmf\" (UID: \"2cfd7f24-f83d-4209-9632-61e30d075e58\") " pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.607517 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.607489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.657027 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.657004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:29:59.712034 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.711999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:29:59.854584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:29:59.854561 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7564f966fc-g4jmf"] Jun 06 20:29:59.856746 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:29:59.856697 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfd7f24_f83d_4209_9632_61e30d075e58.slice/crio-50485f975c94ee4099f1d61b08496962b39c7346618fbccba957062b7dd72186 WatchSource:0}: Error finding container 50485f975c94ee4099f1d61b08496962b39c7346618fbccba957062b7dd72186: Status 404 returned error can't find the container with id 50485f975c94ee4099f1d61b08496962b39c7346618fbccba957062b7dd72186 Jun 06 20:30:00.191137 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:00.191100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:00.293858 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:00.293829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:00.337157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:00.336630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f966fc-g4jmf" event={"ID":"2cfd7f24-f83d-4209-9632-61e30d075e58","Type":"ContainerStarted","Data":"c3fb9696443dfaf79b153e1811c095b2784b3c54c9b6029938c71d96f504b8ac"} Jun 06 20:30:00.337157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:00.336688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7564f966fc-g4jmf" event={"ID":"2cfd7f24-f83d-4209-9632-61e30d075e58","Type":"ContainerStarted","Data":"50485f975c94ee4099f1d61b08496962b39c7346618fbccba957062b7dd72186"} Jun 06 20:30:00.354719 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:00.354659 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7564f966fc-g4jmf" podStartSLOduration=1.35464379 podStartE2EDuration="1.35464379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:00.352155024 +0000 UTC m=+624.163499603" watchObservedRunningTime="2026-06-06 20:30:00.35464379 +0000 UTC m=+624.165988373" Jun 06 20:30:01.434981 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:01.434945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:01.481237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:01.481201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:03.584185 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:03.584154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:09.712885 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:09.712844 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:30:09.713378 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:09.712936 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:30:09.717690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:09.717666 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:30:10.396069 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:10.396043 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7564f966fc-g4jmf" Jun 06 20:30:10.442042 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:10.442009 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:30:10.538890 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:10.538848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:10.640073 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:10.640027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:10.688066 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:10.687990 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:14.002687 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.002654 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5"] Jun 06 20:30:14.017319 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.017287 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5"] Jun 06 20:30:14.017504 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.017379 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.019896 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.019874 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 20:30:14.020036 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.019910 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zldnj\"" Jun 06 20:30:14.020770 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.020748 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 20:30:14.118131 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.118090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.118311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.118141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.118311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.118179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wfp\" (UniqueName: \"kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.218872 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.218830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.219050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.218885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.219050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.218931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wfp\" (UniqueName: \"kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.219339 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.219315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.219383 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.219327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.227208 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.227185 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wfp\" (UniqueName: \"kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.329179 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.329153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:14.465231 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.465204 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5"] Jun 06 20:30:14.466490 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:14.466454 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf22cc06_d81a_4a6b_9d97_ef63f86d1330.slice/crio-169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd WatchSource:0}: Error finding container 169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd: Status 404 returned error can't find the container with id 169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd Jun 06 20:30:14.600558 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.600491 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg"] Jun 06 20:30:14.604328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.604313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.611210 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.611183 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg"] Jun 06 20:30:14.725285 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.725252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.725463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.725301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfrd\" (UniqueName: \"kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.725463 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.725425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.826319 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.826287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.826495 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.826343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfrd\" (UniqueName: \"kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.826495 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.826402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.826751 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.826732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.826797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.826748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.834692 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.834657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfrd\" (UniqueName: \"kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:14.935223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:14.935139 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:15.069886 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.069861 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg"] Jun 06 20:30:15.071165 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:15.071138 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a4d3b0_77a7_470d_a7bb_8d4d53b6815b.slice/crio-611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8 WatchSource:0}: Error finding container 611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8: Status 404 returned error can't find the container with id 611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8 Jun 06 20:30:15.199165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.199092 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s"] Jun 06 20:30:15.202851 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.202833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.209525 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.209488 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s"] Jun 06 20:30:15.330395 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.330359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.330589 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.330421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttmx\" (UniqueName: \"kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.330589 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.330506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.423795 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.423758 2575 generic.go:356] "Generic (PLEG): container finished" podID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerID="86dca25f06dd4545cc38f9e7ec8616ab4866c7250bda425461dd25ffb76e7d52" exitCode=0 Jun 06 20:30:15.423979 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.423835 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" event={"ID":"bf22cc06-d81a-4a6b-9d97-ef63f86d1330","Type":"ContainerDied","Data":"86dca25f06dd4545cc38f9e7ec8616ab4866c7250bda425461dd25ffb76e7d52"} Jun 06 20:30:15.423979 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.423887 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" event={"ID":"bf22cc06-d81a-4a6b-9d97-ef63f86d1330","Type":"ContainerStarted","Data":"169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd"} Jun 06 20:30:15.424452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.424435 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:30:15.425544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.425514 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerID="28378469106f5fb2747926d1729051fcfcfe7ec1ceb331833582c7197dfc85a8" exitCode=0 Jun 06 20:30:15.425640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.425552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" event={"ID":"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b","Type":"ContainerDied","Data":"28378469106f5fb2747926d1729051fcfcfe7ec1ceb331833582c7197dfc85a8"} Jun 06 20:30:15.425640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.425587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" event={"ID":"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b","Type":"ContainerStarted","Data":"611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8"} Jun 06 20:30:15.431679 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.431659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttmx\" (UniqueName: \"kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.431842 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.431694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.431842 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.431787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.432131 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.432109 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.432235 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.432131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.439170 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.439148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttmx\" (UniqueName: \"kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.545950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.545872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:15.603251 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.603219 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl"] Jun 06 20:30:15.609535 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.609512 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.614239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.614104 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl"] Jun 06 20:30:15.686666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.686635 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s"] Jun 06 20:30:15.688247 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:15.688214 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc103499_dddd_4d2e_a530_7533d976da7c.slice/crio-720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03 WatchSource:0}: Error finding container 720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03: Status 404 returned error can't find the container with id 720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03 Jun 06 20:30:15.735802 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.735773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf5wf\" (UniqueName: \"kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.735957 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.735937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.736006 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.735985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.837170 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.837138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.837319 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.837181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.837319 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.837236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf5wf\" (UniqueName: \"kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.837523 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.837503 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.837586 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.837517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.844854 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.844835 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf5wf\" (UniqueName: \"kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:15.922960 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:15.922925 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:16.082939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.082906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl"] Jun 06 20:30:16.083874 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:16.083844 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3241a23e_4bf2_4cd0_a9ef_10891c9e11c8.slice/crio-66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6 WatchSource:0}: Error finding container 66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6: Status 404 returned error can't find the container with id 66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6 Jun 06 20:30:16.434096 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.434065 2575 generic.go:356] "Generic (PLEG): container finished" podID="fc103499-dddd-4d2e-a530-7533d976da7c" containerID="a84569619a87bb70f4ff17a5ec369f7dfe1404490240c8b3466fc678f55f463f" exitCode=0 Jun 06 20:30:16.434207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.434142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" event={"ID":"fc103499-dddd-4d2e-a530-7533d976da7c","Type":"ContainerDied","Data":"a84569619a87bb70f4ff17a5ec369f7dfe1404490240c8b3466fc678f55f463f"} Jun 06 20:30:16.434207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.434195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" event={"ID":"fc103499-dddd-4d2e-a530-7533d976da7c","Type":"ContainerStarted","Data":"720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03"} Jun 06 20:30:16.436484 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.436459 2575 generic.go:356] "Generic (PLEG): container finished" podID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerID="661f5c6cfb7afd2ebca053c832c3b1a124a6f07d6592371435864fc724ac63c7" exitCode=0 Jun 06 20:30:16.436611 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.436551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" event={"ID":"bf22cc06-d81a-4a6b-9d97-ef63f86d1330","Type":"ContainerDied","Data":"661f5c6cfb7afd2ebca053c832c3b1a124a6f07d6592371435864fc724ac63c7"} Jun 06 20:30:16.438227 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.438201 2575 generic.go:356] "Generic (PLEG): container finished" podID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerID="2efe22adb42e2f0180d182ed0eb4bed24495402f330b2ccca866ff3379466df5" exitCode=0 Jun 06 20:30:16.438352 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.438305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" event={"ID":"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8","Type":"ContainerDied","Data":"2efe22adb42e2f0180d182ed0eb4bed24495402f330b2ccca866ff3379466df5"} Jun 06 20:30:16.438412 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:16.438352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" event={"ID":"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8","Type":"ContainerStarted","Data":"66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6"} Jun 06 20:30:17.446050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.446018 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerID="ba243b3d26d9c350bf6619991b6198c54ae46e74f2ed3683cea0fbd5e288e565" exitCode=0 Jun 06 20:30:17.446479 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.446098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" event={"ID":"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b","Type":"ContainerDied","Data":"ba243b3d26d9c350bf6619991b6198c54ae46e74f2ed3683cea0fbd5e288e565"} Jun 06 20:30:17.448428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.448406 2575 generic.go:356] "Generic (PLEG): container finished" podID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerID="21eefde0f3a12c05ab461d1cd71c96e8c5dda4cf0a613e8408de2010d992df88" exitCode=0 Jun 06 20:30:17.448515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.448488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" event={"ID":"bf22cc06-d81a-4a6b-9d97-ef63f86d1330","Type":"ContainerDied","Data":"21eefde0f3a12c05ab461d1cd71c96e8c5dda4cf0a613e8408de2010d992df88"} Jun 06 20:30:17.450219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.450199 2575 generic.go:356] "Generic (PLEG): container finished" podID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerID="664ed5f31a5e290e0692433ce18fce6caba9477a17d9dee73887b14ce5032c73" exitCode=0 Jun 06 20:30:17.450319 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.450277 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" event={"ID":"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8","Type":"ContainerDied","Data":"664ed5f31a5e290e0692433ce18fce6caba9477a17d9dee73887b14ce5032c73"} Jun 06 20:30:17.452233 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.452213 2575 generic.go:356] "Generic (PLEG): container finished" podID="fc103499-dddd-4d2e-a530-7533d976da7c" containerID="a187c279a7c5a41c64794d421d02d2d4d7bf0657c99bb5a52130bb7ee63e6264" exitCode=0 Jun 06 20:30:17.452318 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:17.452257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" event={"ID":"fc103499-dddd-4d2e-a530-7533d976da7c","Type":"ContainerDied","Data":"a187c279a7c5a41c64794d421d02d2d4d7bf0657c99bb5a52130bb7ee63e6264"} Jun 06 20:30:18.460069 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.460037 2575 generic.go:356] "Generic (PLEG): container finished" podID="fc103499-dddd-4d2e-a530-7533d976da7c" containerID="5c81b0253c7f840938b5e19e8f61bd73e095ecd965b811c7a2f27571ec5959b3" exitCode=0 Jun 06 20:30:18.460423 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.460121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" event={"ID":"fc103499-dddd-4d2e-a530-7533d976da7c","Type":"ContainerDied","Data":"5c81b0253c7f840938b5e19e8f61bd73e095ecd965b811c7a2f27571ec5959b3"} Jun 06 20:30:18.462165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.462145 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerID="2cb03429e7ce0d557613038e594fa76e1081f81762acbd52744e97b896ec8bdf" exitCode=0 Jun 06 20:30:18.462297 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.462224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" event={"ID":"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b","Type":"ContainerDied","Data":"2cb03429e7ce0d557613038e594fa76e1081f81762acbd52744e97b896ec8bdf"} Jun 06 20:30:18.471759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.471737 2575 generic.go:356] "Generic (PLEG): container finished" podID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerID="71a7e6058574826f874f4051b14c762bbea2c8e0dea1957c587002373848a873" exitCode=0 Jun 06 20:30:18.471858 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.471819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" event={"ID":"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8","Type":"ContainerDied","Data":"71a7e6058574826f874f4051b14c762bbea2c8e0dea1957c587002373848a873"} Jun 06 20:30:18.609889 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.609861 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:18.772428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.772394 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle\") pod \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " Jun 06 20:30:18.772594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.772464 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2wfp\" (UniqueName: \"kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp\") pod \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " Jun 06 20:30:18.772594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.772507 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util\") pod \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\" (UID: \"bf22cc06-d81a-4a6b-9d97-ef63f86d1330\") " Jun 06 20:30:18.773089 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.773064 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle" (OuterVolumeSpecName: "bundle") pod "bf22cc06-d81a-4a6b-9d97-ef63f86d1330" (UID: "bf22cc06-d81a-4a6b-9d97-ef63f86d1330"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:18.774741 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.774718 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp" (OuterVolumeSpecName: "kube-api-access-k2wfp") pod "bf22cc06-d81a-4a6b-9d97-ef63f86d1330" (UID: "bf22cc06-d81a-4a6b-9d97-ef63f86d1330"). InnerVolumeSpecName "kube-api-access-k2wfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:18.777889 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.777835 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util" (OuterVolumeSpecName: "util") pod "bf22cc06-d81a-4a6b-9d97-ef63f86d1330" (UID: "bf22cc06-d81a-4a6b-9d97-ef63f86d1330"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:18.873562 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.873509 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2wfp\" (UniqueName: \"kubernetes.io/projected/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-kube-api-access-k2wfp\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:18.873562 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.873555 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:18.873562 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:18.873570 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf22cc06-d81a-4a6b-9d97-ef63f86d1330-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.479889 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.479855 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" Jun 06 20:30:19.480334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.479882 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5" event={"ID":"bf22cc06-d81a-4a6b-9d97-ef63f86d1330","Type":"ContainerDied","Data":"169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd"} Jun 06 20:30:19.480334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.479940 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="169d046f586cc0f8f11db7313ec5b21cb69207bc9490bf54d3e364534922a2cd" Jun 06 20:30:19.650080 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.650054 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:19.705679 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.705658 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:19.708787 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.708764 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:19.780469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780391 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle\") pod \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " Jun 06 20:30:19.780469 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780454 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf5wf\" (UniqueName: \"kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf\") pod \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " Jun 06 20:30:19.780671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780486 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle\") pod \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " Jun 06 20:30:19.780671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780507 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util\") pod \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " Jun 06 20:30:19.780671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780539 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdfrd\" (UniqueName: \"kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd\") pod \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\" (UID: \"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b\") " Jun 06 20:30:19.780671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.780632 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util\") pod \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\" (UID: \"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8\") " Jun 06 20:30:19.781447 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.781086 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle" (OuterVolumeSpecName: "bundle") pod "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" (UID: "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.781447 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.781275 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle" (OuterVolumeSpecName: "bundle") pod "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" (UID: "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.783002 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.782975 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf" (OuterVolumeSpecName: "kube-api-access-mf5wf") pod "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" (UID: "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8"). InnerVolumeSpecName "kube-api-access-mf5wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:19.783103 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.783007 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd" (OuterVolumeSpecName: "kube-api-access-rdfrd") pod "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" (UID: "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b"). InnerVolumeSpecName "kube-api-access-rdfrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:19.786415 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.786382 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util" (OuterVolumeSpecName: "util") pod "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" (UID: "b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.786662 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.786642 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util" (OuterVolumeSpecName: "util") pod "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" (UID: "3241a23e-4bf2-4cd0-a9ef-10891c9e11c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.882047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882011 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jttmx\" (UniqueName: \"kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx\") pod \"fc103499-dddd-4d2e-a530-7533d976da7c\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " Jun 06 20:30:19.882241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882154 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle\") pod \"fc103499-dddd-4d2e-a530-7533d976da7c\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " Jun 06 20:30:19.882241 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882182 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util\") pod \"fc103499-dddd-4d2e-a530-7533d976da7c\" (UID: \"fc103499-dddd-4d2e-a530-7533d976da7c\") " Jun 06 20:30:19.882433 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882418 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882439 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882452 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf5wf\" (UniqueName: \"kubernetes.io/projected/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-kube-api-access-mf5wf\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882468 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3241a23e-4bf2-4cd0-a9ef-10891c9e11c8-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882500 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882480 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882654 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882510 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdfrd\" (UniqueName: \"kubernetes.io/projected/b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b-kube-api-access-rdfrd\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.882654 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.882606 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle" (OuterVolumeSpecName: "bundle") pod "fc103499-dddd-4d2e-a530-7533d976da7c" (UID: "fc103499-dddd-4d2e-a530-7533d976da7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.884114 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.884093 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx" (OuterVolumeSpecName: "kube-api-access-jttmx") pod "fc103499-dddd-4d2e-a530-7533d976da7c" (UID: "fc103499-dddd-4d2e-a530-7533d976da7c"). InnerVolumeSpecName "kube-api-access-jttmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:19.887632 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.887593 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util" (OuterVolumeSpecName: "util") pod "fc103499-dddd-4d2e-a530-7533d976da7c" (UID: "fc103499-dddd-4d2e-a530-7533d976da7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:19.983277 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.983240 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.983277 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.983271 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc103499-dddd-4d2e-a530-7533d976da7c-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:19.983277 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:19.983281 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jttmx\" (UniqueName: \"kubernetes.io/projected/fc103499-dddd-4d2e-a530-7533d976da7c-kube-api-access-jttmx\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:20.488059 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.488028 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" Jun 06 20:30:20.488550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.488036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s" event={"ID":"fc103499-dddd-4d2e-a530-7533d976da7c","Type":"ContainerDied","Data":"720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03"} Jun 06 20:30:20.488550 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.488153 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="720b835861314769b88a50e3575c81a3e9c920bc9fad46b3a4ead25194a21a03" Jun 06 20:30:20.489960 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.489938 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" Jun 06 20:30:20.489960 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.489945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg" event={"ID":"b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b","Type":"ContainerDied","Data":"611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8"} Jun 06 20:30:20.490152 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.489981 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="611a887285f4d3720f1d20b4c5b633f31b335f295ac4e94a2acd24ac16511cf8" Jun 06 20:30:20.491869 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.491847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" event={"ID":"3241a23e-4bf2-4cd0-a9ef-10891c9e11c8","Type":"ContainerDied","Data":"66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6"} Jun 06 20:30:20.491869 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.491863 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl" Jun 06 20:30:20.492031 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:20.491886 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66ea35312127d558e51edac219d6b9f2a95596d1d8804c5cb901aef71e7fd4e6" Jun 06 20:30:21.441810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:21.441777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:21.855019 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:21.854985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:23.085832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:23.085793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:23.198541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:23.198492 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:26.252931 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:26.252896 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:29.248812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:29.248768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:31.317081 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:31.317023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:32.710385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.710352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:32.751022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.750992 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv"] Jun 06 20:30:32.751428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751414 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="util" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751429 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="util" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751439 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="pull" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751444 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="pull" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751451 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="extract" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751456 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="extract" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751465 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="extract" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751472 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="extract" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751483 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="pull" Jun 06 20:30:32.751489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751491 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="pull" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751508 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751515 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751523 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751528 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751534 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="pull" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751539 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="pull" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751547 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="pull" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751552 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="pull" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751560 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751565 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751575 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751581 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751593 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751597 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="util" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751662 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf22cc06-d81a-4a6b-9d97-ef63f86d1330" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751671 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc103499-dddd-4d2e-a530-7533d976da7c" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751680 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3241a23e-4bf2-4cd0-a9ef-10891c9e11c8" containerName="extract" Jun 06 20:30:32.751812 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.751685 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b" containerName="extract" Jun 06 20:30:32.755163 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.755144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.757737 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.757700 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 20:30:32.757857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.757804 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cc89s\"" Jun 06 20:30:32.758025 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.757997 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 20:30:32.767782 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.767760 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv"] Jun 06 20:30:32.807076 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.807050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdhl\" (UniqueName: \"kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.807183 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.807106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.908275 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.908237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdhl\" (UniqueName: \"kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.908432 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.908304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.908622 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.908607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:32.917761 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:32.917737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdhl\" (UniqueName: \"kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:33.066038 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:33.066003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:33.214799 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:33.214777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv"] Jun 06 20:30:33.217392 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:33.217352 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0e7a3d_6db0_4af7_87c2_3429c90b467a.slice/crio-e83422e337c999439274abb60244d1a2c6dc08ecb8bb23a5a0e34e25e3045ff6 WatchSource:0}: Error finding container e83422e337c999439274abb60244d1a2c6dc08ecb8bb23a5a0e34e25e3045ff6: Status 404 returned error can't find the container with id e83422e337c999439274abb60244d1a2c6dc08ecb8bb23a5a0e34e25e3045ff6 Jun 06 20:30:33.579016 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:33.578979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" event={"ID":"6b0e7a3d-6db0-4af7-87c2-3429c90b467a","Type":"ContainerStarted","Data":"e83422e337c999439274abb60244d1a2c6dc08ecb8bb23a5a0e34e25e3045ff6"} Jun 06 20:30:33.669536 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:33.669506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:35.466098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.466053 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74f78db9cd-sxx5g" podUID="745ed170-9537-4144-8bdc-785013c1d205" containerName="console" containerID="cri-o://1aa84883dd3936e13e2db303619acc491c13b75f8b345227bffd63ec251ccb16" gracePeriod=15 Jun 06 20:30:35.507279 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.507249 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:35.593000 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.592948 2575 generic.go:356] "Generic (PLEG): container finished" podID="745ed170-9537-4144-8bdc-785013c1d205" containerID="1aa84883dd3936e13e2db303619acc491c13b75f8b345227bffd63ec251ccb16" exitCode=0 Jun 06 20:30:35.593193 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.592997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f78db9cd-sxx5g" event={"ID":"745ed170-9537-4144-8bdc-785013c1d205","Type":"ContainerDied","Data":"1aa84883dd3936e13e2db303619acc491c13b75f8b345227bffd63ec251ccb16"} Jun 06 20:30:35.735907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.735824 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:30:35.842602 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842570 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.842790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842615 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmtct\" (UniqueName: \"kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.842790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842636 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.842790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842658 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.842790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842727 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.842790 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842770 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.843075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842831 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle\") pod \"745ed170-9537-4144-8bdc-785013c1d205\" (UID: \"745ed170-9537-4144-8bdc-785013c1d205\") " Jun 06 20:30:35.843075 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.842988 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:30:35.843193 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.843171 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca" (OuterVolumeSpecName: "service-ca") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:30:35.843251 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.843231 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config" (OuterVolumeSpecName: "console-config") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:30:35.843292 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.843257 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-oauth-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.843327 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.843313 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:30:35.844863 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.844845 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:30:35.845277 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.845255 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct" (OuterVolumeSpecName: "kube-api-access-hmtct") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "kube-api-access-hmtct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:35.845277 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.845253 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "745ed170-9537-4144-8bdc-785013c1d205" (UID: "745ed170-9537-4144-8bdc-785013c1d205"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:30:35.944254 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944225 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmtct\" (UniqueName: \"kubernetes.io/projected/745ed170-9537-4144-8bdc-785013c1d205-kube-api-access-hmtct\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.944254 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944251 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-service-ca\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.944254 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944261 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-serving-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.944453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944269 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-console-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.944453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944277 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/745ed170-9537-4144-8bdc-785013c1d205-console-oauth-config\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:35.944453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:35.944285 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/745ed170-9537-4144-8bdc-785013c1d205-trusted-ca-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:36.603907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.603864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f78db9cd-sxx5g" event={"ID":"745ed170-9537-4144-8bdc-785013c1d205","Type":"ContainerDied","Data":"8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66"} Jun 06 20:30:36.604326 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.603932 2575 scope.go:117] "RemoveContainer" containerID="1aa84883dd3936e13e2db303619acc491c13b75f8b345227bffd63ec251ccb16" Jun 06 20:30:36.604326 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.603880 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f78db9cd-sxx5g" Jun 06 20:30:36.630476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.630446 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:30:36.636145 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.636119 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f78db9cd-sxx5g"] Jun 06 20:30:36.653784 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:36.653759 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="745ed170-9537-4144-8bdc-785013c1d205" path="/var/lib/kubelet/pods/745ed170-9537-4144-8bdc-785013c1d205/volumes" Jun 06 20:30:37.052611 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:37.052573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:37.105863 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:37.105821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:37.456486 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:37.456410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:37.513113 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:37.513083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:38.545679 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:38.545640 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:30:38.619334 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:38.619297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" event={"ID":"6b0e7a3d-6db0-4af7-87c2-3429c90b467a","Type":"ContainerStarted","Data":"79c6bab33fbee2299644131d7a63e8b0e3f6882fe1feda51f7e57b7512a2a28a"} Jun 06 20:30:38.619512 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:38.619391 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:38.653837 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:38.653789 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" podStartSLOduration=2.087023176 podStartE2EDuration="6.653771899s" totalImagesPullingTime="4.566748723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:38.650518663 +0000 UTC m=+662.461863247" watchObservedRunningTime="2026-06-06 20:30:38.653771899 +0000 UTC m=+662.465116481" Jun 06 20:30:40.045929 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:40.045889 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache]" Jun 06 20:30:40.046549 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:40.046519 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:30:40.616410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:40.616381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:40.809860 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:40.809825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:41.067606 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:41.067578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:41.172390 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:41.172350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:44.467515 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:44.467478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:44.528152 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:44.528122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:45.688087 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:45.688053 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:30:48.556601 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:48.556564 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache]" Jun 06 20:30:49.627817 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:49.627787 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:50.269902 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:50.269866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:50.386337 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:50.386301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:51.082672 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.082633 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7"] Jun 06 20:30:51.083263 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.083245 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745ed170-9537-4144-8bdc-785013c1d205" containerName="console" Jun 06 20:30:51.083352 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.083266 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="745ed170-9537-4144-8bdc-785013c1d205" containerName="console" Jun 06 20:30:51.083417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.083394 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="745ed170-9537-4144-8bdc-785013c1d205" containerName="console" Jun 06 20:30:51.088170 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.088150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.102581 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.102560 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7"] Jun 06 20:30:51.138821 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.138797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:51.192635 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.192603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckrg\" (UniqueName: \"kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.192810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.192660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.242214 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.242181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:51.293784 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.293757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.293914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.293853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckrg\" (UniqueName: \"kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.294157 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.294138 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.302227 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.302210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckrg\" (UniqueName: \"kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg\") pod \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.398666 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.398583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.492851 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.492814 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7"] Jun 06 20:30:51.498063 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.498029 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7"] Jun 06 20:30:51.518671 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.518642 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:30:51.524422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.524396 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.525205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.525177 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv"] Jun 06 20:30:51.525345 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.525325 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" containerName="manager" containerID="cri-o://79c6bab33fbee2299644131d7a63e8b0e3f6882fe1feda51f7e57b7512a2a28a" gracePeriod=2 Jun 06 20:30:51.541661 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.541622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:30:51.549317 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.549281 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv"] Jun 06 20:30:51.570573 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.570534 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:51.597011 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.596957 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nrf\" (UniqueName: \"kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.597153 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.597106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.670572 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.670530 2575 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 06 20:30:51.670572 ip-10-0-131-207 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xcdt7_kuadrant-system_1cb5c273-387e-4ab0-8c6f-e0db9689ab19_0(e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xcdt7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42" Netns:"/var/run/netns/a2bc3433-fa90-4f24-80c9-d87634438295" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-xcdt7;K8S_POD_INFRA_CONTAINER_ID=e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42;K8S_POD_UID=1cb5c273-387e-4ab0-8c6f-e0db9689ab19" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7/1cb5c273-387e-4ab0-8c6f-e0db9689ab19:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7 e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7 e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:34 [10.133.0.52/23] Jun 06 20:30:51.670572 ip-10-0-131-207 kubenswrapper[2575]: ' Jun 06 20:30:51.670572 ip-10-0-131-207 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 06 20:30:51.670572 ip-10-0-131-207 kubenswrapper[2575]: > Jun 06 20:30:51.670805 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.670609 2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 06 20:30:51.670805 ip-10-0-131-207 kubenswrapper[2575]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xcdt7_kuadrant-system_1cb5c273-387e-4ab0-8c6f-e0db9689ab19_0(e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xcdt7 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42" Netns:"/var/run/netns/a2bc3433-fa90-4f24-80c9-d87634438295" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-xcdt7;K8S_POD_INFRA_CONTAINER_ID=e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42;K8S_POD_UID=1cb5c273-387e-4ab0-8c6f-e0db9689ab19" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7/1cb5c273-387e-4ab0-8c6f-e0db9689ab19:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7 e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7 e1b235e0e8b57adce03f5094d1706a0947e048d19c2febb89e8d4ba936aada42 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:34 [10.133.0.52/23] Jun 06 20:30:51.670805 ip-10-0-131-207 kubenswrapper[2575]: ' Jun 06 20:30:51.670805 ip-10-0-131-207 kubenswrapper[2575]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 06 20:30:51.670805 ip-10-0-131-207 kubenswrapper[2575]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.697797 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.697768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.697953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.697899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nrf\" (UniqueName: \"kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.698021 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.698001 2575 generic.go:356] "Generic (PLEG): container finished" podID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" containerID="79c6bab33fbee2299644131d7a63e8b0e3f6882fe1feda51f7e57b7512a2a28a" exitCode=0 Jun 06 20:30:51.698183 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.698161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.698240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.698233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.700287 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.700265 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="1cb5c273-387e-4ab0-8c6f-e0db9689ab19" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.702430 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.702366 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:51.707389 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.707370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.708103 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.708082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nrf\" (UniqueName: \"kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf\") pod \"kuadrant-operator-controller-manager-55467d9f7-sjsg9\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.709304 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.709281 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:51.710941 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.710915 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="1cb5c273-387e-4ab0-8c6f-e0db9689ab19" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.771608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.771589 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:51.773610 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.773588 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="1cb5c273-387e-4ab0-8c6f-e0db9689ab19" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:51.775257 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:51.775238 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9fcdv\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:51.798585 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.798559 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume\") pod \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " Jun 06 20:30:51.798673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.798596 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckrg\" (UniqueName: \"kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg\") pod \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\" (UID: \"1cb5c273-387e-4ab0-8c6f-e0db9689ab19\") " Jun 06 20:30:51.798818 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.798800 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1cb5c273-387e-4ab0-8c6f-e0db9689ab19" (UID: "1cb5c273-387e-4ab0-8c6f-e0db9689ab19"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:51.798897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.798882 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-extensions-socket-volume\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:51.800506 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.800481 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg" (OuterVolumeSpecName: "kube-api-access-8ckrg") pod "1cb5c273-387e-4ab0-8c6f-e0db9689ab19" (UID: "1cb5c273-387e-4ab0-8c6f-e0db9689ab19"). InnerVolumeSpecName "kube-api-access-8ckrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:51.841337 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.841304 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:51.899736 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.899683 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjdhl\" (UniqueName: \"kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl\") pod \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " Jun 06 20:30:51.899866 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.899803 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume\") pod \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\" (UID: \"6b0e7a3d-6db0-4af7-87c2-3429c90b467a\") " Jun 06 20:30:51.900137 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.900108 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckrg\" (UniqueName: \"kubernetes.io/projected/1cb5c273-387e-4ab0-8c6f-e0db9689ab19-kube-api-access-8ckrg\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:51.900394 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.900346 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b0e7a3d-6db0-4af7-87c2-3429c90b467a" (UID: "6b0e7a3d-6db0-4af7-87c2-3429c90b467a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:51.901868 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.901837 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl" (OuterVolumeSpecName: "kube-api-access-mjdhl") pod "6b0e7a3d-6db0-4af7-87c2-3429c90b467a" (UID: "6b0e7a3d-6db0-4af7-87c2-3429c90b467a"). InnerVolumeSpecName "kube-api-access-mjdhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:51.992067 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:51.992014 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:30:51.994474 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:30:51.994446 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24eb154_4267_4c09_9d96_59c29cde82c8.slice/crio-84e92abbef8dc55399612fb0cb8a2f98c62fab387475297443a91d6a27765c2b WatchSource:0}: Error finding container 84e92abbef8dc55399612fb0cb8a2f98c62fab387475297443a91d6a27765c2b: Status 404 returned error can't find the container with id 84e92abbef8dc55399612fb0cb8a2f98c62fab387475297443a91d6a27765c2b Jun 06 20:30:52.000972 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.000949 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjdhl\" (UniqueName: \"kubernetes.io/projected/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-kube-api-access-mjdhl\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:52.001055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.000974 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0e7a3d-6db0-4af7-87c2-3429c90b467a-extensions-socket-volume\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:30:52.651244 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.651164 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb5c273-387e-4ab0-8c6f-e0db9689ab19" path="/var/lib/kubelet/pods/1cb5c273-387e-4ab0-8c6f-e0db9689ab19/volumes" Jun 06 20:30:52.651603 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.651452 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" path="/var/lib/kubelet/pods/6b0e7a3d-6db0-4af7-87c2-3429c90b467a/volumes" Jun 06 20:30:52.705338 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.705314 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9fcdv" Jun 06 20:30:52.705461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.705337 2575 scope.go:117] "RemoveContainer" containerID="79c6bab33fbee2299644131d7a63e8b0e3f6882fe1feda51f7e57b7512a2a28a" Jun 06 20:30:52.707161 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.707134 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" event={"ID":"b24eb154-4267-4c09-9d96-59c29cde82c8","Type":"ContainerStarted","Data":"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94"} Jun 06 20:30:52.707318 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.707194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" event={"ID":"b24eb154-4267-4c09-9d96-59c29cde82c8","Type":"ContainerStarted","Data":"84e92abbef8dc55399612fb0cb8a2f98c62fab387475297443a91d6a27765c2b"} Jun 06 20:30:52.707410 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.707396 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:30:52.707488 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.707459 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:52.733257 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:52.733205 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" podStartSLOduration=1.733186159 podStartE2EDuration="1.733186159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:52.73292907 +0000 UTC m=+676.544273654" watchObservedRunningTime="2026-06-06 20:30:52.733186159 +0000 UTC m=+676.544530743" Jun 06 20:30:52.735128 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:52.735101 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xcdt7\" is forbidden: User \"system:node:ip-10-0-131-207.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-207.ec2.internal' and this object" podUID="1cb5c273-387e-4ab0-8c6f-e0db9689ab19" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xcdt7" Jun 06 20:30:55.915225 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:55.915186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:56.015344 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:56.015312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:56.519037 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:56.519008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:56.577920 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:30:56.577889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:30:58.607753 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:30:58.607694 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:00.317690 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:00.317653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:00.420549 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:00.420516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:00.644883 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:00.644783 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:03.525673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:03.525642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:03.623322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:03.623290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:03.723752 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:03.723688 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:31:04.062246 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.062210 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:31:04.062827 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.062761 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" containerName="manager" Jun 06 20:31:04.062827 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.062783 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" containerName="manager" Jun 06 20:31:04.063018 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.062886 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b0e7a3d-6db0-4af7-87c2-3429c90b467a" containerName="manager" Jun 06 20:31:04.071174 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.071159 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.085967 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.085940 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:31:04.116313 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.116056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9smjv\" (UniqueName: \"kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.116507 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.116341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.217211 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.217176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9smjv\" (UniqueName: \"kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.217211 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.217217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.217569 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.217553 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.227628 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.227596 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9smjv\" (UniqueName: \"kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv\") pod \"kuadrant-operator-controller-manager-86878c769f-zpwtz\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.382803 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.382774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.525454 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.525430 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:31:04.528058 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:31:04.528027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbc1205_c971_48f3_9e2a_c9c181db9c88.slice/crio-04bef488707f10c1bf1b4f45888958d01536de5d9ede293c75159ea342281be6 WatchSource:0}: Error finding container 04bef488707f10c1bf1b4f45888958d01536de5d9ede293c75159ea342281be6: Status 404 returned error can't find the container with id 04bef488707f10c1bf1b4f45888958d01536de5d9ede293c75159ea342281be6 Jun 06 20:31:04.792744 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.792622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" event={"ID":"2dbc1205-c971-48f3-9e2a-c9c181db9c88","Type":"ContainerStarted","Data":"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5"} Jun 06 20:31:04.792905 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.792826 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:04.792905 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.792861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" event={"ID":"2dbc1205-c971-48f3-9e2a-c9c181db9c88","Type":"ContainerStarted","Data":"04bef488707f10c1bf1b4f45888958d01536de5d9ede293c75159ea342281be6"} Jun 06 20:31:04.812181 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:04.812132 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" podStartSLOduration=0.812118737 podStartE2EDuration="812.118737ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:31:04.809840625 +0000 UTC m=+688.621185316" watchObservedRunningTime="2026-06-06 20:31:04.812118737 +0000 UTC m=+688.623463320" Jun 06 20:31:08.660415 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:08.660382 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:09.200841 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:09.200809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:09.296779 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:09.296736 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:15.682154 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:15.682114 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:15.802328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:15.802298 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:31:15.858827 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:15.858796 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:31:15.859030 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:15.859006 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" podUID="b24eb154-4267-4c09-9d96-59c29cde82c8" containerName="manager" containerID="cri-o://7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94" gracePeriod=10 Jun 06 20:31:16.114387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.114363 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:31:16.217217 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.217186 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume\") pod \"b24eb154-4267-4c09-9d96-59c29cde82c8\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " Jun 06 20:31:16.217407 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.217229 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9nrf\" (UniqueName: \"kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf\") pod \"b24eb154-4267-4c09-9d96-59c29cde82c8\" (UID: \"b24eb154-4267-4c09-9d96-59c29cde82c8\") " Jun 06 20:31:16.217558 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.217535 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b24eb154-4267-4c09-9d96-59c29cde82c8" (UID: "b24eb154-4267-4c09-9d96-59c29cde82c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:31:16.219364 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.219341 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf" (OuterVolumeSpecName: "kube-api-access-k9nrf") pod "b24eb154-4267-4c09-9d96-59c29cde82c8" (UID: "b24eb154-4267-4c09-9d96-59c29cde82c8"). InnerVolumeSpecName "kube-api-access-k9nrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:31:16.318791 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.318756 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b24eb154-4267-4c09-9d96-59c29cde82c8-extensions-socket-volume\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:31:16.318791 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.318783 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9nrf\" (UniqueName: \"kubernetes.io/projected/b24eb154-4267-4c09-9d96-59c29cde82c8-kube-api-access-k9nrf\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:31:16.865634 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.865603 2575 generic.go:356] "Generic (PLEG): container finished" podID="b24eb154-4267-4c09-9d96-59c29cde82c8" containerID="7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94" exitCode=0 Jun 06 20:31:16.866108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.865646 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" Jun 06 20:31:16.866108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.865694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" event={"ID":"b24eb154-4267-4c09-9d96-59c29cde82c8","Type":"ContainerDied","Data":"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94"} Jun 06 20:31:16.866108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.865756 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9" event={"ID":"b24eb154-4267-4c09-9d96-59c29cde82c8","Type":"ContainerDied","Data":"84e92abbef8dc55399612fb0cb8a2f98c62fab387475297443a91d6a27765c2b"} Jun 06 20:31:16.866108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.865777 2575 scope.go:117] "RemoveContainer" containerID="7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94" Jun 06 20:31:16.875370 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.875350 2575 scope.go:117] "RemoveContainer" containerID="7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94" Jun 06 20:31:16.875633 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:16.875616 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94\": container with ID starting with 7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94 not found: ID does not exist" containerID="7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94" Jun 06 20:31:16.875676 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.875640 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94"} err="failed to get container status \"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94\": rpc error: code = NotFound desc = could not find container \"7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94\": container with ID starting with 7d84dec5587c58b6ac050de92c06d0fb32dab6442208a43e92fb14a8bc8dbe94 not found: ID does not exist" Jun 06 20:31:16.895917 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.895895 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:31:16.908355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:16.908302 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sjsg9"] Jun 06 20:31:18.651271 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:18.651240 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24eb154-4267-4c09-9d96-59c29cde82c8" path="/var/lib/kubelet/pods/b24eb154-4267-4c09-9d96-59c29cde82c8/volumes" Jun 06 20:31:18.670980 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:18.670950 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:20.087961 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:20.087924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:20.189380 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:20.189345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:23.460767 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:23.460696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:23.560897 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:23.560864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:23.617981 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:23.617945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:28.720765 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:28.720727 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:30.640638 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:30.640597 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745ed170_9537_4144_8bdc_785013c1d205.slice/crio-8dbf9c40ebc93c44214db05f0cc205657c8ea8826f627e023a3630ebe26d6e66\": RecentStats: unable to find data in memory cache]" Jun 06 20:31:33.080472 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.080432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:33.081362 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.081341 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:33.081783 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.081768 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b24eb154-4267-4c09-9d96-59c29cde82c8" containerName="manager" Jun 06 20:31:33.081831 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.081787 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24eb154-4267-4c09-9d96-59c29cde82c8" containerName="manager" Jun 06 20:31:33.081907 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.081898 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b24eb154-4267-4c09-9d96-59c29cde82c8" containerName="manager" Jun 06 20:31:33.084934 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.084919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.087125 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.087096 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 20:31:33.087246 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.087135 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zldnj\"" Jun 06 20:31:33.092484 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.092460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:33.174275 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.174243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7bt\" (UniqueName: \"kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.174434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.174359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.175417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.175389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:33.182227 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.182199 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:33.275147 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.275117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7bt\" (UniqueName: \"kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.275338 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.275174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.275910 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.275888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.276023 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.275926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:33.283158 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.283085 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7bt\" (UniqueName: \"kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt\") pod \"limitador-limitador-64c94fd64f-xlsxf\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.396688 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.396615 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:33.536205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.536182 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:33.537437 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:31:33.537406 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae63424_87ef_49c7_aeb1_5bfcc50e8b9d.slice/crio-68ae0d9c2884a1f3a75c6ba0cca50171ceb1e231ed3d36c0d84c539afeebb3ea WatchSource:0}: Error finding container 68ae0d9c2884a1f3a75c6ba0cca50171ceb1e231ed3d36c0d84c539afeebb3ea: Status 404 returned error can't find the container with id 68ae0d9c2884a1f3a75c6ba0cca50171ceb1e231ed3d36c0d84c539afeebb3ea Jun 06 20:31:33.909402 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.909360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:33.969194 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.969159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" event={"ID":"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d","Type":"ContainerStarted","Data":"68ae0d9c2884a1f3a75c6ba0cca50171ceb1e231ed3d36c0d84c539afeebb3ea"} Jun 06 20:31:33.988193 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:33.988163 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:36.642015 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:36.641976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:36.992510 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:36.992420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" event={"ID":"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d","Type":"ContainerStarted","Data":"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871"} Jun 06 20:31:36.992679 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:36.992548 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:37.010475 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:37.010426 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" podStartSLOduration=1.390297058 podStartE2EDuration="4.010410834s" totalImagesPullingTime="2.620113776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:31:37.008002191 +0000 UTC m=+720.819346775" watchObservedRunningTime="2026-06-06 20:31:37.010410834 +0000 UTC m=+720.821755439" Jun 06 20:31:47.999857 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:47.999824 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:48.343095 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:48.343065 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:48.343355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:48.343308 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" podUID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" containerName="limitador" containerID="cri-o://d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871" gracePeriod=30 Jun 06 20:31:48.903179 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:48.903126 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:49.023527 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.023496 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc7bt\" (UniqueName: \"kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt\") pod \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " Jun 06 20:31:49.023527 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.023530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file\") pod \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\" (UID: \"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d\") " Jun 06 20:31:49.023953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.023934 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file" (OuterVolumeSpecName: "config-file") pod "dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" (UID: "dae63424-87ef-49c7-aeb1-5bfcc50e8b9d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:31:49.025389 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.025364 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt" (OuterVolumeSpecName: "kube-api-access-xc7bt") pod "dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" (UID: "dae63424-87ef-49c7-aeb1-5bfcc50e8b9d"). InnerVolumeSpecName "kube-api-access-xc7bt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:31:49.063173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.063141 2575 generic.go:356] "Generic (PLEG): container finished" podID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" containerID="d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871" exitCode=0 Jun 06 20:31:49.063301 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.063190 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" Jun 06 20:31:49.063301 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.063214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" event={"ID":"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d","Type":"ContainerDied","Data":"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871"} Jun 06 20:31:49.063301 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.063260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xlsxf" event={"ID":"dae63424-87ef-49c7-aeb1-5bfcc50e8b9d","Type":"ContainerDied","Data":"68ae0d9c2884a1f3a75c6ba0cca50171ceb1e231ed3d36c0d84c539afeebb3ea"} Jun 06 20:31:49.063301 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.063282 2575 scope.go:117] "RemoveContainer" containerID="d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871" Jun 06 20:31:49.072472 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.072455 2575 scope.go:117] "RemoveContainer" containerID="d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871" Jun 06 20:31:49.072719 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:31:49.072684 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871\": container with ID starting with d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871 not found: ID does not exist" containerID="d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871" Jun 06 20:31:49.072780 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.072741 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871"} err="failed to get container status \"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871\": rpc error: code = NotFound desc = could not find container \"d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871\": container with ID starting with d5aa729ab69bf1ac8cafc5a049c8aa40239b562a4d6ae425f415c4b5d4116871 not found: ID does not exist" Jun 06 20:31:49.085108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.085083 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:49.090548 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.090529 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xlsxf"] Jun 06 20:31:49.125285 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.125256 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc7bt\" (UniqueName: \"kubernetes.io/projected/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-kube-api-access-xc7bt\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:31:49.125285 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:49.125283 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d-config-file\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:31:50.106772 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.106736 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-jd96w"] Jun 06 20:31:50.107442 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.107425 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" containerName="limitador" Jun 06 20:31:50.107488 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.107446 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" containerName="limitador" Jun 06 20:31:50.107559 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.107548 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" containerName="limitador" Jun 06 20:31:50.112681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.112650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.114993 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.114974 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 06 20:31:50.117827 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.117802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jd96w"] Jun 06 20:31:50.143062 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.143040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:50.236222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.236193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2mf\" (UniqueName: \"kubernetes.io/projected/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-kube-api-access-lc2mf\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.236367 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.236304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-data\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.337055 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.337020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-data\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.337244 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.337084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2mf\" (UniqueName: \"kubernetes.io/projected/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-kube-api-access-lc2mf\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.337400 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.337380 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-data\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.344747 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.344726 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2mf\" (UniqueName: \"kubernetes.io/projected/dab90ae6-6e9e-473f-b8a2-d1063dad0b7c-kube-api-access-lc2mf\") pod \"postgres-69fb4594cf-jd96w\" (UID: \"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c\") " pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.426492 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.426414 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:50.579200 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.579169 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jd96w"] Jun 06 20:31:50.580876 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:31:50.580850 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab90ae6_6e9e_473f_b8a2_d1063dad0b7c.slice/crio-faef9eaf9996b450f4578f8073f9f9bff1208651b3b6ad34a9a07642d0ff9064 WatchSource:0}: Error finding container faef9eaf9996b450f4578f8073f9f9bff1208651b3b6ad34a9a07642d0ff9064: Status 404 returned error can't find the container with id faef9eaf9996b450f4578f8073f9f9bff1208651b3b6ad34a9a07642d0ff9064 Jun 06 20:31:50.651141 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:50.651111 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae63424-87ef-49c7-aeb1-5bfcc50e8b9d" path="/var/lib/kubelet/pods/dae63424-87ef-49c7-aeb1-5bfcc50e8b9d/volumes" Jun 06 20:31:51.077525 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:51.077492 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jd96w" event={"ID":"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c","Type":"ContainerStarted","Data":"faef9eaf9996b450f4578f8073f9f9bff1208651b3b6ad34a9a07642d0ff9064"} Jun 06 20:31:53.091317 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:53.091271 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jd96w" event={"ID":"dab90ae6-6e9e-473f-b8a2-d1063dad0b7c","Type":"ContainerStarted","Data":"e1554e45147760bce35bb48bd28d335bfa9b3cd66bcd94b7d1401138f934f9be"} Jun 06 20:31:53.091725 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:53.091389 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:53.109627 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:53.109576 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-jd96w" podStartSLOduration=0.976132254 podStartE2EDuration="3.109564062s" totalImagesPullingTime="2.133431808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:31:53.107301382 +0000 UTC m=+736.918645968" watchObservedRunningTime="2026-06-06 20:31:53.109564062 +0000 UTC m=+736.920908644" Jun 06 20:31:59.130758 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:59.130695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-jd96w" Jun 06 20:31:59.411250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:59.411166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:59.508653 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:59.508616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:31:59.642668 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:31:59.642631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:00.455914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.455869 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp"] Jun 06 20:32:00.462602 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.462581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.465393 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.465370 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 20:32:00.465503 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.465377 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 20:32:00.466400 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.466379 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77nmt\"" Jun 06 20:32:00.470787 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.470767 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp"] Jun 06 20:32:00.531741 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.531670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltq8q\" (UniqueName: \"kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.531935 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.531786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.531935 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.531825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.633118 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.633081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltq8q\" (UniqueName: \"kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.633314 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.633141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.633314 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.633178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.633557 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.633538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.633610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.633593 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.648899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.648867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltq8q\" (UniqueName: \"kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.772931 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.772841 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:00.916226 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:00.916197 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp"] Jun 06 20:32:00.917406 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:32:00.917378 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c5b8ed_c65a_4d6f_96e7_9fc99b55dbdb.slice/crio-70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d WatchSource:0}: Error finding container 70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d: Status 404 returned error can't find the container with id 70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d Jun 06 20:32:01.142571 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:01.142533 2575 generic.go:356] "Generic (PLEG): container finished" podID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerID="7bdf6c1fdc473cb8ca0b2e5e91a57bc5d4f0929f1fccdf1cec4425894ef7cbde" exitCode=0 Jun 06 20:32:01.142748 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:01.142617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" event={"ID":"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb","Type":"ContainerDied","Data":"7bdf6c1fdc473cb8ca0b2e5e91a57bc5d4f0929f1fccdf1cec4425894ef7cbde"} Jun 06 20:32:01.142748 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:01.142670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" event={"ID":"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb","Type":"ContainerStarted","Data":"70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d"} Jun 06 20:32:02.149981 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:02.149945 2575 generic.go:356] "Generic (PLEG): container finished" podID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerID="9c9e9b58e78e575f2e278e83f8581cfa14448f5c04e1308a67ea2b2f0f551d7b" exitCode=0 Jun 06 20:32:02.150417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:02.150011 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" event={"ID":"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb","Type":"ContainerDied","Data":"9c9e9b58e78e575f2e278e83f8581cfa14448f5c04e1308a67ea2b2f0f551d7b"} Jun 06 20:32:03.158047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:03.158014 2575 generic.go:356] "Generic (PLEG): container finished" podID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerID="0bea8b0af511fb29b9f46ac4285dfa73ffc4c2be67f3155cdd18d65242a5a9f5" exitCode=0 Jun 06 20:32:03.158450 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:03.158053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" event={"ID":"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb","Type":"ContainerDied","Data":"0bea8b0af511fb29b9f46ac4285dfa73ffc4c2be67f3155cdd18d65242a5a9f5"} Jun 06 20:32:04.309292 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.309265 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:04.369604 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.369575 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle\") pod \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " Jun 06 20:32:04.369763 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.369637 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltq8q\" (UniqueName: \"kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q\") pod \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " Jun 06 20:32:04.369763 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.369658 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util\") pod \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\" (UID: \"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb\") " Jun 06 20:32:04.370211 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.370186 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle" (OuterVolumeSpecName: "bundle") pod "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" (UID: "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:32:04.371662 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.371635 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q" (OuterVolumeSpecName: "kube-api-access-ltq8q") pod "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" (UID: "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb"). InnerVolumeSpecName "kube-api-access-ltq8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:32:04.375229 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.375198 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util" (OuterVolumeSpecName: "util") pod "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" (UID: "d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:32:04.470361 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.470283 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-bundle\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:32:04.470361 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.470310 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltq8q\" (UniqueName: \"kubernetes.io/projected/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-kube-api-access-ltq8q\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:32:04.470361 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:04.470321 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb-util\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:32:05.172260 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:05.172232 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" Jun 06 20:32:05.172445 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:05.172225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7486xjhp" event={"ID":"d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb","Type":"ContainerDied","Data":"70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d"} Jun 06 20:32:05.172445 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:05.172359 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70d9ebb5152fd55386b54a3db7033d1a6b6b70b645be5751a04672e1284c2a7d" Jun 06 20:32:22.405020 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:22.404980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:22.508391 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:22.508360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:44.732964 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:44.732929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:44.784481 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:44.784446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:51.864636 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:51.864555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:51.964681 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:51.964637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:57.688271 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.688232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:57.699539 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699497 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:32:57.699944 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699930 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="pull" Jun 06 20:32:57.700007 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699945 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="pull" Jun 06 20:32:57.700007 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699964 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="extract" Jun 06 20:32:57.700007 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699970 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="extract" Jun 06 20:32:57.700007 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699985 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="util" Jun 06 20:32:57.700007 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.699991 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="util" Jun 06 20:32:57.700172 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.700055 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9c5b8ed-c65a-4d6f-96e7-9fc99b55dbdb" containerName="extract" Jun 06 20:32:57.703083 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.703069 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.705904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.705881 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 20:32:57.706022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.705950 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 20:32:57.706022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.705979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wz2lk\"" Jun 06 20:32:57.714653 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.714632 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:32:57.753536 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.753504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx86x\" (UniqueName: \"kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.753695 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.753567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.789150 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.789120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:57.855119 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.855090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx86x\" (UniqueName: \"kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.855296 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.855134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.857621 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.857598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.864114 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.864092 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx86x\" (UniqueName: \"kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x\") pod \"maas-controller-666659f7bb-gjbhh\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:57.877580 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.877558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:57.883205 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.883183 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:32:57.886975 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.886960 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:57.895580 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.895556 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:32:57.935022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.934985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:32:57.956220 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.956153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:57.956332 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:57.956223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kkvw\" (UniqueName: \"kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.015067 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.015043 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:32:58.057810 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.057772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kkvw\" (UniqueName: \"kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.057957 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.057864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.060191 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.060163 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.066882 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.066857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kkvw\" (UniqueName: \"kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw\") pod \"maas-controller-db7bc5d9b-zn9lz\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.151768 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.151738 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:32:58.153208 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:32:58.153188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d62ae4f_4516_4db8_a646_78e53ebf7c34.slice/crio-cb8a9f624600bf098d66ba9a26607e549037ffa5d2994a09e9710b77dcff38c8 WatchSource:0}: Error finding container cb8a9f624600bf098d66ba9a26607e549037ffa5d2994a09e9710b77dcff38c8: Status 404 returned error can't find the container with id cb8a9f624600bf098d66ba9a26607e549037ffa5d2994a09e9710b77dcff38c8 Jun 06 20:32:58.199784 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.199764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:32:58.333687 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.333662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:32:58.335631 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:32:58.335603 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71df3a93_495a_4fce_8671_64ccc84ee957.slice/crio-bad80a0e48224b52c2dcbf59d58f0f06be39f636215ff5ccbcceed975f0af3e6 WatchSource:0}: Error finding container bad80a0e48224b52c2dcbf59d58f0f06be39f636215ff5ccbcceed975f0af3e6: Status 404 returned error can't find the container with id bad80a0e48224b52c2dcbf59d58f0f06be39f636215ff5ccbcceed975f0af3e6 Jun 06 20:32:58.490403 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.490326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" event={"ID":"71df3a93-495a-4fce-8671-64ccc84ee957","Type":"ContainerStarted","Data":"bad80a0e48224b52c2dcbf59d58f0f06be39f636215ff5ccbcceed975f0af3e6"} Jun 06 20:32:58.491474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:32:58.491451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666659f7bb-gjbhh" event={"ID":"7d62ae4f-4516-4db8-a646-78e53ebf7c34","Type":"ContainerStarted","Data":"cb8a9f624600bf098d66ba9a26607e549037ffa5d2994a09e9710b77dcff38c8"} Jun 06 20:33:01.118149 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.118113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:01.207332 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.207257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:01.518868 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.518772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666659f7bb-gjbhh" event={"ID":"7d62ae4f-4516-4db8-a646-78e53ebf7c34","Type":"ContainerStarted","Data":"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82"} Jun 06 20:33:01.518868 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.518839 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:33:01.520254 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.520220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" event={"ID":"71df3a93-495a-4fce-8671-64ccc84ee957","Type":"ContainerStarted","Data":"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260"} Jun 06 20:33:01.520388 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.520312 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:33:01.539962 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.539913 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-666659f7bb-gjbhh" podStartSLOduration=1.807007456 podStartE2EDuration="4.539899582s" totalImagesPullingTime="2.732892126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:01.536627319 +0000 UTC m=+805.347971902" watchObservedRunningTime="2026-06-06 20:33:01.539899582 +0000 UTC m=+805.351244171" Jun 06 20:33:01.554022 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:01.553974 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" podStartSLOduration=1.991502311 podStartE2EDuration="4.553961838s" totalImagesPullingTime="2.562459527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:01.551611431 +0000 UTC m=+805.362956026" watchObservedRunningTime="2026-06-06 20:33:01.553961838 +0000 UTC m=+805.365306421" Jun 06 20:33:12.532584 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.532551 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:33:12.533125 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.532880 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:33:12.588473 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.588432 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:33:12.595975 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.595936 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-666659f7bb-gjbhh" podUID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" containerName="manager" containerID="cri-o://7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82" gracePeriod=30 Jun 06 20:33:12.847466 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.847444 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:33:12.998980 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.998955 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert\") pod \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " Jun 06 20:33:12.999160 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:12.999069 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx86x\" (UniqueName: \"kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x\") pod \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\" (UID: \"7d62ae4f-4516-4db8-a646-78e53ebf7c34\") " Jun 06 20:33:13.001104 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.001071 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7d62ae4f-4516-4db8-a646-78e53ebf7c34" (UID: "7d62ae4f-4516-4db8-a646-78e53ebf7c34"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:33:13.001220 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.001148 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x" (OuterVolumeSpecName: "kube-api-access-lx86x") pod "7d62ae4f-4516-4db8-a646-78e53ebf7c34" (UID: "7d62ae4f-4516-4db8-a646-78e53ebf7c34"). InnerVolumeSpecName "kube-api-access-lx86x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:33:13.099932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.099844 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx86x\" (UniqueName: \"kubernetes.io/projected/7d62ae4f-4516-4db8-a646-78e53ebf7c34-kube-api-access-lx86x\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:33:13.099932 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.099885 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d62ae4f-4516-4db8-a646-78e53ebf7c34-webhook-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:33:13.603406 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.603372 2575 generic.go:356] "Generic (PLEG): container finished" podID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" containerID="7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82" exitCode=0 Jun 06 20:33:13.603846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.603416 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666659f7bb-gjbhh" Jun 06 20:33:13.603846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.603456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666659f7bb-gjbhh" event={"ID":"7d62ae4f-4516-4db8-a646-78e53ebf7c34","Type":"ContainerDied","Data":"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82"} Jun 06 20:33:13.603846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.603503 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666659f7bb-gjbhh" event={"ID":"7d62ae4f-4516-4db8-a646-78e53ebf7c34","Type":"ContainerDied","Data":"cb8a9f624600bf098d66ba9a26607e549037ffa5d2994a09e9710b77dcff38c8"} Jun 06 20:33:13.603846 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.603527 2575 scope.go:117] "RemoveContainer" containerID="7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82" Jun 06 20:33:13.613828 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.613811 2575 scope.go:117] "RemoveContainer" containerID="7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82" Jun 06 20:33:13.614065 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:33:13.614046 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82\": container with ID starting with 7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82 not found: ID does not exist" containerID="7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82" Jun 06 20:33:13.614110 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.614073 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82"} err="failed to get container status \"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82\": rpc error: code = NotFound desc = could not find container \"7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82\": container with ID starting with 7e2c8a733738fc8a666455d468ae4714f536b342a217dadd863e4775225adb82 not found: ID does not exist" Jun 06 20:33:13.626462 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.626441 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:33:13.630297 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:13.630273 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-666659f7bb-gjbhh"] Jun 06 20:33:14.651317 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:14.651285 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" path="/var/lib/kubelet/pods/7d62ae4f-4516-4db8-a646-78e53ebf7c34/volumes" Jun 06 20:33:35.038207 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.038169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:35.104153 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.104115 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6bf546bd9f-8br7h"] Jun 06 20:33:35.104630 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.104612 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" containerName="manager" Jun 06 20:33:35.104818 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.104633 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" containerName="manager" Jun 06 20:33:35.104818 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.104781 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d62ae4f-4516-4db8-a646-78e53ebf7c34" containerName="manager" Jun 06 20:33:35.109530 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.109510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.112044 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.112021 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 06 20:33:35.112173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.112154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2mh9k\"" Jun 06 20:33:35.120669 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.120643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bf546bd9f-8br7h"] Jun 06 20:33:35.200981 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.200950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.201149 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.201022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7fw\" (UniqueName: \"kubernetes.io/projected/2c172c53-799f-4db2-b70d-fde261e3d1b3-kube-api-access-gd7fw\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.302361 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.302327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7fw\" (UniqueName: \"kubernetes.io/projected/2c172c53-799f-4db2-b70d-fde261e3d1b3-kube-api-access-gd7fw\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.302517 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.302424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.302575 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:33:35.302559 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 06 20:33:35.302635 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:33:35.302627 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls podName:2c172c53-799f-4db2-b70d-fde261e3d1b3 nodeName:}" failed. No retries permitted until 2026-06-06 20:33:35.802610664 +0000 UTC m=+839.613955229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls") pod "maas-api-6bf546bd9f-8br7h" (UID: "2c172c53-799f-4db2-b70d-fde261e3d1b3") : secret "maas-api-serving-cert" not found Jun 06 20:33:35.316698 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.316672 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7fw\" (UniqueName: \"kubernetes.io/projected/2c172c53-799f-4db2-b70d-fde261e3d1b3-kube-api-access-gd7fw\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.440892 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.440855 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:35.548608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.548576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:35.642501 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.642411 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kgqcl"] Jun 06 20:33:35.643321 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.643276 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:33:35.645427 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.645405 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:35.647689 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.647668 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h5n4x\"" Jun 06 20:33:35.647832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.647693 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 20:33:35.656064 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.656041 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kgqcl"] Jun 06 20:33:35.689633 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.689603 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q7wz5"] Jun 06 20:33:35.692108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.692092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:35.713415 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.713300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzwzt\" (UniqueName: \"kubernetes.io/projected/a71945f4-161f-4ff4-9e76-e72e1614d6ce-kube-api-access-vzwzt\") pod \"payload-processing-7c6c859784-q7wz5\" (UID: \"a71945f4-161f-4ff4-9e76-e72e1614d6ce\") " pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:35.714184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.713745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldwg\" (UniqueName: \"kubernetes.io/projected/1bfb1e70-c87c-4d83-ae7c-067c2dba36c2-kube-api-access-sldwg\") pod \"payload-pre-processing-67d7689b65-kgqcl\" (UID: \"1bfb1e70-c87c-4d83-ae7c-067c2dba36c2\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:35.715353 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.715325 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q7wz5"] Jun 06 20:33:35.814656 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.814619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sldwg\" (UniqueName: \"kubernetes.io/projected/1bfb1e70-c87c-4d83-ae7c-067c2dba36c2-kube-api-access-sldwg\") pod \"payload-pre-processing-67d7689b65-kgqcl\" (UID: \"1bfb1e70-c87c-4d83-ae7c-067c2dba36c2\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:35.814839 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.814663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.814839 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.814778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzwzt\" (UniqueName: \"kubernetes.io/projected/a71945f4-161f-4ff4-9e76-e72e1614d6ce-kube-api-access-vzwzt\") pod \"payload-processing-7c6c859784-q7wz5\" (UID: \"a71945f4-161f-4ff4-9e76-e72e1614d6ce\") " pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:35.817167 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.817144 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c172c53-799f-4db2-b70d-fde261e3d1b3-maas-api-tls\") pod \"maas-api-6bf546bd9f-8br7h\" (UID: \"2c172c53-799f-4db2-b70d-fde261e3d1b3\") " pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:35.822764 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.822740 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzwzt\" (UniqueName: \"kubernetes.io/projected/a71945f4-161f-4ff4-9e76-e72e1614d6ce-kube-api-access-vzwzt\") pod \"payload-processing-7c6c859784-q7wz5\" (UID: \"a71945f4-161f-4ff4-9e76-e72e1614d6ce\") " pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:35.822854 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.822773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldwg\" (UniqueName: \"kubernetes.io/projected/1bfb1e70-c87c-4d83-ae7c-067c2dba36c2-kube-api-access-sldwg\") pod \"payload-pre-processing-67d7689b65-kgqcl\" (UID: \"1bfb1e70-c87c-4d83-ae7c-067c2dba36c2\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:35.957525 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:35.957431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:36.002647 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.002610 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:36.024354 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.024299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:36.123354 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:33:36.123300 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfb1e70_c87c_4d83_ae7c_067c2dba36c2.slice/crio-bddd77a63088018fcbd6384a3b91389cfe6336a6eaeb2686f66b862fb9fa2629 WatchSource:0}: Error finding container bddd77a63088018fcbd6384a3b91389cfe6336a6eaeb2686f66b862fb9fa2629: Status 404 returned error can't find the container with id bddd77a63088018fcbd6384a3b91389cfe6336a6eaeb2686f66b862fb9fa2629 Jun 06 20:33:36.126888 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.126600 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-kgqcl"] Jun 06 20:33:36.179745 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.179694 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-q7wz5"] Jun 06 20:33:36.181843 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:33:36.181814 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71945f4_161f_4ff4_9e76_e72e1614d6ce.slice/crio-2f1130e807f1f7f7c3784af11b56f440c64e7af8fae83a029a790f2bbf859984 WatchSource:0}: Error finding container 2f1130e807f1f7f7c3784af11b56f440c64e7af8fae83a029a790f2bbf859984: Status 404 returned error can't find the container with id 2f1130e807f1f7f7c3784af11b56f440c64e7af8fae83a029a790f2bbf859984 Jun 06 20:33:36.207278 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.207254 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6bf546bd9f-8br7h"] Jun 06 20:33:36.208431 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:33:36.208375 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c172c53_799f_4db2_b70d_fde261e3d1b3.slice/crio-d0a42c450abb4018b5c2ea6a19533b873f55f5c1b8efebed81ccc2526492ea9d WatchSource:0}: Error finding container d0a42c450abb4018b5c2ea6a19533b873f55f5c1b8efebed81ccc2526492ea9d: Status 404 returned error can't find the container with id d0a42c450abb4018b5c2ea6a19533b873f55f5c1b8efebed81ccc2526492ea9d Jun 06 20:33:36.753902 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.753861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" event={"ID":"1bfb1e70-c87c-4d83-ae7c-067c2dba36c2","Type":"ContainerStarted","Data":"bddd77a63088018fcbd6384a3b91389cfe6336a6eaeb2686f66b862fb9fa2629"} Jun 06 20:33:36.755470 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.755403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" event={"ID":"a71945f4-161f-4ff4-9e76-e72e1614d6ce","Type":"ContainerStarted","Data":"2f1130e807f1f7f7c3784af11b56f440c64e7af8fae83a029a790f2bbf859984"} Jun 06 20:33:36.756956 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:36.756928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bf546bd9f-8br7h" event={"ID":"2c172c53-799f-4db2-b70d-fde261e3d1b3","Type":"ContainerStarted","Data":"d0a42c450abb4018b5c2ea6a19533b873f55f5c1b8efebed81ccc2526492ea9d"} Jun 06 20:33:37.793193 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:37.793172 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 20:33:38.774385 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.774345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" event={"ID":"1bfb1e70-c87c-4d83-ae7c-067c2dba36c2","Type":"ContainerStarted","Data":"ee7cb1842823786d4c8a79159e76940b5d0f9ec14266a505c8821787c25a50c3"} Jun 06 20:33:38.774594 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.774409 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:33:38.775960 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.775933 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" event={"ID":"a71945f4-161f-4ff4-9e76-e72e1614d6ce","Type":"ContainerStarted","Data":"f57866aa0231cb1ac7c6dcdc1812bd06d9847af2c6401049326c1de77127c35a"} Jun 06 20:33:38.776081 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.775987 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:38.777234 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.777213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6bf546bd9f-8br7h" event={"ID":"2c172c53-799f-4db2-b70d-fde261e3d1b3","Type":"ContainerStarted","Data":"71e2e5f46b313b5ef9bd045712cb6379ef865ddf3fb0d2d1c6cf667b4b0ad478"} Jun 06 20:33:38.777341 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.777326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:38.789850 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.789656 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" podStartSLOduration=2.122776925 podStartE2EDuration="3.789636308s" totalImagesPullingTime="1.666859383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:38.788820074 +0000 UTC m=+842.600164657" watchObservedRunningTime="2026-06-06 20:33:38.789636308 +0000 UTC m=+842.600980892" Jun 06 20:33:38.805245 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.805202 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6bf546bd9f-8br7h" podStartSLOduration=2.223973374 podStartE2EDuration="3.805188524s" totalImagesPullingTime="1.58121515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:38.802246163 +0000 UTC m=+842.613590759" watchObservedRunningTime="2026-06-06 20:33:38.805188524 +0000 UTC m=+842.616533106" Jun 06 20:33:38.818765 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:38.818722 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" podStartSLOduration=2.211799843 podStartE2EDuration="3.818695161s" totalImagesPullingTime="1.606895318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:38.815885467 +0000 UTC m=+842.627230051" watchObservedRunningTime="2026-06-06 20:33:38.818695161 +0000 UTC m=+842.630039743" Jun 06 20:33:44.790652 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:44.790624 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6bf546bd9f-8br7h" Jun 06 20:33:49.786422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:49.786391 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-q7wz5" Jun 06 20:33:49.786829 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:33:49.786583 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-kgqcl" Jun 06 20:34:23.908974 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:23.908872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:34:36.069961 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.069930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:34:36.167859 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.167825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:34:36.727166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.727140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:34:36.733074 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.733053 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:34:36.734673 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.734657 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:34:36.740069 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:36.740054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:34:51.694730 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.694674 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq"] Jun 06 20:34:51.698700 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.698681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.701436 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.701405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 20:34:51.701560 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.701450 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 20:34:51.702333 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.702313 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mjf4j\"" Jun 06 20:34:51.702437 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.702314 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 06 20:34:51.707920 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.707899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq"] Jun 06 20:34:51.766397 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.766366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:34:51.821911 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.821887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.822054 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.821958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3ce789-b545-4191-a431-9b6ddd00f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.822054 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.822018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.822054 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.822049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.822188 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.822090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-889gl\" (UniqueName: \"kubernetes.io/projected/1d3ce789-b545-4191-a431-9b6ddd00f121-kube-api-access-889gl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.822188 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.822154 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.922995 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.922962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3ce789-b545-4191-a431-9b6ddd00f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-889gl\" (UniqueName: \"kubernetes.io/projected/1d3ce789-b545-4191-a431-9b6ddd00f121-kube-api-access-889gl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923166 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923636 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923636 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.923636 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.923550 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.925620 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.925592 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d3ce789-b545-4191-a431-9b6ddd00f121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.925765 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.925677 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d3ce789-b545-4191-a431-9b6ddd00f121-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:51.930753 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:51.930733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-889gl\" (UniqueName: \"kubernetes.io/projected/1d3ce789-b545-4191-a431-9b6ddd00f121-kube-api-access-889gl\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq\" (UID: \"1d3ce789-b545-4191-a431-9b6ddd00f121\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:52.011546 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:52.011461 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:34:52.160604 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:52.160574 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq"] Jun 06 20:34:52.162046 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:34:52.162024 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3ce789_b545_4191_a431_9b6ddd00f121.slice/crio-9ca8cecffc3231ec2bb70893f3402f2af1c085fc08190fc4230dfccbaba9d10d WatchSource:0}: Error finding container 9ca8cecffc3231ec2bb70893f3402f2af1c085fc08190fc4230dfccbaba9d10d: Status 404 returned error can't find the container with id 9ca8cecffc3231ec2bb70893f3402f2af1c085fc08190fc4230dfccbaba9d10d Jun 06 20:34:52.236322 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:52.236281 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" event={"ID":"1d3ce789-b545-4191-a431-9b6ddd00f121","Type":"ContainerStarted","Data":"9ca8cecffc3231ec2bb70893f3402f2af1c085fc08190fc4230dfccbaba9d10d"} Jun 06 20:34:54.284289 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.284253 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r"] Jun 06 20:34:54.296047 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.296021 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.296855 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.296826 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r"] Jun 06 20:34:54.298576 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.298551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 06 20:34:54.304474 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.304444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkt5\" (UniqueName: \"kubernetes.io/projected/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kube-api-access-5kkt5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.352387 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.352275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453489 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkt5\" (UniqueName: \"kubernetes.io/projected/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kube-api-access-5kkt5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453672 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453809 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453809 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453924 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.453924 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.453894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.454244 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.454186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.454379 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.454355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.454467 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.454447 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.456518 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.456494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.456912 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.456892 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.461532 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.461513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkt5\" (UniqueName: \"kubernetes.io/projected/8b6d92ef-3da3-4d1b-a166-e068c1bd11af-kube-api-access-5kkt5\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z9d2r\" (UID: \"8b6d92ef-3da3-4d1b-a166-e068c1bd11af\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:54.611289 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:54.611247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:34:55.565061 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:55.565039 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r"] Jun 06 20:34:55.567199 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:34:55.567160 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6d92ef_3da3_4d1b_a166_e068c1bd11af.slice/crio-4ccee22bfbf4961c624ecdf340ceb0e6496b5b5844c64d90f50a30de4c33e435 WatchSource:0}: Error finding container 4ccee22bfbf4961c624ecdf340ceb0e6496b5b5844c64d90f50a30de4c33e435: Status 404 returned error can't find the container with id 4ccee22bfbf4961c624ecdf340ceb0e6496b5b5844c64d90f50a30de4c33e435 Jun 06 20:34:56.266343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:56.266310 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" event={"ID":"1d3ce789-b545-4191-a431-9b6ddd00f121","Type":"ContainerStarted","Data":"92e7f9ad7a4e3c1d68f481ff42cbe176dc478edfbe4ee4063558958c46d1eed5"} Jun 06 20:34:56.267757 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:56.267697 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" event={"ID":"8b6d92ef-3da3-4d1b-a166-e068c1bd11af","Type":"ContainerStarted","Data":"99f77e0d4ed95d79ef3d59e6a70e486be7b09c38f609e382aaf3d2b40ab538e7"} Jun 06 20:34:56.267900 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:56.267785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" event={"ID":"8b6d92ef-3da3-4d1b-a166-e068c1bd11af","Type":"ContainerStarted","Data":"4ccee22bfbf4961c624ecdf340ceb0e6496b5b5844c64d90f50a30de4c33e435"} Jun 06 20:34:58.281398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:58.281312 2575 generic.go:356] "Generic (PLEG): container finished" podID="1d3ce789-b545-4191-a431-9b6ddd00f121" containerID="92e7f9ad7a4e3c1d68f481ff42cbe176dc478edfbe4ee4063558958c46d1eed5" exitCode=0 Jun 06 20:34:58.281398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:34:58.281387 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" event={"ID":"1d3ce789-b545-4191-a431-9b6ddd00f121","Type":"ContainerDied","Data":"92e7f9ad7a4e3c1d68f481ff42cbe176dc478edfbe4ee4063558958c46d1eed5"} Jun 06 20:35:00.295222 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:00.295182 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" event={"ID":"1d3ce789-b545-4191-a431-9b6ddd00f121","Type":"ContainerStarted","Data":"e3f5a03fb1099ce4ef4fda95d59713eea32f28f1b49f28eb2b22b85e5e8d01f3"} Jun 06 20:35:00.315003 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:00.314949 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" podStartSLOduration=2.695766413 podStartE2EDuration="9.314934957s" totalImagesPullingTime="4.353973934s" totalInitContainerRuntime="2.26519461s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:34:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:35:00.31286781 +0000 UTC m=+924.124212417" watchObservedRunningTime="2026-06-06 20:35:00.314934957 +0000 UTC m=+924.126279540" Jun 06 20:35:02.011888 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:02.011846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:35:02.012280 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:02.011946 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:35:02.024554 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:02.024529 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:35:02.319249 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:02.319219 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq" Jun 06 20:35:03.989342 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:03.989307 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld"] Jun 06 20:35:03.995381 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:03.995359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:03.998196 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:03.998170 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 06 20:35:04.001422 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.001395 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld"] Jun 06 20:35:04.026040 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.026010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:35:04.059950 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.059920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvrcc\" (UniqueName: \"kubernetes.io/projected/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kube-api-access-qvrcc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.060108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.059986 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.060108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.060009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.060108 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.060048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.060280 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.060118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.060280 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.060158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.162551 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.162514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.162824 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.162801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.163182 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.163152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.163610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.163586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.163861 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.163841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.164005 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.163989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.164179 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.164160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrcc\" (UniqueName: \"kubernetes.io/projected/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kube-api-access-qvrcc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.164921 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.164902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.165046 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.165020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.168416 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.168389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.168761 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.168685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.176600 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.176574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvrcc\" (UniqueName: \"kubernetes.io/projected/ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca-kube-api-access-qvrcc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld\" (UID: \"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.310390 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.310361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:04.454122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:04.454092 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld"] Jun 06 20:35:04.456002 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:35:04.455972 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1d8562_2eb0_4f82_99d2_d82fcf8fc0ca.slice/crio-bd471e23f05dbe0264fb4f7735a1e5b3840150ade76816e171d1793edcfff66f WatchSource:0}: Error finding container bd471e23f05dbe0264fb4f7735a1e5b3840150ade76816e171d1793edcfff66f: Status 404 returned error can't find the container with id bd471e23f05dbe0264fb4f7735a1e5b3840150ade76816e171d1793edcfff66f Jun 06 20:35:05.329457 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:05.329416 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" event={"ID":"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca","Type":"ContainerStarted","Data":"aee59f0ea1f54c38e652ed8d990a5cbec590a0a9dde541735cac6d160023d7d9"} Jun 06 20:35:05.329868 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:05.329488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" event={"ID":"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca","Type":"ContainerStarted","Data":"bd471e23f05dbe0264fb4f7735a1e5b3840150ade76816e171d1793edcfff66f"} Jun 06 20:35:06.337209 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:06.337174 2575 generic.go:356] "Generic (PLEG): container finished" podID="ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca" containerID="aee59f0ea1f54c38e652ed8d990a5cbec590a0a9dde541735cac6d160023d7d9" exitCode=0 Jun 06 20:35:06.337592 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:06.337238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" event={"ID":"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca","Type":"ContainerDied","Data":"aee59f0ea1f54c38e652ed8d990a5cbec590a0a9dde541735cac6d160023d7d9"} Jun 06 20:35:07.345770 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:07.345732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" event={"ID":"ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca","Type":"ContainerStarted","Data":"91400739c7af08a00d333a827c9d8c149295edd639726f88fe9934f201ef9621"} Jun 06 20:35:07.364687 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:07.364638 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" podStartSLOduration=2.9032273699999998 podStartE2EDuration="4.364623551s" totalImagesPullingTime="191.068101ms" totalInitContainerRuntime="1.27032808s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:35:07.363967206 +0000 UTC m=+931.175311789" watchObservedRunningTime="2026-06-06 20:35:07.364623551 +0000 UTC m=+931.175968134" Jun 06 20:35:14.310997 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:14.310960 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:14.311383 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:14.311030 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:14.323598 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:14.323575 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:14.401923 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:14.401893 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld" Jun 06 20:35:19.071033 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.070993 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m"] Jun 06 20:35:19.090030 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.089975 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m"] Jun 06 20:35:19.090173 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.090131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.092920 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.092893 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 06 20:35:19.112462 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.112440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:35:19.221232 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.221405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.221405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.221405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.221517 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgn4q\" (UniqueName: \"kubernetes.io/projected/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kube-api-access-hgn4q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.221517 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.221498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322389 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322813 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgn4q\" (UniqueName: \"kubernetes.io/projected/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kube-api-access-hgn4q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322813 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322813 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322895 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.322959 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.322918 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.323064 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.323004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.325144 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.325105 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.325405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.325379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.330811 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.330787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgn4q\" (UniqueName: \"kubernetes.io/projected/32c8390d-2e88-49ab-8794-13b6f7ffb9bf-kube-api-access-hgn4q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m\" (UID: \"32c8390d-2e88-49ab-8794-13b6f7ffb9bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.404744 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.404690 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:19.555585 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:35:19.555551 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c8390d_2e88_49ab_8794_13b6f7ffb9bf.slice/crio-5b388210d3e65feddf4fc117063f55d0dae3c4558ed05b4163024919e311817d WatchSource:0}: Error finding container 5b388210d3e65feddf4fc117063f55d0dae3c4558ed05b4163024919e311817d: Status 404 returned error can't find the container with id 5b388210d3e65feddf4fc117063f55d0dae3c4558ed05b4163024919e311817d Jun 06 20:35:19.556137 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:19.556113 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m"] Jun 06 20:35:20.433725 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:20.433676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" event={"ID":"32c8390d-2e88-49ab-8794-13b6f7ffb9bf","Type":"ContainerStarted","Data":"c109c5755107b10528f3bca9f52429ad409e9919eeba26fac4b225a9b879d70a"} Jun 06 20:35:20.434116 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:20.433752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" event={"ID":"32c8390d-2e88-49ab-8794-13b6f7ffb9bf","Type":"ContainerStarted","Data":"5b388210d3e65feddf4fc117063f55d0dae3c4558ed05b4163024919e311817d"} Jun 06 20:35:21.441779 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:21.441745 2575 generic.go:356] "Generic (PLEG): container finished" podID="32c8390d-2e88-49ab-8794-13b6f7ffb9bf" containerID="c109c5755107b10528f3bca9f52429ad409e9919eeba26fac4b225a9b879d70a" exitCode=0 Jun 06 20:35:21.442213 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:21.441883 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" event={"ID":"32c8390d-2e88-49ab-8794-13b6f7ffb9bf","Type":"ContainerDied","Data":"c109c5755107b10528f3bca9f52429ad409e9919eeba26fac4b225a9b879d70a"} Jun 06 20:35:21.442417 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:21.442401 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:35:22.451240 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:22.451203 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" event={"ID":"32c8390d-2e88-49ab-8794-13b6f7ffb9bf","Type":"ContainerStarted","Data":"268bf7a70db58ccfcc67cfd9dae2026ad54a61368c061b2f6e37e7ac88e38a6a"} Jun 06 20:35:22.469723 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:22.469657 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" podStartSLOduration=1.948178225 podStartE2EDuration="3.46964328s" totalImagesPullingTime="164.959835ms" totalInitContainerRuntime="1.35650522s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:35:22.468063089 +0000 UTC m=+946.279407672" watchObservedRunningTime="2026-06-06 20:35:22.46964328 +0000 UTC m=+946.280987863" Jun 06 20:35:26.978229 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.978197 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8"] Jun 06 20:35:26.983180 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.983157 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.985456 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.985433 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 06 20:35:26.991832 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.991806 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8"] Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdl25\" (UniqueName: \"kubernetes.io/projected/6e35d4d4-2276-4712-b161-0a035860b67b-kube-api-access-qdl25\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e35d4d4-2276-4712-b161-0a035860b67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:26.999288 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:26.997465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.009532 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.009499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:35:27.098684 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.098899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.098899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdl25\" (UniqueName: \"kubernetes.io/projected/6e35d4d4-2276-4712-b161-0a035860b67b-kube-api-access-qdl25\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.098899 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e35d4d4-2276-4712-b161-0a035860b67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.099077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098937 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.099077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.098966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.099237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.099213 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.099355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.099305 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.099355 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.099334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.101281 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.101255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e35d4d4-2276-4712-b161-0a035860b67b-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.101453 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.101431 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e35d4d4-2276-4712-b161-0a035860b67b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.106800 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.106778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdl25\" (UniqueName: \"kubernetes.io/projected/6e35d4d4-2276-4712-b161-0a035860b67b-kube-api-access-qdl25\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8\" (UID: \"6e35d4d4-2276-4712-b161-0a035860b67b\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.298290 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.298199 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:27.444099 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.444070 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8"] Jun 06 20:35:27.444790 ip-10-0-131-207 kubenswrapper[2575]: W0606 20:35:27.444768 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e35d4d4_2276_4712_b161_0a035860b67b.slice/crio-e0647682c4a58bd293cf5d8e501de680b8a0b8bbcc8358f91e2c61b08977a685 WatchSource:0}: Error finding container e0647682c4a58bd293cf5d8e501de680b8a0b8bbcc8358f91e2c61b08977a685: Status 404 returned error can't find the container with id e0647682c4a58bd293cf5d8e501de680b8a0b8bbcc8358f91e2c61b08977a685 Jun 06 20:35:27.493405 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:27.493344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" event={"ID":"6e35d4d4-2276-4712-b161-0a035860b67b","Type":"ContainerStarted","Data":"e0647682c4a58bd293cf5d8e501de680b8a0b8bbcc8358f91e2c61b08977a685"} Jun 06 20:35:28.501602 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:28.501558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" event={"ID":"6e35d4d4-2276-4712-b161-0a035860b67b","Type":"ContainerStarted","Data":"7c4e3f6d0daadf6b05cd91ad991765af744ad1267ae206ee5c28c25fe28357cd"} Jun 06 20:35:29.405152 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.405116 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:29.405354 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.405195 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:29.418087 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.418063 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:29.513101 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.513065 2575 generic.go:356] "Generic (PLEG): container finished" podID="6e35d4d4-2276-4712-b161-0a035860b67b" containerID="7c4e3f6d0daadf6b05cd91ad991765af744ad1267ae206ee5c28c25fe28357cd" exitCode=0 Jun 06 20:35:29.513476 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.513155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" event={"ID":"6e35d4d4-2276-4712-b161-0a035860b67b","Type":"ContainerDied","Data":"7c4e3f6d0daadf6b05cd91ad991765af744ad1267ae206ee5c28c25fe28357cd"} Jun 06 20:35:29.525452 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:29.525420 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m" Jun 06 20:35:30.521311 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:30.521271 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" event={"ID":"6e35d4d4-2276-4712-b161-0a035860b67b","Type":"ContainerStarted","Data":"2d6357816a3a084f3270c45ea367b9d11090120b8daeb9fe2f0e9eaf47ce9117"} Jun 06 20:35:30.540434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:30.540383 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" podStartSLOduration=3.134950698 podStartE2EDuration="4.540367886s" totalImagesPullingTime="152.972262ms" totalInitContainerRuntime="1.252444926s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:35:30.538013314 +0000 UTC m=+954.349357897" watchObservedRunningTime="2026-06-06 20:35:30.540367886 +0000 UTC m=+954.351712530" Jun 06 20:35:37.299136 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:37.299087 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:37.299684 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:37.299165 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:37.312043 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:37.312020 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:37.589141 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:37.589061 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8" Jun 06 20:35:43.914665 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:35:43.914626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:34.921937 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:34.921903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:40.988109 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:40.988077 2575 generic.go:356] "Generic (PLEG): container finished" podID="8b6d92ef-3da3-4d1b-a166-e068c1bd11af" containerID="99f77e0d4ed95d79ef3d59e6a70e486be7b09c38f609e382aaf3d2b40ab538e7" exitCode=0 Jun 06 20:36:40.988461 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:40.988148 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" event={"ID":"8b6d92ef-3da3-4d1b-a166-e068c1bd11af","Type":"ContainerDied","Data":"99f77e0d4ed95d79ef3d59e6a70e486be7b09c38f609e382aaf3d2b40ab538e7"} Jun 06 20:36:41.996326 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:41.996284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" event={"ID":"8b6d92ef-3da3-4d1b-a166-e068c1bd11af","Type":"ContainerStarted","Data":"8ce50cfa7f44b802a6d22888132d184de249a933229158f21bbdd81e0e4d018b"} Jun 06 20:36:42.022051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:42.021997 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" podStartSLOduration=2.664634115 podStartE2EDuration="1m48.021979726s" totalImagesPullingTime="182.299605ms" totalInitContainerRuntime="1m45.175046006s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:36:42.020638593 +0000 UTC m=+1025.831983190" watchObservedRunningTime="2026-06-06 20:36:42.021979726 +0000 UTC m=+1025.833324308" Jun 06 20:36:43.756186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:43.756150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:43.871675 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:43.871643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:44.612437 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:44.612401 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:36:44.612611 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:44.612488 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:36:44.624640 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:44.624615 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:36:44.838306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:44.838269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:44.937051 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:44.936972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:36:45.029498 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:36:45.029464 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z9d2r" Jun 06 20:37:23.833521 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:37:23.833438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:38:10.742165 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:10.742126 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:38:10.837090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:10.837057 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:38:10.837291 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:10.837266 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" podUID="71df3a93-495a-4fce-8671-64ccc84ee957" containerName="manager" containerID="cri-o://f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260" gracePeriod=30 Jun 06 20:38:11.089398 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.089377 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:38:11.233150 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.233114 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kkvw\" (UniqueName: \"kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw\") pod \"71df3a93-495a-4fce-8671-64ccc84ee957\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " Jun 06 20:38:11.233341 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.233196 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert\") pod \"71df3a93-495a-4fce-8671-64ccc84ee957\" (UID: \"71df3a93-495a-4fce-8671-64ccc84ee957\") " Jun 06 20:38:11.235156 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.235123 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw" (OuterVolumeSpecName: "kube-api-access-4kkvw") pod "71df3a93-495a-4fce-8671-64ccc84ee957" (UID: "71df3a93-495a-4fce-8671-64ccc84ee957"). InnerVolumeSpecName "kube-api-access-4kkvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:38:11.235270 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.235161 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "71df3a93-495a-4fce-8671-64ccc84ee957" (UID: "71df3a93-495a-4fce-8671-64ccc84ee957"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:38:11.334634 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.334607 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kkvw\" (UniqueName: \"kubernetes.io/projected/71df3a93-495a-4fce-8671-64ccc84ee957-kube-api-access-4kkvw\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:38:11.334634 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.334632 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71df3a93-495a-4fce-8671-64ccc84ee957-webhook-cert\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:38:11.600186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.600101 2575 generic.go:356] "Generic (PLEG): container finished" podID="71df3a93-495a-4fce-8671-64ccc84ee957" containerID="f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260" exitCode=0 Jun 06 20:38:11.600186 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.600140 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" Jun 06 20:38:11.600372 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.600187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" event={"ID":"71df3a93-495a-4fce-8671-64ccc84ee957","Type":"ContainerDied","Data":"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260"} Jun 06 20:38:11.600372 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.600236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db7bc5d9b-zn9lz" event={"ID":"71df3a93-495a-4fce-8671-64ccc84ee957","Type":"ContainerDied","Data":"bad80a0e48224b52c2dcbf59d58f0f06be39f636215ff5ccbcceed975f0af3e6"} Jun 06 20:38:11.600372 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.600264 2575 scope.go:117] "RemoveContainer" containerID="f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260" Jun 06 20:38:11.610250 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.610234 2575 scope.go:117] "RemoveContainer" containerID="f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260" Jun 06 20:38:11.610518 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:38:11.610498 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260\": container with ID starting with f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260 not found: ID does not exist" containerID="f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260" Jun 06 20:38:11.610599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.610525 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260"} err="failed to get container status \"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260\": rpc error: code = NotFound desc = could not find container \"f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260\": container with ID starting with f299320979c58f6a600900eb28467a75e24b6db623374a3e843e7024c4200260 not found: ID does not exist" Jun 06 20:38:11.622131 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.622102 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:38:11.631008 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:11.628674 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-db7bc5d9b-zn9lz"] Jun 06 20:38:12.259184 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:12.259153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:38:12.652096 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:12.652058 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71df3a93-495a-4fce-8671-64ccc84ee957" path="/var/lib/kubelet/pods/71df3a93-495a-4fce-8671-64ccc84ee957/volumes" Jun 06 20:38:30.701237 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:30.701204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:38:53.950583 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:53.950506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:38:54.049438 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:38:54.049404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:39:02.431807 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:02.431768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:39:08.135492 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:08.135455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:39:08.234895 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:08.234854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:39:36.773001 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:36.772973 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:39:36.779759 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:36.779738 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:39:36.784615 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:36.784596 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:39:36.790239 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:36.790220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:39:40.239056 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:40.239013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:39:41.175625 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:39:41.175593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:04.144904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:04.144862 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:09.693265 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:09.693231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:09.749563 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:09.749527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:09.819748 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:09.819691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:09.920696 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:09.920662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:10.054519 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:10.054487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:10.151338 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:10.151306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:26.560541 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:26.560459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:26.676074 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:26.676009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:26.783261 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:26.783224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:32.365953 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:32.365915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:32.420271 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:32.420236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:40.512242 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:40.512199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:40.614428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:40.614396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:40.707806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:40.707768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:40.808837 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:40.808804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:46.060970 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:46.060927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:46.109540 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:46.109506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:57.279345 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:57.279304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:57.376945 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:57.376911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:40:57.478486 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:40:57.478454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:03.126892 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:03.126858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:03.223699 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:03.223666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:23.487160 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:23.487122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:23.588740 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:23.588678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:23.685957 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:23.685923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:29.473397 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:29.473360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:29.572122 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:29.572092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:29.672223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:29.672196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:29.803610 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:29.803579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:35.349961 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:35.349922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:41:35.409567 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:41:35.409531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:44:03.633853 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:44:03.633815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:44:36.819973 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:44:36.819945 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:44:36.826189 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:44:36.826164 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:44:36.844976 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:44:36.844951 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:44:36.850477 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:44:36.850457 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:48:36.915992 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:36.915956 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:48:36.916482 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:36.916182 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" podUID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" containerName="manager" containerID="cri-o://4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5" gracePeriod=10 Jun 06 20:48:37.175833 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.175773 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:48:37.222997 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.222968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume\") pod \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " Jun 06 20:48:37.223161 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.223051 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9smjv\" (UniqueName: \"kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv\") pod \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\" (UID: \"2dbc1205-c971-48f3-9e2a-c9c181db9c88\") " Jun 06 20:48:37.223328 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.223305 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2dbc1205-c971-48f3-9e2a-c9c181db9c88" (UID: "2dbc1205-c971-48f3-9e2a-c9c181db9c88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:48:37.223434 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.223420 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dbc1205-c971-48f3-9e2a-c9c181db9c88-extensions-socket-volume\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:48:37.225182 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.225151 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv" (OuterVolumeSpecName: "kube-api-access-9smjv") pod "2dbc1205-c971-48f3-9e2a-c9c181db9c88" (UID: "2dbc1205-c971-48f3-9e2a-c9c181db9c88"). InnerVolumeSpecName "kube-api-access-9smjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:48:37.324162 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.324130 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9smjv\" (UniqueName: \"kubernetes.io/projected/2dbc1205-c971-48f3-9e2a-c9c181db9c88-kube-api-access-9smjv\") on node \"ip-10-0-131-207.ec2.internal\" DevicePath \"\"" Jun 06 20:48:37.667219 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.667184 2575 generic.go:356] "Generic (PLEG): container finished" podID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" containerID="4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5" exitCode=0 Jun 06 20:48:37.667391 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.667227 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" Jun 06 20:48:37.667391 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.667264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" event={"ID":"2dbc1205-c971-48f3-9e2a-c9c181db9c88","Type":"ContainerDied","Data":"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5"} Jun 06 20:48:37.667391 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.667316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz" event={"ID":"2dbc1205-c971-48f3-9e2a-c9c181db9c88","Type":"ContainerDied","Data":"04bef488707f10c1bf1b4f45888958d01536de5d9ede293c75159ea342281be6"} Jun 06 20:48:37.667391 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.667336 2575 scope.go:117] "RemoveContainer" containerID="4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5" Jun 06 20:48:37.677714 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.677683 2575 scope.go:117] "RemoveContainer" containerID="4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5" Jun 06 20:48:37.677993 ip-10-0-131-207 kubenswrapper[2575]: E0606 20:48:37.677971 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5\": container with ID starting with 4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5 not found: ID does not exist" containerID="4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5" Jun 06 20:48:37.678090 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.677999 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5"} err="failed to get container status \"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5\": rpc error: code = NotFound desc = could not find container \"4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5\": container with ID starting with 4faaa7d9ec719af45c1d37ac128da7c995e0fc92d4152c583fff69282d76a7d5 not found: ID does not exist" Jun 06 20:48:37.691340 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.691317 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:48:37.697337 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:37.697312 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zpwtz"] Jun 06 20:48:38.651255 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:48:38.651228 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" path="/var/lib/kubelet/pods/2dbc1205-c971-48f3-9e2a-c9c181db9c88/volumes" Jun 06 20:49:35.887535 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:49:35.887499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:49:36.874939 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:49:36.874912 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:49:36.880751 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:49:36.880727 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:49:36.891701 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:49:36.891676 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:49:36.897936 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:49:36.897917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:50:19.174534 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:50:19.174484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:50:19.225011 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:50:19.224979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:53:17.467608 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:53:17.467577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:53:17.555813 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:53:17.555779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:54:36.927684 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:54:36.927656 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:54:36.934914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:54:36.934887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:54:36.940196 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:54:36.940173 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:54:36.946497 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:54:36.946462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:56:25.028599 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:56:25.028568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.249778 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:00.249724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:00.339544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:00.339507 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:21.843822 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:21.843588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:27.171396 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:27.171358 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:36.335225 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:36.335191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:58:51.421806 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:58:51.421771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:04.469002 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:04.468961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:06.079175 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:06.079116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:06.177216 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:06.177181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:06.276298 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:06.276262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:06.375720 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:06.375577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:09.342382 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:09.342329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:12.293471 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:12.293426 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:12.482428 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:12.482389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:12.582941 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:12.582909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:14.271914 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:14.271874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.186935 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.186903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.244306 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.244274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.410010 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.409979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.465621 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.465539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.565995 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.565958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:18.669178 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:18.669142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:21.904223 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:21.904189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:24.627487 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:24.627453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:25.844333 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:25.844302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:25.945273 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:25.945240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:27.505888 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:27.505844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:31.703019 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:31.702984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:31.755009 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:31.754978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:36.974536 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:36.974509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:59:36.980937 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:36.980916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:59:36.989653 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:36.989629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 20:59:36.994544 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:36.994528 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qpwws_2c0f652c-036c-48a6-a1fa-dbd24f38dc00/ovn-acl-logging/0.log" Jun 06 20:59:43.639850 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:43.639817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c6d865764-jxxvm_d032e3a0-0461-46a8-b678-dad2210a9740/nginx/0.log" Jun 06 20:59:43.747997 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:43.747972 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-vbzf4_426e7b3e-9c14-4782-a31b-a01dc0e4746e/manager/0.log" Jun 06 20:59:43.867278 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:43.867249 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-78c9x_cf293818-d4ef-4cc9-a203-46a04b9bd81f/manager/0.log" Jun 06 20:59:43.985015 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:43.984945 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bf546bd9f-8br7h_2c172c53-799f-4db2-b70d-fde261e3d1b3/maas-api/0.log" Jun 06 20:59:44.328542 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:44.328516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-g2g2n_cdbf77ee-7fc9-41df-a74e-d9ab9aecc720/server/0.log" Jun 06 20:59:44.449747 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:44.449700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zqd7v_716db496-970c-434b-985a-5c812ec067e5/manager/0.log" Jun 06 20:59:44.675244 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:44.675165 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-rhcx8_d553bb8e-bbf6-4878-a7c4-068ab15d5683/copy-manifests/0.log" Jun 06 20:59:44.683018 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:44.682993 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-rhcx8_d553bb8e-bbf6-4878-a7c4-068ab15d5683/manager/0.log" Jun 06 20:59:44.925948 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:44.925863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jd96w_dab90ae6-6e9e-473f-b8a2-d1063dad0b7c/postgres/0.log" Jun 06 20:59:45.703407 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.703382 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/util/0.log" Jun 06 20:59:45.715591 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.715567 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/pull/0.log" Jun 06 20:59:45.729139 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.729120 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/extract/0.log" Jun 06 20:59:45.842084 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.842062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/util/0.log" Jun 06 20:59:45.854618 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.854594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/pull/0.log" Jun 06 20:59:45.867284 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.867266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/extract/0.log" Jun 06 20:59:45.983107 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.983042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/util/0.log" Jun 06 20:59:45.993393 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:45.993368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/pull/0.log" Jun 06 20:59:46.007904 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:46.007879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/extract/0.log" Jun 06 20:59:46.121289 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:46.121264 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/util/0.log" Jun 06 20:59:46.133755 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:46.133724 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/pull/0.log" Jun 06 20:59:46.141871 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:46.141847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/extract/0.log" Jun 06 20:59:47.533954 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:47.533927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jgjww_cbc6841b-017b-4246-8971-857d671e5f15/discovery/0.log" Jun 06 20:59:47.770567 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:47.770536 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54c798458-s9w8l_06e30aa4-eaeb-4f9a-9f09-3cca3af8459a/kube-auth-proxy/0.log" Jun 06 20:59:48.000533 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.000497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kgqcl_1bfb1e70-c87c-4d83-ae7c-067c2dba36c2/payload-pre-processing/0.log" Jun 06 20:59:48.121498 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.121469 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q7wz5_a71945f4-161f-4ff4-9e76-e72e1614d6ce/payload-processing/0.log" Jun 06 20:59:48.554859 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.554830 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq_1d3ce789-b545-4191-a431-9b6ddd00f121/storage-initializer/0.log" Jun 06 20:59:48.561989 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.561965 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-mwqkq_1d3ce789-b545-4191-a431-9b6ddd00f121/main/0.log" Jun 06 20:59:48.680611 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.680573 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z9d2r_8b6d92ef-3da3-4d1b-a166-e068c1bd11af/storage-initializer/0.log" Jun 06 20:59:48.689091 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.689068 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z9d2r_8b6d92ef-3da3-4d1b-a166-e068c1bd11af/main/0.log" Jun 06 20:59:48.800866 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.800840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld_ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca/storage-initializer/0.log" Jun 06 20:59:48.808174 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.808102 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cvjld_ce1d8562-2eb0-4f82-99d2-d82fcf8fc0ca/main/0.log" Jun 06 20:59:48.919343 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.919309 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m_32c8390d-2e88-49ab-8794-13b6f7ffb9bf/storage-initializer/0.log" Jun 06 20:59:48.926823 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:48.926791 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4m62m_32c8390d-2e88-49ab-8794-13b6f7ffb9bf/main/0.log" Jun 06 20:59:49.036015 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:49.035988 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8_6e35d4d4-2276-4712-b161-0a035860b67b/storage-initializer/0.log" Jun 06 20:59:49.043477 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:49.043446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bqkn8_6e35d4d4-2276-4712-b161-0a035860b67b/main/0.log" Jun 06 20:59:52.637098 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:52.637010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:52.737212 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:52.737170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 20:59:55.656066 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:55.656035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c92rl_e6820639-5c09-4428-8ce4-7f6e71097b20/global-pull-secret-syncer/0.log" Jun 06 20:59:55.782050 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:55.782019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" Jun 06 20:59:55.862077 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:55.862042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-207.ec2.internal_3c0d397031f09076e54ac96b039a5d49/haproxy/0.log" Jun 06 20:59:58.527297 ip-10-0-131-207 kubenswrapper[2575]: I0606 20:59:58.527264 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-m5mtf_39676b95-4dd9-416b-add6-d9775e0bb2b2/sail-operator/0.log" Jun 06 21:00:00.701072 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.701045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/extract/0.log" Jun 06 21:00:00.726995 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.726970 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/util/0.log" Jun 06 21:00:00.748248 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.748218 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gt6s_fc103499-dddd-4d2e-a530-7533d976da7c/pull/0.log" Jun 06 21:00:00.789179 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.789146 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/extract/0.log" Jun 06 21:00:00.810019 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.809995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/util/0.log" Jun 06 21:00:00.832084 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.832052 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zn4gg_b6a4d3b0-77a7-470d-a7bb-8d4d53b6815b/pull/0.log" Jun 06 21:00:00.863309 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.863282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/extract/0.log" Jun 06 21:00:00.890101 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.890074 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/util/0.log" Jun 06 21:00:00.912066 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.912037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738sztl_3241a23e-4bf2-4cd0-a9ef-10891c9e11c8/pull/0.log" Jun 06 21:00:00.940012 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.939984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/extract/0.log" Jun 06 21:00:00.962280 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.962214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/util/0.log" Jun 06 21:00:00.982650 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:00.982626 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16lxg5_bf22cc06-d81a-4a6b-9d97-ef63f86d1330/pull/0.log" Jun 06 21:00:02.906126 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:02.906095 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/alertmanager/0.log" Jun 06 21:00:02.925637 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:02.925608 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/config-reloader/0.log" Jun 06 21:00:02.946617 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:02.946590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/kube-rbac-proxy-web/0.log" Jun 06 21:00:02.966920 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:02.966897 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/kube-rbac-proxy/0.log" Jun 06 21:00:02.986626 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:02.986606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/kube-rbac-proxy-metric/0.log" Jun 06 21:00:03.007746 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.007697 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/prom-label-proxy/0.log" Jun 06 21:00:03.029061 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.029031 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bd961aa1-a739-4b41-8f66-8af16f08218e/init-config-reloader/0.log" Jun 06 21:00:03.076555 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.076528 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xtffx_bca633b8-7da5-44c0-9e94-dbdee55e8e20/cluster-monitoring-operator/0.log" Jun 06 21:00:03.109618 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.109594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-state-metrics/0.log" Jun 06 21:00:03.125716 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.125680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-rbac-proxy-main/0.log" Jun 06 21:00:03.144483 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.144460 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-55hnl_4859efe4-968f-42ea-ac68-233297312f1e/kube-rbac-proxy-self/0.log" Jun 06 21:00:03.169094 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.169026 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6664dd6b47-2x5j9_a4c4d148-aa69-4e79-8d24-f23214229b90/metrics-server/0.log" Jun 06 21:00:03.269627 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.269592 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/node-exporter/0.log" Jun 06 21:00:03.291084 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.291061 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/kube-rbac-proxy/0.log" Jun 06 21:00:03.310280 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.310262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg8zn_9e86188d-8d78-47c2-b63f-95c454d59381/init-textfile/0.log" Jun 06 21:00:03.525807 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.525750 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/kube-rbac-proxy-main/0.log" Jun 06 21:00:03.542603 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.542504 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/kube-rbac-proxy-self/0.log" Jun 06 21:00:03.565948 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.565920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-j2sfj_287633ed-23e9-488a-a8c8-d14196b34ad5/openshift-state-metrics/0.log" Jun 06 21:00:03.844863 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.844833 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-pvwcj_b34bf53b-3a43-458c-815c-99506161178a/prometheus-operator-admission-webhook/0.log" Jun 06 21:00:03.885774 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.885746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c956957d5-dg85l_9a3f0b1c-30b9-446a-ba18-dc30575dbea6/telemeter-client/0.log" Jun 06 21:00:03.912110 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.912089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c956957d5-dg85l_9a3f0b1c-30b9-446a-ba18-dc30575dbea6/reload/0.log" Jun 06 21:00:03.935029 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:03.935007 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c956957d5-dg85l_9a3f0b1c-30b9-446a-ba18-dc30575dbea6/kube-rbac-proxy/0.log" Jun 06 21:00:05.511775 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:05.511737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qlpfd_9e40d9cd-cfbb-4e2b-a45c-a9a40831bf22/networking-console-plugin/0.log" Jun 06 21:00:06.108145 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:06.108116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/2.log" Jun 06 21:00:06.116259 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:06.116236 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bbcrk_b3967c80-c5ee-4dc4-bea4-1db6236085a1/console-operator/3.log" Jun 06 21:00:06.679044 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:06.679015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7564f966fc-g4jmf_2cfd7f24-f83d-4209-9632-61e30d075e58/console/0.log" Jun 06 21:00:06.716182 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:06.716157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-rckns_b09ec5c8-bf00-4107-a12b-c5be26a8698a/download-server/0.log" Jun 06 21:00:07.555264 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555228 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw"] Jun 06 21:00:07.555853 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555828 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71df3a93-495a-4fce-8671-64ccc84ee957" containerName="manager" Jun 06 21:00:07.555853 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555850 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="71df3a93-495a-4fce-8671-64ccc84ee957" containerName="manager" Jun 06 21:00:07.555853 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555862 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" containerName="manager" Jun 06 21:00:07.556057 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555870 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" containerName="manager" Jun 06 21:00:07.556057 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555967 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="71df3a93-495a-4fce-8671-64ccc84ee957" containerName="manager" Jun 06 21:00:07.556057 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.555975 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dbc1205-c971-48f3-9e2a-c9c181db9c88" containerName="manager" Jun 06 21:00:07.558945 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.558929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.561008 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.560987 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg66\"/\"kube-root-ca.crt\"" Jun 06 21:00:07.561144 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.561043 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg66\"/\"openshift-service-ca.crt\"" Jun 06 21:00:07.562196 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.562173 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mcg66\"/\"default-dockercfg-9fdhk\"" Jun 06 21:00:07.569305 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.569283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw"] Jun 06 21:00:07.699922 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.699895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-sys\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.700271 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.699934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-podres\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.700271 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.699992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qftlr\" (UniqueName: \"kubernetes.io/projected/27e14d17-b0ab-4d45-a51d-fd80ad33e848-kube-api-access-qftlr\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.700271 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.700037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-proc\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.700271 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.700073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-lib-modules\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801067 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-proc\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801203 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-lib-modules\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801203 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-sys\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801203 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-podres\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801203 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-proc\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801203 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qftlr\" (UniqueName: \"kubernetes.io/projected/27e14d17-b0ab-4d45-a51d-fd80ad33e848-kube-api-access-qftlr\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801372 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801206 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-sys\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801372 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-podres\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.801372 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.801299 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27e14d17-b0ab-4d45-a51d-fd80ad33e848-lib-modules\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.808663 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.808615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qftlr\" (UniqueName: \"kubernetes.io/projected/27e14d17-b0ab-4d45-a51d-fd80ad33e848-kube-api-access-qftlr\") pod \"perf-node-gather-daemonset-4jgfw\" (UID: \"27e14d17-b0ab-4d45-a51d-fd80ad33e848\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.854563 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.854524 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:07.870576 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.870557 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:07.902411 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:07.902360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5m2jq_6bb24586-bf13-4e8e-a385-45ead245cef8/konnectivity-agent/0.log" limit=1024 Jun 06 21:00:08.007366 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:08.007338 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw"] Jun 06 21:00:08.007980 ip-10-0-131-207 kubenswrapper[2575]: W0606 21:00:08.007953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27e14d17_b0ab_4d45_a51d_fd80ad33e848.slice/crio-b82aa081b8258ab56027946189edfd6319ac0a2c3c6c7ab05a019b42b3e313d4 WatchSource:0}: Error finding container b82aa081b8258ab56027946189edfd6319ac0a2c3c6c7ab05a019b42b3e313d4: Status 404 returned error can't find the container with id b82aa081b8258ab56027946189edfd6319ac0a2c3c6c7ab05a019b42b3e313d4 Jun 06 21:00:08.081040 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:08.080970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" event={"ID":"27e14d17-b0ab-4d45-a51d-fd80ad33e848","Type":"ContainerStarted","Data":"b82aa081b8258ab56027946189edfd6319ac0a2c3c6c7ab05a019b42b3e313d4"} Jun 06 21:00:08.642171 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:08.642123 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hg5g2_a4c56f4e-7be5-47c8-8f85-a3a5c40a783d/dns/0.log" Jun 06 21:00:08.661991 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:08.661952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hg5g2_a4c56f4e-7be5-47c8-8f85-a3a5c40a783d/kube-rbac-proxy/0.log" Jun 06 21:00:08.731910 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:08.731886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fznv_1dafddc6-3e69-427f-a8fa-cc7d871211f2/dns-node-resolver/0.log" Jun 06 21:00:09.089798 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.089769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" event={"ID":"27e14d17-b0ab-4d45-a51d-fd80ad33e848","Type":"ContainerStarted","Data":"89f5ab0c70bdac8206a41b3504398c18337915b78c06708b0eb53fb54dc21a9b"} Jun 06 21:00:09.089967 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.089908 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:09.110682 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.110627 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" podStartSLOduration=2.110607072 podStartE2EDuration="2.110607072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 21:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:09.107392002 +0000 UTC m=+2432.918736584" watchObservedRunningTime="2026-06-06 21:00:09.110607072 +0000 UTC m=+2432.921951656" Jun 06 21:00:09.293322 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.293289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69f9cdc847-7grqh_f442446c-6782-47a5-8ab5-d3b952b0540f/registry/0.log" Jun 06 21:00:09.309087 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.309062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69f9cdc847-7grqh_f442446c-6782-47a5-8ab5-d3b952b0540f/registry/1.log" Jun 06 21:00:09.375015 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:09.374945 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml7q8_9125843c-8115-4094-9711-4ffcd690547d/node-ca/0.log" Jun 06 21:00:10.377419 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:10.377386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jgjww_cbc6841b-017b-4246-8971-857d671e5f15/discovery/0.log" Jun 06 21:00:10.420219 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:10.420194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54c798458-s9w8l_06e30aa4-eaeb-4f9a-9f09-3cca3af8459a/kube-auth-proxy/0.log" Jun 06 21:00:10.515879 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:10.515838 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kgqcl_1bfb1e70-c87c-4d83-ae7c-067c2dba36c2/payload-pre-processing/0.log" Jun 06 21:00:10.611199 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:10.611167 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q7wz5_a71945f4-161f-4ff4-9e76-e72e1614d6ce/payload-processing/0.log" Jun 06 21:00:11.273753 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:11.273695 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5v6s_f85be7f4-fd60-47aa-b6b0-0e533d639e10/serve-healthcheck-canary/0.log" Jun 06 21:00:11.919382 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:11.919353 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vch7b_0aa08c1b-707e-4170-8ef6-afed3c14b4e6/kube-rbac-proxy/0.log" Jun 06 21:00:11.938417 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:11.938392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vch7b_0aa08c1b-707e-4170-8ef6-afed3c14b4e6/exporter/0.log" Jun 06 21:00:11.960061 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:11.960040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vch7b_0aa08c1b-707e-4170-8ef6-afed3c14b4e6/extractor/0.log" Jun 06 21:00:14.159900 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.159870 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c6d865764-jxxvm_d032e3a0-0461-46a8-b678-dad2210a9740/nginx/0.log" Jun 06 21:00:14.184758 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.184736 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-vbzf4_426e7b3e-9c14-4782-a31b-a01dc0e4746e/manager/0.log" Jun 06 21:00:14.321121 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.321087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-78c9x_cf293818-d4ef-4cc9-a203-46a04b9bd81f/manager/0.log" Jun 06 21:00:14.366041 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.366009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6bf546bd9f-8br7h_2c172c53-799f-4db2-b70d-fde261e3d1b3/maas-api/0.log" Jun 06 21:00:14.521970 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.521881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-g2g2n_cdbf77ee-7fc9-41df-a74e-d9ab9aecc720/server/0.log" Jun 06 21:00:14.593455 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.593432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zqd7v_716db496-970c-434b-985a-5c812ec067e5/manager/0.log" Jun 06 21:00:14.661866 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.661837 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-rhcx8_d553bb8e-bbf6-4878-a7c4-068ab15d5683/manager/0.log" Jun 06 21:00:14.680009 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.679983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-rhcx8_d553bb8e-bbf6-4878-a7c4-068ab15d5683/copy-manifests/0.log" Jun 06 21:00:14.816214 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:14.816191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jd96w_dab90ae6-6e9e-473f-b8a2-d1063dad0b7c/postgres/0.log" Jun 06 21:00:15.108515 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:15.108436 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-4jgfw" Jun 06 21:00:16.424972 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:16.424941 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wsh6w_2d8e592d-30e6-495c-a8a7-dd30531f63a6/openshift-lws-operator/0.log" Jun 06 21:00:20.028144 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:20.028104 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jgjww_cbc6841b-017b-4246-8971-857d671e5f15/discovery/0.log" Jun 06 21:00:20.055690 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:20.055657 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54c798458-s9w8l_06e30aa4-eaeb-4f9a-9f09-3cca3af8459a/kube-auth-proxy/0.log" Jun 06 21:00:20.131659 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:20.131631 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kgqcl_1bfb1e70-c87c-4d83-ae7c-067c2dba36c2/payload-pre-processing/0.log" Jun 06 21:00:20.220122 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:20.220089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q7wz5_a71945f4-161f-4ff4-9e76-e72e1614d6ce/payload-processing/0.log" Jun 06 21:00:21.386053 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:21.386006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jgjww_cbc6841b-017b-4246-8971-857d671e5f15/discovery/0.log" Jun 06 21:00:21.441601 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:21.441566 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54c798458-s9w8l_06e30aa4-eaeb-4f9a-9f09-3cca3af8459a/kube-auth-proxy/0.log" Jun 06 21:00:21.518084 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:21.518054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kgqcl_1bfb1e70-c87c-4d83-ae7c-067c2dba36c2/payload-pre-processing/0.log" Jun 06 21:00:21.607932 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:21.607899 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q7wz5_a71945f4-161f-4ff4-9e76-e72e1614d6ce/payload-processing/0.log" Jun 06 21:00:22.170913 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:22.170878 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tll9l_0c6d6275-d072-42ea-8635-256b99431c1d/kube-storage-version-migrator-operator/1.log" Jun 06 21:00:22.172445 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:22.172413 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tll9l_0c6d6275-d072-42ea-8635-256b99431c1d/kube-storage-version-migrator-operator/0.log" Jun 06 21:00:23.243536 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.243500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4jnxs_5f4a33e4-312c-4562-811d-e0ed1512715c/kube-multus/0.log" Jun 06 21:00:23.378237 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.378200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-jgjww_cbc6841b-017b-4246-8971-857d671e5f15/discovery/0.log" Jun 06 21:00:23.399847 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.399823 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54c798458-s9w8l_06e30aa4-eaeb-4f9a-9f09-3cca3af8459a/kube-auth-proxy/0.log" Jun 06 21:00:23.480149 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.480124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-kgqcl_1bfb1e70-c87c-4d83-ae7c-067c2dba36c2/payload-pre-processing/0.log" Jun 06 21:00:23.568498 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.568468 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-q7wz5_a71945f4-161f-4ff4-9e76-e72e1614d6ce/payload-processing/0.log" Jun 06 21:00:23.576674 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.576650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/kube-multus-additional-cni-plugins/0.log" Jun 06 21:00:23.595578 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.595557 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/egress-router-binary-copy/0.log" Jun 06 21:00:23.616145 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.616124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/cni-plugins/0.log" Jun 06 21:00:23.635595 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.635578 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/bond-cni-plugin/0.log" Jun 06 21:00:23.655552 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.655528 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/routeoverride-cni/0.log" Jun 06 21:00:23.675182 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.675161 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/whereabouts-cni-bincopy/0.log" Jun 06 21:00:23.693538 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.693518 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cq6gn_107990db-0354-4448-92be-6463717c5dae/whereabouts-cni/0.log" Jun 06 21:00:23.769535 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.769483 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8zgpn_b33ff57f-5718-4121-93ca-261066c392d0/network-metrics-daemon/0.log" Jun 06 21:00:23.785768 ip-10-0-131-207 kubenswrapper[2575]: I0606 21:00:23.785744 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8zgpn_b33ff57f-5718-4121-93ca-261066c392d0/kube-rbac-proxy/0.log"