Jul 06 19:09:35.572910 ip-10-0-129-72 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:09:36.018978 ip-10-0-129-72 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:09:36.018978 ip-10-0-129-72 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:09:36.018978 ip-10-0-129-72 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:09:36.018978 ip-10-0-129-72 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:09:36.018978 ip-10-0-129-72 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:09:36.022103 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.022009 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:09:36.027276 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027257 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.027276 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027275 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027279 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027283 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027286 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027289 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027291 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027295 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027298 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027302 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027304 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027307 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027309 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027312 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027314 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027317 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027319 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027322 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027324 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027328 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.027343 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027332 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027335 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027338 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027341 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027344 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027347 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027350 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027353 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027356 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027359 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027362 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027364 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027368 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027372 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027375 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027378 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027381 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027383 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027386 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027388 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.027807 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027391 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027393 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027396 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027398 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027401 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027403 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027406 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027408 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027410 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027413 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027415 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027418 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027421 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027424 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027427 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027430 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027433 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027436 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027438 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027440 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.028617 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027443 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027446 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027448 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027450 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027453 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027455 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027458 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027460 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027463 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027465 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027468 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027470 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027473 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027475 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027478 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027480 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027483 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027485 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027488 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.029115 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027490 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027492 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027495 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027497 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027500 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027503 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027506 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027509 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027512 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027514 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027517 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027519 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027521 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027524 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027527 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027529 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027533 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027536 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027539 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.029589 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.027542 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.030561 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030534 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030564 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030568 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030572 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030574 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030578 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030580 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030583 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030585 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030588 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030591 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030593 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030596 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030598 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.030595 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030601 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030604 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030607 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030609 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030612 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030614 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030617 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030619 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030622 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030625 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030627 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030630 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030633 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030635 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030638 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030640 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030642 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030645 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030647 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.030941 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030649 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030652 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030655 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030657 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030659 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030662 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030664 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030667 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030670 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030672 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030675 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030678 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030680 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030682 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030685 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030691 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030695 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030700 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030703 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030706 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.031397 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030708 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030710 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030713 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030715 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030718 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030721 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030724 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030726 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030729 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030731 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030733 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030736 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030738 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030740 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030743 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030746 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030750 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030754 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030757 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030760 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.031897 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030762 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030765 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030767 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030771 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030774 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030777 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030782 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030789 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030792 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030795 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030798 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030801 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030803 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030806 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030809 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030812 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030814 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030817 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030820 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.032379 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030822 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030824 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030827 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030829 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030832 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030834 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.030836 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031235 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031240 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031243 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031245 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031248 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031251 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031253 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031256 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031258 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031260 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031263 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031265 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.032874 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031268 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031272 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031274 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031277 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031280 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031283 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031285 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031288 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031290 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031293 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031296 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031298 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031300 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031303 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031305 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031308 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031310 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031313 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031315 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031318 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.033335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031320 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031322 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031325 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031327 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031329 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031332 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031335 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031337 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031339 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031342 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031344 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031346 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031349 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031352 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031355 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031358 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031360 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031363 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031366 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031368 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.033835 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031370 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031373 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031377 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031381 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031384 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031386 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031389 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031391 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031395 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031397 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031400 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031404 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031407 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031410 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031414 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031416 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031419 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031423 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031426 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.034353 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031428 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031431 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031434 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031437 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031439 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031443 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031446 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031450 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031453 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031455 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031458 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031462 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031465 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031467 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031470 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031472 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031475 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031477 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031480 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.034825 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031482 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031485 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031488 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031490 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031493 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031495 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031498 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031500 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.031502 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031590 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031598 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031605 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031609 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031614 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031617 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031625 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031629 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031632 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031636 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031639 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031643 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031646 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:09:36.035310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031648 2575 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031651 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031654 2575 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031658 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031660 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031665 2575 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031668 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031671 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031674 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031677 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031680 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031683 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031686 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031690 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031693 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031696 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031699 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031702 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031705 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031709 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031712 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031715 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031718 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031721 2575 flags.go:64] FLAG: --enable-server="true" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031726 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:09:36.035840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031731 2575 flags.go:64] FLAG: --event-burst="100" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031734 2575 flags.go:64] FLAG: --event-qps="50" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031736 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031740 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031744 2575 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031748 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031751 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031753 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031756 2575 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031759 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031762 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031766 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031769 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031772 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031774 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031777 2575 flags.go:64] FLAG: --feature-gates="" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031781 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031784 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031787 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031790 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031793 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031796 2575 flags.go:64] FLAG: --help="false" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031799 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031802 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:09:36.036438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031805 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031808 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031811 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031814 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031817 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031820 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031822 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031827 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031829 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031832 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031835 2575 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031838 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031842 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031845 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031847 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031850 2575 flags.go:64] FLAG: --lock-file="" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031853 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031856 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031859 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031864 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031867 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031870 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031872 2575 flags.go:64] FLAG: --logging-format="text" Jul 06 19:09:36.037068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031875 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031878 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031881 2575 flags.go:64] FLAG: --manifest-url="" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031883 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031887 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031890 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031894 2575 flags.go:64] FLAG: --max-pods="110" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031897 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031900 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031902 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031906 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031908 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031912 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031915 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031922 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031925 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031930 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031932 2575 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031935 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031941 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031944 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031948 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031951 2575 flags.go:64] FLAG: --port="10250" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031954 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:09:36.037671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031957 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c47a9866bbd9975" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031960 2575 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031963 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031966 2575 flags.go:64] FLAG: --register-node="true" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031969 2575 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031972 2575 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031975 2575 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031978 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031981 2575 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031985 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031988 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031991 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031994 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031996 2575 flags.go:64] FLAG: --runonce="false" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.031999 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032002 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032005 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032008 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032010 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032013 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032016 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032019 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032021 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032024 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032027 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032031 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:09:36.038245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032035 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032038 2575 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032041 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032047 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032050 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032053 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032058 2575 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032061 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032063 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032066 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032069 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032072 2575 flags.go:64] FLAG: --v="2" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032076 2575 flags.go:64] FLAG: --version="false" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032081 2575 flags.go:64] FLAG: --vmodule="" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032084 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.032088 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032214 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032218 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032222 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032225 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032228 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032231 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032233 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.038918 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032236 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032238 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032241 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032243 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032246 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032249 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032251 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032254 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032258 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032261 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032263 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032266 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032270 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032273 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032275 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032278 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032280 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032283 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032286 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032288 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.039539 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032291 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032293 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032296 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032300 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032304 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032307 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032309 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032312 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032314 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032317 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032319 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032321 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032324 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032326 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032329 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032332 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032334 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032336 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032339 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032341 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.040046 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032345 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032348 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032350 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032353 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032356 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032358 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032361 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032363 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032366 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032368 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032371 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032373 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032376 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032378 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032381 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032384 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032388 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032390 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032393 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.040520 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032397 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032400 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032403 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032406 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032410 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032412 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032415 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032417 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032419 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032422 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032424 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032427 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032429 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032432 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032435 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032437 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032440 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032443 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032446 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032448 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.041001 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032450 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032453 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032455 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032458 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032460 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032462 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032465 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032467 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032471 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032474 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032478 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032480 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.032482 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.041488 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.033313 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:09:36.042269 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.042245 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:09:36.042269 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.042269 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:09:36.043012 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.043001 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:09:36.043044 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.043012 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:09:36.043077 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043072 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.043077 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043077 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043081 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043084 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043086 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043089 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043092 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043095 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043098 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043101 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043103 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043106 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043109 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043112 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043114 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043118 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043122 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043125 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043128 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043131 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.043129 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043134 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043136 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043139 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043142 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043145 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043148 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043150 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043153 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043156 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043159 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043162 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043165 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043168 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043172 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043175 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043178 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043180 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043183 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043185 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.043609 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043188 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043190 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043192 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043195 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043197 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043200 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043203 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043205 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043207 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043210 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043212 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043215 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043217 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043220 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043223 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043226 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043229 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043231 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043234 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043238 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.044068 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043242 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043245 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043248 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043251 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043253 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043256 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043259 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043261 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043263 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043266 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043269 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043271 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043273 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043276 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043279 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043282 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043284 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043287 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043289 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.044566 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043291 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043294 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043296 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043299 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043301 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043303 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043306 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043309 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043311 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043314 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043317 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043319 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043322 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043324 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043327 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043330 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043332 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043336 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043338 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043340 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.045036 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043343 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.043348 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043465 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043471 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043474 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043476 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043479 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043481 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043485 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043487 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043490 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043493 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043495 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043498 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043501 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:09:36.045532 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043503 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043506 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043508 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043511 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043514 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043517 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043520 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043522 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043525 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043528 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043530 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043533 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043536 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043538 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043541 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043560 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043564 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043566 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043571 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:09:36.045916 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043575 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043578 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043581 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043583 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043586 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043589 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043592 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043595 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043598 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043601 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043604 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043607 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043610 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043613 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043616 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043618 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043621 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043624 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043626 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043629 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:09:36.046401 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043632 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043634 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043637 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043640 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043642 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043645 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043648 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043650 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043653 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043656 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043658 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043661 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043663 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043665 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043668 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043671 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043673 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043676 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043678 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:09:36.046888 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043681 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043685 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043688 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043691 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043694 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043697 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043699 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043702 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043705 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043707 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043709 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043712 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043714 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043717 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043719 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043723 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043726 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043729 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043731 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:09:36.047348 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043734 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043736 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043739 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043742 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043745 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043747 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043750 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043752 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:36.043755 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.043760 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.043890 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:09:36.047820 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.046279 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:09:36.048098 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.048075 2575 server.go:1019] "Starting client certificate rotation" Jul 06 19:09:36.048212 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.048191 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:09:36.048244 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.048238 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:09:36.050911 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.050897 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:09:36.052350 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.052332 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:09:36.062173 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.062156 2575 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:09:36.064296 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.064280 2575 log.go:25] "Validated CRI v1 image API" Jul 06 19:09:36.065173 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.065153 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:09:36.070179 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.070153 2575 fs.go:135] Filesystem UUIDs: map[02770297-a288-42c0-8100-5bbad08bf893:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9007263e-6b4e-45cd-84db-e96e594542b4:/dev/nvme0n1p3] Jul 06 19:09:36.070248 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.070174 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:09:36.076685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.076575 2575 manager.go:216] Machine: {Timestamp:2026-07-06 19:09:36.074834743 +0000 UTC m=+0.369626400 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102885 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8e13e11355c07390f6b54dcad33f SystemUUID:ec2a8e13-e113-55c0-7390-f6b54dcad33f BootID:366bf4bc-3bb1-48a0-89b6-0cd1c76b6da2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:9a:09:32:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:9a:09:32:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:d4:16:52:ef:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:09:36.076685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.076679 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:09:36.076811 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.076800 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:09:36.080414 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.080387 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:09:36.080577 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.080417 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:09:36.081758 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.081747 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:09:36.081796 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.081761 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:09:36.081796 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.081768 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:09:36.081796 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.081783 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:09:36.083485 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.083473 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:09:36.087756 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.087743 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:09:36.087886 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.087876 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:09:36.088748 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.088738 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:09:36.088779 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.088760 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:09:36.088779 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.088775 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:09:36.088863 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.088785 2575 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:09:36.088863 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.088793 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:09:36.089266 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.089254 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:09:36.089306 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.089274 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:09:36.093121 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.093102 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:09:36.095264 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.095248 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:09:36.095355 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.095286 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:09:36.096502 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096488 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:09:36.096594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096508 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:09:36.096594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096518 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:09:36.096594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096526 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:09:36.096594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096538 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:09:36.096594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096563 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096608 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096618 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096635 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096649 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096661 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:09:36.096785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.096670 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:09:36.097558 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.097529 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:09:36.097621 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.097561 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:09:36.098780 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.098753 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:09:36.100373 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.100351 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:09:36.100457 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.100403 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:09:36.100457 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.100429 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:09:36.101152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.101137 2575 server.go:1268] "Started kubelet" Jul 06 19:09:36.101270 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.101220 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:09:36.102098 ip-10-0-129-72 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:09:36.106322 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.105486 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:09:36.106498 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.106464 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:09:36.108469 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.108446 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:09:36.109974 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.109955 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:09:36.110254 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.110233 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:09:36.115034 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115020 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:09:36.115099 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115047 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:09:36.115268 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.115196 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.115717 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115700 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:09:36.115807 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115727 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:09:36.115807 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115739 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:09:36.115919 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115842 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:09:36.115919 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.115853 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:09:36.116788 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.116765 2575 factory.go:55] Registering systemd factory Jul 06 19:09:36.116788 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.116788 2575 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:09:36.117042 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117028 2575 factory.go:153] Registering CRI-O factory Jul 06 19:09:36.117103 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117045 2575 factory.go:223] Registration of the crio container factory successfully Jul 06 19:09:36.117151 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117141 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:09:36.117199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117168 2575 factory.go:103] Registering Raw factory Jul 06 19:09:36.117199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117185 2575 manager.go:1196] Started watching for new ooms in manager Jul 06 19:09:36.117615 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.117601 2575 manager.go:349] Starting recovery of all containers Jul 06 19:09:36.118990 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.118958 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:09:36.119163 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.119127 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:09:36.119672 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.118612 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff41604f73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.101052275 +0000 UTC m=+0.395843932,LastTimestamp:2026-07-06 19:09:36.101052275 +0000 UTC m=+0.395843932,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.128909 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.128889 2575 manager.go:354] Recovery completed Jul 06 19:09:36.134032 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.134019 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.136381 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136359 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.136432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136398 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.136432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136411 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.136950 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136928 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:09:36.136950 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136948 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:09:36.137029 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136967 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:09:36.137057 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.136949 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.138397 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.138386 2575 policy_none.go:49] "None policy: Start" Jul 06 19:09:36.138431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.138401 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:09:36.138431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.138411 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:09:36.139616 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.139606 2575 policy_none.go:47] "Start" Jul 06 19:09:36.142792 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.142741 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.142848 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.142831 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.142888 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.142856 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.144325 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.144220 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437b6851 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136382545 +0000 UTC m=+0.431174206,LastTimestamp:2026-07-06 19:09:36.136382545 +0000 UTC m=+0.431174206,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.159611 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.159497 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437bc28e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136405646 +0000 UTC m=+0.431197306,LastTimestamp:2026-07-06 19:09:36.136405646 +0000 UTC m=+0.431197306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.171187 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.171122 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437beca0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136416416 +0000 UTC m=+0.431208073,LastTimestamp:2026-07-06 19:09:36.136416416 +0000 UTC m=+0.431208073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.179122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179106 2575 manager.go:337] "Starting Device Plugin manager" Jul 06 19:09:36.179222 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.179207 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:09:36.179300 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179226 2575 server.go:87] "Starting device plugin registration server" Jul 06 19:09:36.179477 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179466 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:09:36.179514 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179478 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:09:36.179629 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179607 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:09:36.179722 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179699 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:09:36.179722 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.179708 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:09:36.180219 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.180200 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:09:36.180284 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.180254 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.183434 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.183342 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-72.ec2.internal.18bfc8ff437b6851\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437b6851 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136382545 +0000 UTC m=+0.431174206,LastTimestamp:2026-07-06 19:09:36.142812169 +0000 UTC m=+0.437603830,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.195437 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.195364 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-72.ec2.internal.18bfc8ff437bc28e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437bc28e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136405646 +0000 UTC m=+0.431197306,LastTimestamp:2026-07-06 19:09:36.142839209 +0000 UTC m=+0.437630873,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.208727 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.208658 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-72.ec2.internal.18bfc8ff437beca0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff437beca0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-72.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.136416416 +0000 UTC m=+0.431208073,LastTimestamp:2026-07-06 19:09:36.142862515 +0000 UTC m=+0.437654174,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.215665 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.215638 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krd9w" Jul 06 19:09:36.230927 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.230825 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-72.ec2.internal.18bfc8ff4627ff52 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-72.ec2.internal,UID:ip-10-0-129-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-129-72.ec2.internal,},FirstTimestamp:2026-07-06 19:09:36.181247826 +0000 UTC m=+0.476039471,LastTimestamp:2026-07-06 19:09:36.181247826 +0000 UTC m=+0.476039471,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-72.ec2.internal,}" Jul 06 19:09:36.233234 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.233216 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krd9w" Jul 06 19:09:36.279922 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.279854 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.280908 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.280878 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.281009 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.280915 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.281009 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.280931 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.281009 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.280972 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.300384 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.300355 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.300384 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.300380 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-72.ec2.internal\": node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.320648 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.320625 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.321484 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.321452 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:09:36.322919 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.322899 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:09:36.322992 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.322934 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:09:36.322992 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.322954 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:09:36.322992 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.322984 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:09:36.325038 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.325023 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:09:36.420958 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.420911 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.424010 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.423993 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal"] Jul 06 19:09:36.424091 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.424081 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.425860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.425840 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.425929 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.425885 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.425929 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.425898 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.427456 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.427443 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.427568 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.427541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.427608 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.427582 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.428208 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428195 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.428257 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428218 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.428257 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428227 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.428257 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428201 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.428355 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428256 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.428355 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.428282 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.429476 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.429463 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.429531 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.429484 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:36.430112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.430096 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:36.430189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.430122 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:36.430189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.430132 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:36.452437 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.452404 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-72.ec2.internal\" not found" node="ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.456946 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.456921 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-72.ec2.internal\" not found" node="ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.516900 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.516869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.516900 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.516900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.517077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.516918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd71acd86f617aec832f721e4495c874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-72.ec2.internal\" (UID: \"bd71acd86f617aec832f721e4495c874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.521886 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.521868 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.618030 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.618132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd71acd86f617aec832f721e4495c874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-72.ec2.internal\" (UID: \"bd71acd86f617aec832f721e4495c874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.618132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.618132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618109 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.618252 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd71acd86f617aec832f721e4495c874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-72.ec2.internal\" (UID: \"bd71acd86f617aec832f721e4495c874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.618252 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.618140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79c0e52abe3c24ef04b60066dfc2041a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal\" (UID: \"79c0e52abe3c24ef04b60066dfc2041a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.622471 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.622445 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.722569 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.722500 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.757982 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.757926 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.760973 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:36.760939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:36.823035 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.822988 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:36.924035 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:36.923962 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.024499 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.024464 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.047765 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.047717 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:09:37.047963 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.047919 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:09:37.125280 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.125247 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.214418 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.214385 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:09:37.226039 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.225996 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.235398 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.235356 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:04:36 +0000 UTC" deadline="2028-04-17 00:16:15.262367294 +0000 UTC" Jul 06 19:09:37.235398 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.235394 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15605h6m38.026976769s" Jul 06 19:09:37.306130 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:37.306100 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c0e52abe3c24ef04b60066dfc2041a.slice/crio-a8778b5f847b4e9474055ea651469003f8a623bee9fc1fa2d9cee7a70e38ef6c WatchSource:0}: Error finding container a8778b5f847b4e9474055ea651469003f8a623bee9fc1fa2d9cee7a70e38ef6c: Status 404 returned error can't find the container with id a8778b5f847b4e9474055ea651469003f8a623bee9fc1fa2d9cee7a70e38ef6c Jul 06 19:09:37.306463 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:37.306446 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd71acd86f617aec832f721e4495c874.slice/crio-f654d2f98f188ad79ab0274476357e68e148d78765d81cf3baa8bceb91f5acd8 WatchSource:0}: Error finding container f654d2f98f188ad79ab0274476357e68e148d78765d81cf3baa8bceb91f5acd8: Status 404 returned error can't find the container with id f654d2f98f188ad79ab0274476357e68e148d78765d81cf3baa8bceb91f5acd8 Jul 06 19:09:37.314861 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.314843 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:09:37.326097 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.326077 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.326194 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.326094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" event={"ID":"79c0e52abe3c24ef04b60066dfc2041a","Type":"ContainerStarted","Data":"a8778b5f847b4e9474055ea651469003f8a623bee9fc1fa2d9cee7a70e38ef6c"} Jul 06 19:09:37.327135 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.327112 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" event={"ID":"bd71acd86f617aec832f721e4495c874","Type":"ContainerStarted","Data":"f654d2f98f188ad79ab0274476357e68e148d78765d81cf3baa8bceb91f5acd8"} Jul 06 19:09:37.352532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.352501 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:09:37.353564 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.353543 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:09:37.353649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.353594 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:09:37.353649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.353610 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:09:37.426568 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.426510 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.527206 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:37.527134 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-72.ec2.internal\" not found" Jul 06 19:09:37.542065 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.542036 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:09:37.542210 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.542154 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:09:37.616785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.616732 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" Jul 06 19:09:37.624352 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.624324 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:09:37.625910 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.625893 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" Jul 06 19:09:37.635129 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:37.635102 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:09:38.057617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.057325 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:09:38.089608 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.089570 2575 apiserver.go:52] "Watching apiserver" Jul 06 19:09:38.097542 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.097509 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:09:38.101981 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.101508 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fjldf","kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s","openshift-cluster-node-tuning-operator/tuned-c59zd","openshift-image-registry/node-ca-mlrrb","openshift-multus/network-metrics-daemon-j26gh","openshift-network-operator/iptables-alerter-t59jq","openshift-ovn-kubernetes/ovnkube-node-j44lf","kube-system/global-pull-secret-syncer-j8dkw","openshift-dns/node-resolver-4wwtf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-75s6d","openshift-multus/multus-gf6kz","openshift-network-diagnostics/network-check-target-t5j4j"] Jul 06 19:09:38.104227 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.103484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.105312 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.105289 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.106676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.106215 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.106676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.106345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:09:38.107064 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.106911 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dpwdb\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.107337 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.107855 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.107929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.108093 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.108161 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.108413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.108359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fpcgn\"" Jul 06 19:09:38.110560 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.109577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.111294 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.111274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.111518 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.111472 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.111818 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.111800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:09:38.111901 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.111819 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4t98n\"" Jul 06 19:09:38.112084 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.112065 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.112991 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.112969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.115382 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.113492 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8pksp\"" Jul 06 19:09:38.115382 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.113647 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.115382 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.113695 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.115382 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.114963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.115382 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.115023 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:38.116002 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.115468 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tw488\"" Jul 06 19:09:38.116002 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.115657 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.116002 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.115841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.116158 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.116043 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:09:38.116593 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.116230 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:09:38.117150 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.117125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.117253 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.117192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:38.119664 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.119642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.122330 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.122306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:09:38.122791 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.122669 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hk2jv\"" Jul 06 19:09:38.122791 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.122680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:09:38.122791 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.122687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:38.122791 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.122780 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:38.124229 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.124210 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.127944 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.126852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.128724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-k8s-cni-cncf-io\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smttp\" (UniqueName: \"kubernetes.io/projected/69bc136b-e47c-49a2-9fab-d87688054f05-kube-api-access-smttp\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-device-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs5jk\" (UniqueName: \"kubernetes.io/projected/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kube-api-access-xs5jk\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e048939e-fb58-4502-897b-0f63d2ef0399-host-slash\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-tmp\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755w4\" (UniqueName: \"kubernetes.io/projected/a2331e94-f16f-4dfd-8c88-eecc20675809-kube-api-access-755w4\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-bin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-conf-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.129262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-etc-kubernetes\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/e048939e-fb58-4502-897b-0f63d2ef0399-kube-api-access-xnrtq\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74pnz\" (UniqueName: \"kubernetes.io/projected/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-kube-api-access-74pnz\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-cnibin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-os-release\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-socket-dir-parent\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-netns\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-hostroot\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129615 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-multus-daemon-config\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-kubelet-config\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-conf\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130122 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-host\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-multus\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129804 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129829 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e048939e-fb58-4502-897b-0f63d2ef0399-iptables-alerter-script\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-systemd\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-lib-modules\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2331e94-f16f-4dfd-8c88-eecc20675809-serviceca\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-system-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.129979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-modprobe-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-kubernetes\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-var-lib-kubelet\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-dbus\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysconfig\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-sys\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2331e94-f16f-4dfd-8c88-eecc20675809-host\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.130913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-cni-binary-copy\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-kubelet\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-multus-certs\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-run\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-tuned\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.131674 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.130353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2f7q\" (UniqueName: \"kubernetes.io/projected/7682152a-9bff-4bbe-ba36-319c9ffb818f-kube-api-access-d2f7q\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.133074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.132073 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:09:38.133074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.132228 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.133074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.132304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.133074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.132395 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g9k42\"" Jul 06 19:09:38.138649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.136943 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cb7hv\"" Jul 06 19:09:38.138649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.137257 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:09:38.138649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.138265 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.139165 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.139443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.139917 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.141070 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.141227 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vl4lx\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.141435 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:09:38.142125 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.141784 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:09:38.150894 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.150776 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fd8s" Jul 06 19:09:38.159089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.159062 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fd8s" Jul 06 19:09:38.217422 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.217396 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:09:38.231196 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-sys\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.231351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-netd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.231351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovn-node-metrics-cert\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.231351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvj7\" (UniqueName: \"kubernetes.io/projected/891831f0-71eb-463d-90ea-a0bb8fc75a57-kube-api-access-rpvj7\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.231351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.231351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-kubelet\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231352 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-sys\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-env-overrides\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r62rs\" (UniqueName: \"kubernetes.io/projected/b32ecc89-69fb-4092-8d44-5990819e70e7-kube-api-access-r62rs\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smttp\" (UniqueName: \"kubernetes.io/projected/69bc136b-e47c-49a2-9fab-d87688054f05-kube-api-access-smttp\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs5jk\" (UniqueName: \"kubernetes.io/projected/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kube-api-access-xs5jk\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-tmp\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755w4\" (UniqueName: \"kubernetes.io/projected/a2331e94-f16f-4dfd-8c88-eecc20675809-kube-api-access-755w4\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.231659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-kubelet\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-ovn\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-bin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-conf-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74pnz\" (UniqueName: \"kubernetes.io/projected/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-kube-api-access-74pnz\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-node-log\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-system-cni-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.231973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-cnibin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-netns\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-hostroot\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56s6x\" (UniqueName: \"kubernetes.io/projected/7a879ec8-725e-4b58-ac3d-81937681ef12-kube-api-access-56s6x\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-multus-daemon-config\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-kubelet-config\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-conf\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-config\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-os-release\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e048939e-fb58-4502-897b-0f63d2ef0399-iptables-alerter-script\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2331e94-f16f-4dfd-8c88-eecc20675809-serviceca\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-log-socket\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a879ec8-725e-4b58-ac3d-81937681ef12-tmp-dir\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-system-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232618 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-modprobe-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.232685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysconfig\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2331e94-f16f-4dfd-8c88-eecc20675809-host\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-agent-certs\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-var-lib-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-cni-binary-copy\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-multus-certs\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-multus-certs\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-run\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-tuned\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.232985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2f7q\" (UniqueName: \"kubernetes.io/projected/7682152a-9bff-4bbe-ba36-319c9ffb818f-kube-api-access-d2f7q\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-systemd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233043 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-k8s-cni-cncf-io\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-device-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-kubelet\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.233348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e048939e-fb58-4502-897b-0f63d2ef0399-host-slash\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-bin\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-etc-kubernetes\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-sys-fs\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233425 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-etc-kubernetes\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/e048939e-fb58-4502-897b-0f63d2ef0399-kube-api-access-xnrtq\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-slash\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233479 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-cnibin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-etc-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-netns\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233549 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-hostroot\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-host\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-os-release\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-registration-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-socket-dir-parent\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234184 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-netns\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-os-release\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-cnibin\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233717 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-bin\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233754 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-conf-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a879ec8-725e-4b58-ac3d-81937681ef12-hosts-file\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-system-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-multus\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-systemd\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-lib-modules\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233927 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-modprobe-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-script-lib\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.233984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-lib-modules\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.234896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-kubernetes\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-var-lib-kubelet\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-kubernetes\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-konnectivity-ca\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-var-lib-kubelet\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-systemd-units\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysconfig\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2331e94-f16f-4dfd-8c88-eecc20675809-host\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234328 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-d\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234836 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-multus-daemon-config\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69bc136b-e47c-49a2-9fab-d87688054f05-cni-binary-copy\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-run-k8s-cni-cncf-io\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-run\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-device-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.235070 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-sysctl-conf\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.235301 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:09:38.235613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.235432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e048939e-fb58-4502-897b-0f63d2ef0399-iptables-alerter-script\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.236497 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.235834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2331e94-f16f-4dfd-8c88-eecc20675809-serviceca\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.236497 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.235929 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:38.236497 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.236005 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:09:38.735983686 +0000 UTC m=+3.030775336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:38.236918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.236748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-socket-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.236918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.236840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-socket-dir-parent\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.237071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.236934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-multus-cni-dir\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.237071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.236982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69bc136b-e47c-49a2-9fab-d87688054f05-host-var-lib-cni-multus\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.237071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.237250 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237102 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.237250 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-dbus\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.237356 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-dbus\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.237424 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237392 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-systemd\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.237482 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237455 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.237538 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.237507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e048939e-fb58-4502-897b-0f63d2ef0399-host-slash\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.238373 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.238347 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:38.238475 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.238407 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:38.738389281 +0000 UTC m=+3.033180927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:38.238610 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.234929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98a4ad15-afb7-488b-b93a-45db89cf7d44-kubelet-config\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.238610 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.238488 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-host\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.241181 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.240792 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-etc-tuned\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.241181 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.241031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-tmp\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.243411 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.243386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74pnz\" (UniqueName: \"kubernetes.io/projected/a3aaa0c7-7b15-43f2-9cfc-090df2588c59-kube-api-access-74pnz\") pod \"tuned-c59zd\" (UID: \"a3aaa0c7-7b15-43f2-9cfc-090df2588c59\") " pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.245520 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.245495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs5jk\" (UniqueName: \"kubernetes.io/projected/c8c9c955-8d58-45f4-ad8c-e82fce23b5c3-kube-api-access-xs5jk\") pod \"aws-ebs-csi-driver-node-dbg7s\" (UID: \"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.246879 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.246849 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smttp\" (UniqueName: \"kubernetes.io/projected/69bc136b-e47c-49a2-9fab-d87688054f05-kube-api-access-smttp\") pod \"multus-gf6kz\" (UID: \"69bc136b-e47c-49a2-9fab-d87688054f05\") " pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.248019 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.247521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2f7q\" (UniqueName: \"kubernetes.io/projected/7682152a-9bff-4bbe-ba36-319c9ffb818f-kube-api-access-d2f7q\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.249579 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.249145 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-755w4\" (UniqueName: \"kubernetes.io/projected/a2331e94-f16f-4dfd-8c88-eecc20675809-kube-api-access-755w4\") pod \"node-ca-mlrrb\" (UID: \"a2331e94-f16f-4dfd-8c88-eecc20675809\") " pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.249579 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.249539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrtq\" (UniqueName: \"kubernetes.io/projected/e048939e-fb58-4502-897b-0f63d2ef0399-kube-api-access-xnrtq\") pod \"iptables-alerter-t59jq\" (UID: \"e048939e-fb58-4502-897b-0f63d2ef0399\") " pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.337521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-netns\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.337521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-cnibin\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a879ec8-725e-4b58-ac3d-81937681ef12-hosts-file\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-script-lib\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-konnectivity-ca\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-systemd-units\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.337773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-netd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovn-node-metrics-cert\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvj7\" (UniqueName: \"kubernetes.io/projected/891831f0-71eb-463d-90ea-a0bb8fc75a57-kube-api-access-rpvj7\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-env-overrides\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r62rs\" (UniqueName: \"kubernetes.io/projected/b32ecc89-69fb-4092-8d44-5990819e70e7-kube-api-access-r62rs\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-kubelet\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.337973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-ovn\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-node-log\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-system-cni-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56s6x\" (UniqueName: \"kubernetes.io/projected/7a879ec8-725e-4b58-ac3d-81937681ef12-kube-api-access-56s6x\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.338152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-config\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-os-release\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-log-socket\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a879ec8-725e-4b58-ac3d-81937681ef12-tmp-dir\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338275 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-agent-certs\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-var-lib-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-systemd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-bin\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-slash\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-etc-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.338883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.338480 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-cnibin\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.339478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339109 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-konnectivity-ca\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.339478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-systemd-units\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339213 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-netd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.339863 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-env-overrides\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a879ec8-725e-4b58-ac3d-81937681ef12-tmp-dir\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-run-netns\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339941 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-system-cni-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-slash\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.339989 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-node-log\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340327 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.339994 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-ovn\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340327 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340327 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-var-lib-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340340 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-os-release\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.340487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340369 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.340487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340417 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-run-systemd\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340534 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-config\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b32ecc89-69fb-4092-8d44-5990819e70e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.340676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-cni-bin\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340828 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340673 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-host-kubelet\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340828 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340719 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-etc-openvswitch\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340828 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/891831f0-71eb-463d-90ea-a0bb8fc75a57-log-socket\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.340828 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.340815 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a879ec8-725e-4b58-ac3d-81937681ef12-hosts-file\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.341035 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.341008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b32ecc89-69fb-4092-8d44-5990819e70e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.341291 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.341268 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovnkube-script-lib\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.342082 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.342057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/891831f0-71eb-463d-90ea-a0bb8fc75a57-ovn-node-metrics-cert\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.342910 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.342888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ea508f2b-2a9e-410b-8e7b-1e119197a9a1-agent-certs\") pod \"konnectivity-agent-fjldf\" (UID: \"ea508f2b-2a9e-410b-8e7b-1e119197a9a1\") " pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.343836 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.343815 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:38.343931 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.343844 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:38.343931 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.343858 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:38.343931 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.343926 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:38.843908343 +0000 UTC m=+3.138700007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:38.348231 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.348199 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvj7\" (UniqueName: \"kubernetes.io/projected/891831f0-71eb-463d-90ea-a0bb8fc75a57-kube-api-access-rpvj7\") pod \"ovnkube-node-j44lf\" (UID: \"891831f0-71eb-463d-90ea-a0bb8fc75a57\") " pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.348367 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.348328 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56s6x\" (UniqueName: \"kubernetes.io/projected/7a879ec8-725e-4b58-ac3d-81937681ef12-kube-api-access-56s6x\") pod \"node-resolver-4wwtf\" (UID: \"7a879ec8-725e-4b58-ac3d-81937681ef12\") " pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.348762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.348743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r62rs\" (UniqueName: \"kubernetes.io/projected/b32ecc89-69fb-4092-8d44-5990819e70e7-kube-api-access-r62rs\") pod \"multus-additional-cni-plugins-75s6d\" (UID: \"b32ecc89-69fb-4092-8d44-5990819e70e7\") " pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.422761 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.422625 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t59jq" Jul 06 19:09:38.431798 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.431768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gf6kz" Jul 06 19:09:38.433136 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:38.433103 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode048939e_fb58_4502_897b_0f63d2ef0399.slice/crio-ead0b654283dcd9ceae8c9e606af3dbe32126e28c20326fd390f429bdddf1949 WatchSource:0}: Error finding container ead0b654283dcd9ceae8c9e606af3dbe32126e28c20326fd390f429bdddf1949: Status 404 returned error can't find the container with id ead0b654283dcd9ceae8c9e606af3dbe32126e28c20326fd390f429bdddf1949 Jul 06 19:09:38.444989 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:38.444953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bc136b_e47c_49a2_9fab_d87688054f05.slice/crio-366e5f8fdbdc5e0ad376870b27e2aadf46127b58053daf4a77d6491ba78b9483 WatchSource:0}: Error finding container 366e5f8fdbdc5e0ad376870b27e2aadf46127b58053daf4a77d6491ba78b9483: Status 404 returned error can't find the container with id 366e5f8fdbdc5e0ad376870b27e2aadf46127b58053daf4a77d6491ba78b9483 Jul 06 19:09:38.448159 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.448100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" Jul 06 19:09:38.455428 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.455399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c59zd" Jul 06 19:09:38.462515 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:38.462479 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c9c955_8d58_45f4_ad8c_e82fce23b5c3.slice/crio-906bc35e9a206c60903ae8075c092d23b9498b2c0fa93b42410decc019c73051 WatchSource:0}: Error finding container 906bc35e9a206c60903ae8075c092d23b9498b2c0fa93b42410decc019c73051: Status 404 returned error can't find the container with id 906bc35e9a206c60903ae8075c092d23b9498b2c0fa93b42410decc019c73051 Jul 06 19:09:38.463904 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.463694 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlrrb" Jul 06 19:09:38.467074 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:38.467036 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3aaa0c7_7b15_43f2_9cfc_090df2588c59.slice/crio-01fb65e6b6062af9e693b826e5c3478e142a6d0a31a5a7da0c55ce8a12ae203c WatchSource:0}: Error finding container 01fb65e6b6062af9e693b826e5c3478e142a6d0a31a5a7da0c55ce8a12ae203c: Status 404 returned error can't find the container with id 01fb65e6b6062af9e693b826e5c3478e142a6d0a31a5a7da0c55ce8a12ae203c Jul 06 19:09:38.471832 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.471802 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:09:38.491334 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.491300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wwtf" Jul 06 19:09:38.497743 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.497712 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:09:38.504094 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.504066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-75s6d" Jul 06 19:09:38.742850 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.742760 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:38.742850 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.742818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:38.743050 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.742942 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:38.743050 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.743009 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:09:39.742990499 +0000 UTC m=+4.037782147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:38.743050 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.742943 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:38.743050 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.743044 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:39.743037519 +0000 UTC m=+4.037829164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:38.944049 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:38.944005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:38.944246 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.944187 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:38.944246 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.944211 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:38.944246 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.944226 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:38.944381 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:38.944290 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:39.944272995 +0000 UTC m=+4.239064644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:39.162589 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.162469 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:04:38 +0000 UTC" deadline="2027-12-22 08:10:28.377037329 +0000 UTC" Jul 06 19:09:39.162589 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.162514 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12805h0m49.214529024s" Jul 06 19:09:39.323443 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.323404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:39.323700 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.323545 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:39.324026 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.324004 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:39.324159 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.324133 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:39.331565 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.331494 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c59zd" event={"ID":"a3aaa0c7-7b15-43f2-9cfc-090df2588c59","Type":"ContainerStarted","Data":"01fb65e6b6062af9e693b826e5c3478e142a6d0a31a5a7da0c55ce8a12ae203c"} Jul 06 19:09:39.334085 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.334017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" event={"ID":"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3","Type":"ContainerStarted","Data":"906bc35e9a206c60903ae8075c092d23b9498b2c0fa93b42410decc019c73051"} Jul 06 19:09:39.335753 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.335720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gf6kz" event={"ID":"69bc136b-e47c-49a2-9fab-d87688054f05","Type":"ContainerStarted","Data":"366e5f8fdbdc5e0ad376870b27e2aadf46127b58053daf4a77d6491ba78b9483"} Jul 06 19:09:39.337404 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.337378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t59jq" event={"ID":"e048939e-fb58-4502-897b-0f63d2ef0399","Type":"ContainerStarted","Data":"ead0b654283dcd9ceae8c9e606af3dbe32126e28c20326fd390f429bdddf1949"} Jul 06 19:09:39.732789 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:39.732733 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea508f2b_2a9e_410b_8e7b_1e119197a9a1.slice/crio-7d8166ebc924f5cf64b7dc3c3c070608a05e9de4f2f98fe0cdb193f441ee197f WatchSource:0}: Error finding container 7d8166ebc924f5cf64b7dc3c3c070608a05e9de4f2f98fe0cdb193f441ee197f: Status 404 returned error can't find the container with id 7d8166ebc924f5cf64b7dc3c3c070608a05e9de4f2f98fe0cdb193f441ee197f Jul 06 19:09:39.735429 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:39.735404 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a879ec8_725e_4b58_ac3d_81937681ef12.slice/crio-f2a786a8b400029e6da82c3241e8bfe5ae1d56379b0f4069e9c35145bbff9af3 WatchSource:0}: Error finding container f2a786a8b400029e6da82c3241e8bfe5ae1d56379b0f4069e9c35145bbff9af3: Status 404 returned error can't find the container with id f2a786a8b400029e6da82c3241e8bfe5ae1d56379b0f4069e9c35145bbff9af3 Jul 06 19:09:39.738146 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:39.738087 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2331e94_f16f_4dfd_8c88_eecc20675809.slice/crio-176dee3e85586bac65c6de1ca016a21803e916108d6ba2513da0981464e1653f WatchSource:0}: Error finding container 176dee3e85586bac65c6de1ca016a21803e916108d6ba2513da0981464e1653f: Status 404 returned error can't find the container with id 176dee3e85586bac65c6de1ca016a21803e916108d6ba2513da0981464e1653f Jul 06 19:09:39.748345 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:09:39.748314 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32ecc89_69fb_4092_8d44_5990819e70e7.slice/crio-9fe1ebe9a1d5e765e35c32e52803c3dffc3d6dd6618f2eaf2d5d766ad7ea6f36 WatchSource:0}: Error finding container 9fe1ebe9a1d5e765e35c32e52803c3dffc3d6dd6618f2eaf2d5d766ad7ea6f36: Status 404 returned error can't find the container with id 9fe1ebe9a1d5e765e35c32e52803c3dffc3d6dd6618f2eaf2d5d766ad7ea6f36 Jul 06 19:09:39.751764 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.751682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:39.751764 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.751740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:39.751896 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.751868 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:39.751896 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.751876 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:39.751977 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.751933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:09:41.751910553 +0000 UTC m=+6.046702209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:39.751977 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.751956 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:41.751945018 +0000 UTC m=+6.046736670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:39.953919 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:39.953277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:39.953919 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.953423 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:39.953919 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.953440 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:39.953919 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.953464 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:39.953919 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:39.953528 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:41.953509119 +0000 UTC m=+6.248300778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:40.163606 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.163494 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:04:38 +0000 UTC" deadline="2028-03-15 09:56:11.25149116 +0000 UTC" Jul 06 19:09:40.163606 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.163541 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14822h46m31.087955688s" Jul 06 19:09:40.324180 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.324141 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:40.324379 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:40.324290 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:40.356533 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.354576 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" event={"ID":"bd71acd86f617aec832f721e4495c874","Type":"ContainerStarted","Data":"5dcf09c75307e6b65fbc295f3a6e480703aacc4038f0340c1b1be6e7756b18d1"} Jul 06 19:09:40.368929 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.368887 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerStarted","Data":"9fe1ebe9a1d5e765e35c32e52803c3dffc3d6dd6618f2eaf2d5d766ad7ea6f36"} Jul 06 19:09:40.372270 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.372170 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-72.ec2.internal" podStartSLOduration=2.37213098 podStartE2EDuration="2.37213098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:40.369481846 +0000 UTC m=+4.664273519" watchObservedRunningTime="2026-07-06 19:09:40.37213098 +0000 UTC m=+4.666922650" Jul 06 19:09:40.375255 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.375213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlrrb" event={"ID":"a2331e94-f16f-4dfd-8c88-eecc20675809","Type":"ContainerStarted","Data":"176dee3e85586bac65c6de1ca016a21803e916108d6ba2513da0981464e1653f"} Jul 06 19:09:40.394823 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.394779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"05d8bb1edddb4c1c4dcab67ae7fabb33ed1d3dd5e4e6257202df0eed825097c5"} Jul 06 19:09:40.398792 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.398755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wwtf" event={"ID":"7a879ec8-725e-4b58-ac3d-81937681ef12","Type":"ContainerStarted","Data":"f2a786a8b400029e6da82c3241e8bfe5ae1d56379b0f4069e9c35145bbff9af3"} Jul 06 19:09:40.414594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:40.414480 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjldf" event={"ID":"ea508f2b-2a9e-410b-8e7b-1e119197a9a1","Type":"ContainerStarted","Data":"7d8166ebc924f5cf64b7dc3c3c070608a05e9de4f2f98fe0cdb193f441ee197f"} Jul 06 19:09:41.323602 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.323548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:41.323602 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.323619 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:41.324190 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.323735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:41.324253 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.324224 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:41.422587 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.421516 2575 generic.go:356] "Generic (PLEG): container finished" podID="79c0e52abe3c24ef04b60066dfc2041a" containerID="4feb5a4f780426b1ce60c0518ad493d262f250640e82c67801d362b4ba27b221" exitCode=0 Jul 06 19:09:41.422587 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.422528 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" event={"ID":"79c0e52abe3c24ef04b60066dfc2041a","Type":"ContainerDied","Data":"4feb5a4f780426b1ce60c0518ad493d262f250640e82c67801d362b4ba27b221"} Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.772866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.772971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.773137 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.773206 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.773185902 +0000 UTC m=+10.067977572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.773273 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:41.773718 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.773310 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.773297747 +0000 UTC m=+10.068089392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:41.974365 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:41.974269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:41.974525 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.974487 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:41.974525 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.974513 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:41.974673 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.974527 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:41.974673 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:41.974611 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:45.974572731 +0000 UTC m=+10.269364391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:42.325643 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:42.325544 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:42.326104 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:42.325676 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:42.435662 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:42.435621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" event={"ID":"79c0e52abe3c24ef04b60066dfc2041a","Type":"ContainerStarted","Data":"fa43ec429351597b3e372c5df1f48bc9dce82ce123bf6d188ea13e6b88644b21"} Jul 06 19:09:43.323912 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:43.323874 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:43.324129 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:43.324027 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:43.324129 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:43.324096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:43.324263 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:43.324197 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:44.324134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:44.324092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:44.324628 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:44.324242 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:45.324061 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:45.324017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:45.324275 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:45.324066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:45.324275 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.324179 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:45.324763 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.324327 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:45.809041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:45.809113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.809218 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.809269 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.809304 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:09:53.80928106 +0000 UTC m=+18.104072720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:45.809409 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:45.809329 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:53.809312136 +0000 UTC m=+18.104103809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:46.011699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:46.011129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:46.011699 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:46.011334 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:46.011699 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:46.011353 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:46.011699 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:46.011363 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:46.011699 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:46.011412 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:09:54.011397764 +0000 UTC m=+18.306189409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:46.324189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:46.324146 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:46.324360 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:46.324266 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:47.324219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:47.323715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:47.324219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:47.323760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:47.324219 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:47.323873 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:47.324219 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:47.324012 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:48.323663 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:48.323580 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:48.323830 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:48.323716 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:49.323425 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:49.323386 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:49.323904 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:49.323397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:49.323904 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:49.323561 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:49.323904 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:49.323588 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:50.326798 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:50.326762 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:50.327237 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:50.326892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:51.323494 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:51.323295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:51.323709 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:51.323296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:51.323709 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:51.323611 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:51.323709 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:51.323682 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:52.325695 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:52.325659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:52.326104 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:52.325779 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:53.323407 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:53.323367 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:53.323407 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:53.323393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:53.323648 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.323506 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:53.323648 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.323631 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:53.873253 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:53.873217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:53.873682 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:53.873273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:53.873682 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.873366 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:53.873682 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.873381 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:53.873682 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.873444 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:10:09.873423983 +0000 UTC m=+34.168215650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:09:53.873682 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:53.873462 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:09.873454308 +0000 UTC m=+34.168245981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:09:54.075090 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:54.075054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:54.075269 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:54.075216 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:09:54.075269 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:54.075239 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:09:54.075269 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:54.075250 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:54.075418 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:54.075314 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:10.075294051 +0000 UTC m=+34.370085716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:09:54.324113 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:54.324032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:54.324264 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:54.324161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:55.323487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:55.323445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:55.323974 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:55.323444 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:55.323974 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:55.323625 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:55.323974 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:55.323725 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:56.326230 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:56.326200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:56.326648 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:56.326314 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:57.323206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:57.323157 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:57.323492 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:57.323212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:57.323492 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:57.323310 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:57.323492 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:57.323464 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:58.323120 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:58.323078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:09:58.323639 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:58.323191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:09:59.323499 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.323291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:09:59.324325 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.323339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:09:59.324325 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:59.323659 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:09:59.324325 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:09:59.323799 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:09:59.471034 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.470933 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="082f2d65a0124930f03db45fec95cb33e32ce2594bd8cce6f5587d239ccc424f" exitCode=0 Jul 06 19:09:59.471034 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.471009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"082f2d65a0124930f03db45fec95cb33e32ce2594bd8cce6f5587d239ccc424f"} Jul 06 19:09:59.473708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.473400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlrrb" event={"ID":"a2331e94-f16f-4dfd-8c88-eecc20675809","Type":"ContainerStarted","Data":"867bb92437003c083a2a9485e87999fa2183887106b6879f748a04610288309d"} Jul 06 19:09:59.478372 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.478353 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:09:59.478769 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.478744 2575 generic.go:356] "Generic (PLEG): container finished" podID="891831f0-71eb-463d-90ea-a0bb8fc75a57" containerID="3f70ef2315dad5c9d9bf798cd563aa6a2d96c6fb0cd0c7a33debf8aa5d24c64f" exitCode=1 Jul 06 19:09:59.478856 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.478838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"ba50040e1ea66666fd212c0d0900b8420e679f44b45657c973de1b6e367351a8"} Jul 06 19:09:59.478941 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.478925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"862d63d1f54be9758c28e135a9c7846dbaa07b60583e886fd2691a1c5f189c9d"} Jul 06 19:09:59.478994 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.478981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"563c97c0be9cd701776c90eac9ff438703fe0653d17a644d571b85a4d9720495"} Jul 06 19:09:59.479040 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.479023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"33bdecfc6baf57d6e42a5491f40286cdeaee3157d797f3d6a0f60a9cff2e9b08"} Jul 06 19:09:59.479078 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.479064 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerDied","Data":"3f70ef2315dad5c9d9bf798cd563aa6a2d96c6fb0cd0c7a33debf8aa5d24c64f"} Jul 06 19:09:59.479120 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.479110 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"7c5de8e69615b552d029af7d6347e2aa8b8108fff71b1922b1cdb7e90e64e86f"} Jul 06 19:09:59.480371 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.480349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c59zd" event={"ID":"a3aaa0c7-7b15-43f2-9cfc-090df2588c59","Type":"ContainerStarted","Data":"ff21643f9ff58b74a055ef072178ff298a0caeadddef8b8c913fc63e50337cac"} Jul 06 19:09:59.482082 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.482051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" event={"ID":"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3","Type":"ContainerStarted","Data":"af26a849e5b76710e039f1372f1889ef8a3ffd277a42513e7b19c7072e640f05"} Jul 06 19:09:59.483971 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.483483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wwtf" event={"ID":"7a879ec8-725e-4b58-ac3d-81937681ef12","Type":"ContainerStarted","Data":"74277be2838b6d55521df69adefa38b2e05814fc5c75b6771d7c5b955bba84fc"} Jul 06 19:09:59.485563 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.485520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjldf" event={"ID":"ea508f2b-2a9e-410b-8e7b-1e119197a9a1","Type":"ContainerStarted","Data":"6134e3c89610bb86b64a07556cc03ec82e054e64075a6bbf2e046995a90425d3"} Jul 06 19:09:59.487575 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.487294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gf6kz" event={"ID":"69bc136b-e47c-49a2-9fab-d87688054f05","Type":"ContainerStarted","Data":"ac4ac4ea03f487d38bf1fa03c12a4cb7d31d42d0ecd0a1caa6eb40cc0342239c"} Jul 06 19:09:59.497185 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.497138 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-72.ec2.internal" podStartSLOduration=21.497124434 podStartE2EDuration="21.497124434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:42.451112737 +0000 UTC m=+6.745904408" watchObservedRunningTime="2026-07-06 19:09:59.497124434 +0000 UTC m=+23.791916101" Jul 06 19:09:59.532598 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.532521 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c59zd" podStartSLOduration=2.26652245 podStartE2EDuration="22.532501323s" totalImagesPullingTime="20.265978873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:59.513344409 +0000 UTC m=+23.808136076" watchObservedRunningTime="2026-07-06 19:09:59.532501323 +0000 UTC m=+23.827292993" Jul 06 19:09:59.532785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.532681 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mlrrb" podStartSLOduration=3.657602931 podStartE2EDuration="22.53267385s" totalImagesPullingTime="18.875070919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:59.532313527 +0000 UTC m=+23.827105188" watchObservedRunningTime="2026-07-06 19:09:59.53267385 +0000 UTC m=+23.827465518" Jul 06 19:09:59.549594 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.549509 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjldf" podStartSLOduration=12.113656553 podStartE2EDuration="22.549493917s" totalImagesPullingTime="10.435837364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:59.549470047 +0000 UTC m=+23.844261901" watchObservedRunningTime="2026-07-06 19:09:59.549493917 +0000 UTC m=+23.844285578" Jul 06 19:09:59.573680 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.573619 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gf6kz" podStartSLOduration=2.364978433 podStartE2EDuration="22.573532575s" totalImagesPullingTime="20.208554142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:59.573335819 +0000 UTC m=+23.868127488" watchObservedRunningTime="2026-07-06 19:09:59.573532575 +0000 UTC m=+23.868324242" Jul 06 19:09:59.589044 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:09:59.588979 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4wwtf" podStartSLOduration=3.712485187 podStartE2EDuration="22.588961358s" totalImagesPullingTime="18.876476171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:59.588856404 +0000 UTC m=+23.883648071" watchObservedRunningTime="2026-07-06 19:09:59.588961358 +0000 UTC m=+23.883753023" Jul 06 19:10:00.099956 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.099786 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:10:00.197621 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.197505 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:10:00.09994776Z","UUID":"911c413b-429e-41a4-a9e7-8b0ca12c4036","Handler":null,"Name":"","Endpoint":""} Jul 06 19:10:00.199298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.199280 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:10:00.199409 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.199313 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:10:00.261619 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.261521 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:10:00.262159 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.262136 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:10:00.324007 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.323975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:00.324402 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:00.324105 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:00.492719 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.492680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" event={"ID":"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3","Type":"ContainerStarted","Data":"f253a7e2b8da537f046485373932c8eaf342895505c1fe47fe445ad3e13c3efa"} Jul 06 19:10:00.495082 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.495047 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t59jq" event={"ID":"e048939e-fb58-4502-897b-0f63d2ef0399","Type":"ContainerStarted","Data":"f583cffa4bd4131587e1f6aa1aabeef9b8b62e5b7b1c8543c89081d3a90769e5"} Jul 06 19:10:00.495405 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.495377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:10:00.495991 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.495970 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjldf" Jul 06 19:10:00.510036 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:00.509978 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t59jq" podStartSLOduration=3.32999517 podStartE2EDuration="23.509962088s" totalImagesPullingTime="20.179966918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:00.509339406 +0000 UTC m=+24.804131072" watchObservedRunningTime="2026-07-06 19:10:00.509962088 +0000 UTC m=+24.804753755" Jul 06 19:10:01.323856 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:01.323768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:01.324094 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:01.323774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:01.324094 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:01.323920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:01.324094 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:01.324024 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:01.500319 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:01.500272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" event={"ID":"c8c9c955-8d58-45f4-ad8c-e82fce23b5c3","Type":"ContainerStarted","Data":"24926d696007e83ee41f80b1e14762abf8bbc2bcc013a241f7b92bb0c9d9b041"} Jul 06 19:10:02.323257 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:02.323219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:02.323433 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:02.323327 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:02.506614 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:02.506572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:10:02.507134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:02.507028 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"7550e184b272f306804d59eb08559167109e8a7c8bce3b9d95c2f7c30e7e6de0"} Jul 06 19:10:03.323356 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:03.323318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:03.323526 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:03.323318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:03.323526 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:03.323433 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:03.323526 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:03.323498 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:04.323783 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.323599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:04.324843 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:04.323849 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:04.514427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.514397 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:10:04.514850 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.514821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"b7ce81427654877de3a3565a7d8ceaf27261e35b1ebc7b5785a39c4635ddfb09"} Jul 06 19:10:04.515148 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.515123 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:04.515280 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.515261 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:04.515340 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.515326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:04.515411 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.515377 2575 scope.go:117] "RemoveContainer" containerID="3f70ef2315dad5c9d9bf798cd563aa6a2d96c6fb0cd0c7a33debf8aa5d24c64f" Jul 06 19:10:04.532462 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.532431 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:04.533047 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.533029 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:04.546457 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:04.546414 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbg7s" podStartSLOduration=5.5242097 podStartE2EDuration="27.54639502s" totalImagesPullingTime="22.02218532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:01.539172688 +0000 UTC m=+25.833964353" watchObservedRunningTime="2026-07-06 19:10:04.54639502 +0000 UTC m=+28.841186685" Jul 06 19:10:05.323951 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.323918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:05.324420 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.323924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:05.324420 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:05.324030 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:05.324420 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:05.324148 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:05.850487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.850458 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5j4j"] Jul 06 19:10:05.850673 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.850595 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:05.850732 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:05.850690 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:05.854203 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.854177 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j26gh"] Jul 06 19:10:05.854322 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.854230 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8dkw"] Jul 06 19:10:05.854322 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.854285 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:05.854389 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:05.854371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:05.854431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:05.854416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:05.854502 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:05.854487 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:06.522849 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:06.522669 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:10:06.523383 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:06.523212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" event={"ID":"891831f0-71eb-463d-90ea-a0bb8fc75a57","Type":"ContainerStarted","Data":"32f1d0a37f151388d745fbe9bb2804974c0ab0784fd5c99ca7fb472a960a77f9"} Jul 06 19:10:06.549942 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:06.549896 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" podStartSLOduration=10.654407139 podStartE2EDuration="29.549881833s" totalImagesPullingTime="18.895474694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:06.54960901 +0000 UTC m=+30.844400677" watchObservedRunningTime="2026-07-06 19:10:06.549881833 +0000 UTC m=+30.844673498" Jul 06 19:10:07.323988 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:07.323951 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:07.324172 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:07.324050 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:07.324172 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:07.324057 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:07.324172 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:07.324077 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:07.324172 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:07.324157 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:07.324334 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:07.324230 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:07.527212 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:07.527174 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="7cda54ae9224446b3a77da45c50d3e6d916722255c6cfdf9d656270f914f1f12" exitCode=0 Jul 06 19:10:07.527807 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:07.527223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"7cda54ae9224446b3a77da45c50d3e6d916722255c6cfdf9d656270f914f1f12"} Jul 06 19:10:08.531765 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:08.531677 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="ba4a5fb0244cbd065fbd6054a72fe7f1e0a07b09ba42add0db9784b8c8b0e8a6" exitCode=0 Jul 06 19:10:08.531765 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:08.531740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"ba4a5fb0244cbd065fbd6054a72fe7f1e0a07b09ba42add0db9784b8c8b0e8a6"} Jul 06 19:10:09.324319 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.324056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:09.324319 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.324060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:09.324489 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.324320 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:09.324489 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.324110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:09.324489 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.324394 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:09.324489 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.324471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:09.536275 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.536241 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="8a35072e5b15bff9c3381c4f96dd17ecd8d19c082336c23f395d1f3f9a68e2ae" exitCode=0 Jul 06 19:10:09.536655 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.536298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"8a35072e5b15bff9c3381c4f96dd17ecd8d19c082336c23f395d1f3f9a68e2ae"} Jul 06 19:10:09.891338 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.891300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:09.891521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:09.891347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:09.891521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.891449 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:10:09.891521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.891453 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:10:09.891521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.891507 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret podName:98a4ad15-afb7-488b-b93a-45db89cf7d44 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:41.891493379 +0000 UTC m=+66.186285023 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret") pod "global-pull-secret-syncer-j8dkw" (UID: "98a4ad15-afb7-488b-b93a-45db89cf7d44") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:10:09.891521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:09.891522 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs podName:7682152a-9bff-4bbe-ba36-319c9ffb818f nodeName:}" failed. No retries permitted until 2026-07-06 19:10:41.891515936 +0000 UTC m=+66.186307580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs") pod "network-metrics-daemon-j26gh" (UID: "7682152a-9bff-4bbe-ba36-319c9ffb818f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:10:10.092865 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:10.092814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:10.093041 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:10.093008 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:10:10.093041 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:10.093036 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:10:10.093130 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:10.093047 2575 projected.go:196] Error preparing data for projected volume kube-api-access-zrwhr for pod openshift-network-diagnostics/network-check-target-t5j4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:10:10.093130 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:10.093103 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr podName:86099fdc-7ffd-4bca-b889-5537cfd1cd49 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:42.093084024 +0000 UTC m=+66.387875687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrwhr" (UniqueName: "kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr") pod "network-check-target-t5j4j" (UID: "86099fdc-7ffd-4bca-b889-5537cfd1cd49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:10:11.324097 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:11.324053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:11.324097 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:11.324088 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:11.324097 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:11.324101 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:11.324602 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:11.324188 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8dkw" podUID="98a4ad15-afb7-488b-b93a-45db89cf7d44" Jul 06 19:10:11.324602 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:11.324233 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j26gh" podUID="7682152a-9bff-4bbe-ba36-319c9ffb818f" Jul 06 19:10:11.324602 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:11.324303 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5j4j" podUID="86099fdc-7ffd-4bca-b889-5537cfd1cd49" Jul 06 19:10:12.450756 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.450724 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-72.ec2.internal" event="NodeReady" Jul 06 19:10:12.451236 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.450897 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:10:12.491274 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.491239 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rzgj7"] Jul 06 19:10:12.493532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.493507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.494572 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.494099 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k2dbz"] Jul 06 19:10:12.496608 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.496152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.496608 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.496350 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k95g\"" Jul 06 19:10:12.496822 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.496801 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:10:12.497059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.497039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:10:12.498223 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.498206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:10:12.498467 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.498445 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:10:12.498587 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.498521 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:10:12.498923 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.498904 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5m8hp\"" Jul 06 19:10:12.509609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.509585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzgj7"] Jul 06 19:10:12.512533 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.512510 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2dbz"] Jul 06 19:10:12.609593 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/527f2c12-3471-4997-a211-71bca0aff199-config-volume\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.609593 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.609780 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf7a3dc-b978-4fb8-853b-700379445a8e-cert\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.609780 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcp65\" (UniqueName: \"kubernetes.io/projected/527f2c12-3471-4997-a211-71bca0aff199-kube-api-access-mcp65\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.609780 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86jn\" (UniqueName: \"kubernetes.io/projected/3cf7a3dc-b978-4fb8-853b-700379445a8e-kube-api-access-w86jn\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.609780 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.609763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527f2c12-3471-4997-a211-71bca0aff199-tmp-dir\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.710808 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.710768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/527f2c12-3471-4997-a211-71bca0aff199-config-volume\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.710808 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.710808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.711079 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.710838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf7a3dc-b978-4fb8-853b-700379445a8e-cert\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.711079 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.710868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcp65\" (UniqueName: \"kubernetes.io/projected/527f2c12-3471-4997-a211-71bca0aff199-kube-api-access-mcp65\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.711079 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:12.710948 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:12.711079 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:12.711027 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:13.211007802 +0000 UTC m=+37.505799448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:12.711258 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.711089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86jn\" (UniqueName: \"kubernetes.io/projected/3cf7a3dc-b978-4fb8-853b-700379445a8e-kube-api-access-w86jn\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.711258 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.711140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527f2c12-3471-4997-a211-71bca0aff199-tmp-dir\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.711414 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.711394 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/527f2c12-3471-4997-a211-71bca0aff199-config-volume\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.711462 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.711401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527f2c12-3471-4997-a211-71bca0aff199-tmp-dir\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.715146 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.715121 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cf7a3dc-b978-4fb8-853b-700379445a8e-cert\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.721478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.721454 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcp65\" (UniqueName: \"kubernetes.io/projected/527f2c12-3471-4997-a211-71bca0aff199-kube-api-access-mcp65\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:12.721615 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.721598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86jn\" (UniqueName: \"kubernetes.io/projected/3cf7a3dc-b978-4fb8-853b-700379445a8e-kube-api-access-w86jn\") pod \"ingress-canary-k2dbz\" (UID: \"3cf7a3dc-b978-4fb8-853b-700379445a8e\") " pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.811726 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.811693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k2dbz" Jul 06 19:10:12.960377 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:12.960347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k2dbz"] Jul 06 19:10:13.215214 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.215175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:13.215414 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:13.215366 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:13.215463 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:13.215448 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:14.215427873 +0000 UTC m=+38.510219526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:13.323468 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.323427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:13.323468 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.323440 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:13.323719 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.323589 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:13.327789 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.327761 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:10:13.327931 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.327903 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9tqph\"" Jul 06 19:10:13.328066 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.328052 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqjhw\"" Jul 06 19:10:13.328214 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.328201 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:10:13.328368 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.328350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:10:13.328587 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:13.328574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:10:14.225013 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:14.224979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:14.225460 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:14.225144 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:14.225460 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:14.225228 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:16.225207212 +0000 UTC m=+40.519998860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:14.487744 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:14.487669 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf7a3dc_b978_4fb8_853b_700379445a8e.slice/crio-40fca8198ab53a726472fd77a13caae2fe9122114a756a0d2a9d8338a0fccb5b WatchSource:0}: Error finding container 40fca8198ab53a726472fd77a13caae2fe9122114a756a0d2a9d8338a0fccb5b: Status 404 returned error can't find the container with id 40fca8198ab53a726472fd77a13caae2fe9122114a756a0d2a9d8338a0fccb5b Jul 06 19:10:14.548729 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:14.548495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2dbz" event={"ID":"3cf7a3dc-b978-4fb8-853b-700379445a8e","Type":"ContainerStarted","Data":"40fca8198ab53a726472fd77a13caae2fe9122114a756a0d2a9d8338a0fccb5b"} Jul 06 19:10:15.555331 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:15.555233 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="0c6a542b6ed6417bf641e58a2f5833bc204c604cf4234e05335d64cb9984b7e5" exitCode=0 Jul 06 19:10:15.555331 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:15.555311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"0c6a542b6ed6417bf641e58a2f5833bc204c604cf4234e05335d64cb9984b7e5"} Jul 06 19:10:16.240849 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:16.240817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:16.241021 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:16.240926 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:16.241021 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:16.240980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:20.240967584 +0000 UTC m=+44.535759228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:16.561499 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:16.561417 2575 generic.go:356] "Generic (PLEG): container finished" podID="b32ecc89-69fb-4092-8d44-5990819e70e7" containerID="9bc53d0a1992ceb9e16d79a163b1c25faec4d97fc8da75ad1ac147862532ffd1" exitCode=0 Jul 06 19:10:16.561499 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:16.561462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerDied","Data":"9bc53d0a1992ceb9e16d79a163b1c25faec4d97fc8da75ad1ac147862532ffd1"} Jul 06 19:10:17.568205 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:17.568096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75s6d" event={"ID":"b32ecc89-69fb-4092-8d44-5990819e70e7","Type":"ContainerStarted","Data":"e9d296234eb1b316c4b5b1f155338c048bc1eb22cfbb7533e2dc8612f19bdaf9"} Jul 06 19:10:17.569673 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:17.569650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k2dbz" event={"ID":"3cf7a3dc-b978-4fb8-853b-700379445a8e","Type":"ContainerStarted","Data":"6dfdf9a806934d1156c8c6c4fd1af4f4d67d88194f12a0161a2cac15ccfc7d0f"} Jul 06 19:10:17.593625 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:17.593569 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-75s6d" podStartSLOduration=8.444110414 podStartE2EDuration="40.593534042s" totalImagesPullingTime="32.149423628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:17.591984947 +0000 UTC m=+41.886776613" watchObservedRunningTime="2026-07-06 19:10:17.593534042 +0000 UTC m=+41.888325707" Jul 06 19:10:17.606726 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:17.606677 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k2dbz" podStartSLOduration=2.790823478 podStartE2EDuration="5.60665839s" totalImagesPullingTime="2.815834912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:17.606080629 +0000 UTC m=+41.900872296" watchObservedRunningTime="2026-07-06 19:10:17.60665839 +0000 UTC m=+41.901450058" Jul 06 19:10:18.377665 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.377630 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl"] Jul 06 19:10:18.398233 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.398196 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl"] Jul 06 19:10:18.398380 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.398315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" Jul 06 19:10:18.400654 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.400627 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sqp4h\"" Jul 06 19:10:18.401329 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.401309 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:10:18.401432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.401350 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:10:18.492327 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.492292 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zz2nv"] Jul 06 19:10:18.518507 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.518481 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58"] Jul 06 19:10:18.518672 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.518627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.520870 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.520848 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:10:18.521088 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.521075 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:10:18.523261 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.521576 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5gkrt\"" Jul 06 19:10:18.523261 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.521748 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:10:18.523261 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.521827 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:10:18.529124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.529104 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:10:18.532145 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.532129 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58"] Jul 06 19:10:18.532215 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.532155 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zz2nv"] Jul 06 19:10:18.532250 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.532241 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.535350 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.535331 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 19:10:18.535493 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.535476 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 19:10:18.535774 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.535760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 19:10:18.535981 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.535967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-d8vmb\"" Jul 06 19:10:18.536060 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.536000 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:10:18.558311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.558278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5lwb\" (UniqueName: \"kubernetes.io/projected/4f0e325b-e770-42bf-b316-1ac066d8cbee-kube-api-access-q5lwb\") pod \"volume-data-source-validator-5d456fdbcd-tnzkl\" (UID: \"4f0e325b-e770-42bf-b316-1ac066d8cbee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" Jul 06 19:10:18.580942 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.580918 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr"] Jul 06 19:10:18.602216 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.602184 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5756b9455-szd25"] Jul 06 19:10:18.602381 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.602314 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" Jul 06 19:10:18.604710 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.604686 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zsnz7\"" Jul 06 19:10:18.626418 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.626381 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr"] Jul 06 19:10:18.626418 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.626423 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5756b9455-szd25"] Jul 06 19:10:18.626660 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.626501 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.629190 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629126 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:10:18.629190 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mwp64\"" Jul 06 19:10:18.629190 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:10:18.629399 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:10:18.629399 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629280 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:10:18.629609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629594 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:10:18.629686 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.629607 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:10:18.659562 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659527 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-config\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.659735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqx22\" (UniqueName: \"kubernetes.io/projected/745bf144-0d11-4b3a-a4cd-bab882f86c09-kube-api-access-vqx22\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.659735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-trusted-ca\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.659809 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/745bf144-0d11-4b3a-a4cd-bab882f86c09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.659851 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/745bf144-0d11-4b3a-a4cd-bab882f86c09-config\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.659901 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49891cad-fa9b-413e-934b-62d0169b285c-serving-cert\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.659956 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.659942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5lwb\" (UniqueName: \"kubernetes.io/projected/4f0e325b-e770-42bf-b316-1ac066d8cbee-kube-api-access-q5lwb\") pod \"volume-data-source-validator-5d456fdbcd-tnzkl\" (UID: \"4f0e325b-e770-42bf-b316-1ac066d8cbee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" Jul 06 19:10:18.660046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.660029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46xz\" (UniqueName: \"kubernetes.io/projected/49891cad-fa9b-413e-934b-62d0169b285c-kube-api-access-j46xz\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.668644 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.668605 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5lwb\" (UniqueName: \"kubernetes.io/projected/4f0e325b-e770-42bf-b316-1ac066d8cbee-kube-api-access-q5lwb\") pod \"volume-data-source-validator-5d456fdbcd-tnzkl\" (UID: \"4f0e325b-e770-42bf-b316-1ac066d8cbee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" Jul 06 19:10:18.706447 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.706406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" Jul 06 19:10:18.760719 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.760686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46xz\" (UniqueName: \"kubernetes.io/projected/49891cad-fa9b-413e-934b-62d0169b285c-kube-api-access-j46xz\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.760719 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.760722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-stats-auth\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.760896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.760864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-config\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.760947 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.760899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.760985 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.760949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqx22\" (UniqueName: \"kubernetes.io/projected/745bf144-0d11-4b3a-a4cd-bab882f86c09-kube-api-access-vqx22\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.761021 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-trusted-ca\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.761063 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/745bf144-0d11-4b3a-a4cd-bab882f86c09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.761107 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.761162 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/745bf144-0d11-4b3a-a4cd-bab882f86c09-config\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.761162 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761155 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqnq\" (UniqueName: \"kubernetes.io/projected/9f76f699-06d4-47b2-ae95-df5169dbf5d0-kube-api-access-2xqnq\") pod \"network-check-source-989f8b8dc-mmdlr\" (UID: \"9f76f699-06d4-47b2-ae95-df5169dbf5d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" Jul 06 19:10:18.761247 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-default-certificate\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.761299 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49891cad-fa9b-413e-934b-62d0169b285c-serving-cert\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.761351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wcsd\" (UniqueName: \"kubernetes.io/projected/75a41da5-156a-4785-9e7b-63eaf701e05b-kube-api-access-8wcsd\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.761768 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-config\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.762004 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.761981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49891cad-fa9b-413e-934b-62d0169b285c-trusted-ca\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.762192 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.762168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/745bf144-0d11-4b3a-a4cd-bab882f86c09-config\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.763661 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.763640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/745bf144-0d11-4b3a-a4cd-bab882f86c09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.763735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.763648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49891cad-fa9b-413e-934b-62d0169b285c-serving-cert\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.769708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.769684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqx22\" (UniqueName: \"kubernetes.io/projected/745bf144-0d11-4b3a-a4cd-bab882f86c09-kube-api-access-vqx22\") pod \"service-ca-operator-5d46d9ffd4-7ct58\" (UID: \"745bf144-0d11-4b3a-a4cd-bab882f86c09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.769833 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.769695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46xz\" (UniqueName: \"kubernetes.io/projected/49891cad-fa9b-413e-934b-62d0169b285c-kube-api-access-j46xz\") pod \"console-operator-68b757fb67-zz2nv\" (UID: \"49891cad-fa9b-413e-934b-62d0169b285c\") " pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.829903 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.829870 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:18.839983 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.839953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" Jul 06 19:10:18.858530 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.858504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl"] Jul 06 19:10:18.861529 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:18.861504 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0e325b_e770_42bf_b316_1ac066d8cbee.slice/crio-c4d2b1fb0afbfe98404ce533edb7eb6b0af1f6896ecc635ad39f25921211daa0 WatchSource:0}: Error finding container c4d2b1fb0afbfe98404ce533edb7eb6b0af1f6896ecc635ad39f25921211daa0: Status 404 returned error can't find the container with id c4d2b1fb0afbfe98404ce533edb7eb6b0af1f6896ecc635ad39f25921211daa0 Jul 06 19:10:18.861830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.861806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.861924 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.861910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.861973 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.861956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqnq\" (UniqueName: \"kubernetes.io/projected/9f76f699-06d4-47b2-ae95-df5169dbf5d0-kube-api-access-2xqnq\") pod \"network-check-source-989f8b8dc-mmdlr\" (UID: \"9f76f699-06d4-47b2-ae95-df5169dbf5d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" Jul 06 19:10:18.862028 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:18.861988 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:19.361963217 +0000 UTC m=+43.656754880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:18.862083 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.862025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-default-certificate\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.862083 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.862055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wcsd\" (UniqueName: \"kubernetes.io/projected/75a41da5-156a-4785-9e7b-63eaf701e05b-kube-api-access-8wcsd\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.862083 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:18.862066 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:18.862210 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.862094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-stats-auth\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.862210 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:18.862135 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:19.362118146 +0000 UTC m=+43.656909846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:18.864699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.864675 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-default-certificate\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.867496 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.867477 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-stats-auth\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.871318 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.871263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wcsd\" (UniqueName: \"kubernetes.io/projected/75a41da5-156a-4785-9e7b-63eaf701e05b-kube-api-access-8wcsd\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:18.871696 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.871671 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqnq\" (UniqueName: \"kubernetes.io/projected/9f76f699-06d4-47b2-ae95-df5169dbf5d0-kube-api-access-2xqnq\") pod \"network-check-source-989f8b8dc-mmdlr\" (UID: \"9f76f699-06d4-47b2-ae95-df5169dbf5d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" Jul 06 19:10:18.912867 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.912572 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" Jul 06 19:10:18.984363 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:18.984329 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zz2nv"] Jul 06 19:10:18.987864 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:18.987835 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49891cad_fa9b_413e_934b_62d0169b285c.slice/crio-c6b7cf5b213162208451cd90c5abad589bf60ba44cedbe14b36c3d55673add52 WatchSource:0}: Error finding container c6b7cf5b213162208451cd90c5abad589bf60ba44cedbe14b36c3d55673add52: Status 404 returned error can't find the container with id c6b7cf5b213162208451cd90c5abad589bf60ba44cedbe14b36c3d55673add52 Jul 06 19:10:19.015633 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.015604 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58"] Jul 06 19:10:19.019694 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:19.019662 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745bf144_0d11_4b3a_a4cd_bab882f86c09.slice/crio-78071d64a3bd341f74833b9027de64f8eb95ef0d1279f2e5fc06291be6125b6e WatchSource:0}: Error finding container 78071d64a3bd341f74833b9027de64f8eb95ef0d1279f2e5fc06291be6125b6e: Status 404 returned error can't find the container with id 78071d64a3bd341f74833b9027de64f8eb95ef0d1279f2e5fc06291be6125b6e Jul 06 19:10:19.081374 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.081345 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr"] Jul 06 19:10:19.085578 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:19.085531 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f76f699_06d4_47b2_ae95_df5169dbf5d0.slice/crio-cdd6f1e106e34427be27f6438384a0ee1f15168a993deeed553830b52d2eb644 WatchSource:0}: Error finding container cdd6f1e106e34427be27f6438384a0ee1f15168a993deeed553830b52d2eb644: Status 404 returned error can't find the container with id cdd6f1e106e34427be27f6438384a0ee1f15168a993deeed553830b52d2eb644 Jul 06 19:10:19.366323 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.366284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:19.366480 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.366388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:19.366571 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:19.366509 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:20.366483732 +0000 UTC m=+44.661275395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:19.366629 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:19.366573 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:19.366669 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:19.366628 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:20.366615657 +0000 UTC m=+44.661407317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:19.576085 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.576042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" event={"ID":"4f0e325b-e770-42bf-b316-1ac066d8cbee","Type":"ContainerStarted","Data":"c4d2b1fb0afbfe98404ce533edb7eb6b0af1f6896ecc635ad39f25921211daa0"} Jul 06 19:10:19.577159 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.577135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" event={"ID":"9f76f699-06d4-47b2-ae95-df5169dbf5d0","Type":"ContainerStarted","Data":"cdd6f1e106e34427be27f6438384a0ee1f15168a993deeed553830b52d2eb644"} Jul 06 19:10:19.578164 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.578142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" event={"ID":"49891cad-fa9b-413e-934b-62d0169b285c","Type":"ContainerStarted","Data":"c6b7cf5b213162208451cd90c5abad589bf60ba44cedbe14b36c3d55673add52"} Jul 06 19:10:19.579265 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:19.579229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" event={"ID":"745bf144-0d11-4b3a-a4cd-bab882f86c09","Type":"ContainerStarted","Data":"78071d64a3bd341f74833b9027de64f8eb95ef0d1279f2e5fc06291be6125b6e"} Jul 06 19:10:20.273986 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:20.273942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:20.274477 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:20.274111 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:20.274477 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:20.274173 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:28.274157361 +0000 UTC m=+52.568949004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:20.374717 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:20.374397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:20.374717 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:20.374500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:20.374717 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:20.374656 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:20.375016 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:20.374713 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:22.37469548 +0000 UTC m=+46.669487127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:20.375016 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:20.374774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:22.374759839 +0000 UTC m=+46.669551483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:21.587196 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:21.587118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" event={"ID":"4f0e325b-e770-42bf-b316-1ac066d8cbee","Type":"ContainerStarted","Data":"25220b4dc2f3b61bde6e131954a40cc00f9754b5f1144927e3f51c507a9b5e29"} Jul 06 19:10:22.393196 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:22.393159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:22.393361 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:22.393227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:22.393361 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:22.393335 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:22.393437 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:22.393345 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:26.393332232 +0000 UTC m=+50.688123877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:22.393437 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:22.393404 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:26.393383785 +0000 UTC m=+50.688175435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:23.594023 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.593972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" event={"ID":"49891cad-fa9b-413e-934b-62d0169b285c","Type":"ContainerStarted","Data":"fecb67de47c6f7ed7cf5e0421119cb457db1316775a91f2664944b0100f39983"} Jul 06 19:10:23.594448 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.594146 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:23.595705 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.595677 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" event={"ID":"745bf144-0d11-4b3a-a4cd-bab882f86c09","Type":"ContainerStarted","Data":"40591dac7abd1f7871043e8b83ac41402ede0d550b40f7ad43d254b3209d5295"} Jul 06 19:10:23.595827 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.595754 2575 patch_prober.go:28] interesting pod/console-operator-68b757fb67-zz2nv container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 06 19:10:23.595827 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.595803 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podUID="49891cad-fa9b-413e-934b-62d0169b285c" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 06 19:10:23.622272 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.622201 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tnzkl" podStartSLOduration=3.713415785 podStartE2EDuration="5.622181492s" totalImagesPullingTime="1.908765707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:21.601854496 +0000 UTC m=+45.896646163" watchObservedRunningTime="2026-07-06 19:10:23.622181492 +0000 UTC m=+47.916973160" Jul 06 19:10:23.622471 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.622337 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podStartSLOduration=1.123182148 podStartE2EDuration="5.622329123s" totalImagesPullingTime="4.499146975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:23.620678056 +0000 UTC m=+47.915469748" watchObservedRunningTime="2026-07-06 19:10:23.622329123 +0000 UTC m=+47.917120791" Jul 06 19:10:23.666060 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:23.666000 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" podStartSLOduration=1.198234513 podStartE2EDuration="5.665977291s" totalImagesPullingTime="4.467742778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:23.665320797 +0000 UTC m=+47.960112463" watchObservedRunningTime="2026-07-06 19:10:23.665977291 +0000 UTC m=+47.960768952" Jul 06 19:10:24.431888 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.431854 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8n4q"] Jul 06 19:10:24.452874 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.452841 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8n4q"] Jul 06 19:10:24.453066 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.452984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.455128 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.455102 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:10:24.455903 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.455884 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jdr5p\"" Jul 06 19:10:24.456003 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.455990 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:10:24.456147 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.456134 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:10:24.456271 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.456260 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:10:24.601487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.601451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" event={"ID":"9f76f699-06d4-47b2-ae95-df5169dbf5d0","Type":"ContainerStarted","Data":"9fa345d1bf3e62b35723ecdc9a061f5cf3ca66e4ffd4795083e1b047dc0b3a39"} Jul 06 19:10:24.603092 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.603070 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/0.log" Jul 06 19:10:24.603231 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.603112 2575 generic.go:356] "Generic (PLEG): container finished" podID="49891cad-fa9b-413e-934b-62d0169b285c" containerID="fecb67de47c6f7ed7cf5e0421119cb457db1316775a91f2664944b0100f39983" exitCode=255 Jul 06 19:10:24.603231 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.603195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" event={"ID":"49891cad-fa9b-413e-934b-62d0169b285c","Type":"ContainerDied","Data":"fecb67de47c6f7ed7cf5e0421119cb457db1316775a91f2664944b0100f39983"} Jul 06 19:10:24.603367 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.603349 2575 scope.go:117] "RemoveContainer" containerID="fecb67de47c6f7ed7cf5e0421119cb457db1316775a91f2664944b0100f39983" Jul 06 19:10:24.612078 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.612055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.612206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.612083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.612206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.612131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc23f88-f5d2-4e14-998f-115c787f95e0-data-volume\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.612206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.612159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgjgq\" (UniqueName: \"kubernetes.io/projected/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-api-access-zgjgq\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.612206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.612188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4dc23f88-f5d2-4e14-998f-115c787f95e0-crio-socket\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.615220 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.615175 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mmdlr" podStartSLOduration=1.9784185619999999 podStartE2EDuration="6.615161953s" totalImagesPullingTime="4.636743391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:24.614444444 +0000 UTC m=+48.909236140" watchObservedRunningTime="2026-07-06 19:10:24.615161953 +0000 UTC m=+48.909953618" Jul 06 19:10:24.712685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.712662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.712814 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.712697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.712814 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:24.712788 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:10:24.712814 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:24.712789 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:10:24.713018 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:24.712853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:25.212832846 +0000 UTC m=+49.507624509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : secret "insights-runtime-extractor-tls" not found Jul 06 19:10:24.713018 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:24.712909 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:25.212882951 +0000 UTC m=+49.507674600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : configmap "kube-rbac-proxy" not found Jul 06 19:10:24.713132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.713023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc23f88-f5d2-4e14-998f-115c787f95e0-data-volume\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.713132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.713052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgjgq\" (UniqueName: \"kubernetes.io/projected/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-api-access-zgjgq\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.713132 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.713094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4dc23f88-f5d2-4e14-998f-115c787f95e0-crio-socket\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.713362 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.713343 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dc23f88-f5d2-4e14-998f-115c787f95e0-data-volume\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.713663 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.713540 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4dc23f88-f5d2-4e14-998f-115c787f95e0-crio-socket\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:24.722969 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:24.722929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgjgq\" (UniqueName: \"kubernetes.io/projected/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-api-access-zgjgq\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:25.218010 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.217970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:25.218010 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.218011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:25.218243 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:25.218103 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:10:25.218243 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:25.218168 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:26.218150807 +0000 UTC m=+50.512942470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : configmap "kube-rbac-proxy" not found Jul 06 19:10:25.218243 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:25.218207 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:10:25.218346 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:25.218277 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:26.21825931 +0000 UTC m=+50.513050967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : secret "insights-runtime-extractor-tls" not found Jul 06 19:10:25.608137 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608063 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:10:25.608538 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608383 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/0.log" Jul 06 19:10:25.608538 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608412 2575 generic.go:356] "Generic (PLEG): container finished" podID="49891cad-fa9b-413e-934b-62d0169b285c" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" exitCode=255 Jul 06 19:10:25.608538 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" event={"ID":"49891cad-fa9b-413e-934b-62d0169b285c","Type":"ContainerDied","Data":"05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4"} Jul 06 19:10:25.608678 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608609 2575 scope.go:117] "RemoveContainer" containerID="fecb67de47c6f7ed7cf5e0421119cb457db1316775a91f2664944b0100f39983" Jul 06 19:10:25.608935 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:25.608908 2575 scope.go:117] "RemoveContainer" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" Jul 06 19:10:25.609115 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:25.609090 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zz2nv_openshift-console-operator(49891cad-fa9b-413e-934b-62d0169b285c)\"" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podUID="49891cad-fa9b-413e-934b-62d0169b285c" Jul 06 19:10:26.228233 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.228198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:26.228233 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.228233 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:26.228508 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.228342 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:10:26.228508 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.228405 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:28.228391947 +0000 UTC m=+52.523183591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : secret "insights-runtime-extractor-tls" not found Jul 06 19:10:26.228825 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.228800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4dc23f88-f5d2-4e14-998f-115c787f95e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:26.429921 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.429884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:26.430116 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.429960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:26.430116 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.430054 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:26.430116 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.430061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:34.430041993 +0000 UTC m=+58.724833641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:26.430116 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.430101 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:34.430089924 +0000 UTC m=+58.724881568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:26.613353 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.613266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:10:26.613773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:26.613600 2575 scope.go:117] "RemoveContainer" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" Jul 06 19:10:26.613773 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:26.613752 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zz2nv_openshift-console-operator(49891cad-fa9b-413e-934b-62d0169b285c)\"" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podUID="49891cad-fa9b-413e-934b-62d0169b285c" Jul 06 19:10:27.012897 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:27.012868 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wwtf_7a879ec8-725e-4b58-ac3d-81937681ef12/dns-node-resolver/0.log" Jul 06 19:10:28.012731 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:28.012703 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlrrb_a2331e94-f16f-4dfd-8c88-eecc20675809/node-ca/0.log" Jul 06 19:10:28.245219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:28.245180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:28.245395 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:28.245336 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:10:28.245436 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:28.245400 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:32.245382395 +0000 UTC m=+56.540174041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : secret "insights-runtime-extractor-tls" not found Jul 06 19:10:28.346119 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:28.346033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:28.346267 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:28.346180 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:10:28.346267 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:28.346241 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls podName:527f2c12-3471-4997-a211-71bca0aff199 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:44.346224039 +0000 UTC m=+68.641015683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls") pod "dns-default-rzgj7" (UID: "527f2c12-3471-4997-a211-71bca0aff199") : secret "dns-default-metrics-tls" not found Jul 06 19:10:28.830747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:28.830701 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:28.831112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:28.831098 2575 scope.go:117] "RemoveContainer" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" Jul 06 19:10:28.831253 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:28.831235 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zz2nv_openshift-console-operator(49891cad-fa9b-413e-934b-62d0169b285c)\"" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podUID="49891cad-fa9b-413e-934b-62d0169b285c" Jul 06 19:10:29.013353 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:29.013320 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2dbz_3cf7a3dc-b978-4fb8-853b-700379445a8e/serve-healthcheck-canary/0.log" Jul 06 19:10:32.277102 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:32.277067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:32.277632 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:32.277244 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:10:32.277632 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:32.277310 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls podName:4dc23f88-f5d2-4e14-998f-115c787f95e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:10:40.277295361 +0000 UTC m=+64.572087010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8n4q" (UID: "4dc23f88-f5d2-4e14-998f-115c787f95e0") : secret "insights-runtime-extractor-tls" not found Jul 06 19:10:33.594889 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:33.594851 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:33.595286 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:33.595227 2575 scope.go:117] "RemoveContainer" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" Jul 06 19:10:33.595396 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:33.595376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zz2nv_openshift-console-operator(49891cad-fa9b-413e-934b-62d0169b285c)\"" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" podUID="49891cad-fa9b-413e-934b-62d0169b285c" Jul 06 19:10:34.497809 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:34.497761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:34.498000 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:34.497868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:34.498000 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:34.497944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:50.49792453 +0000 UTC m=+74.792716177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : configmap references non-existent config key: service-ca.crt Jul 06 19:10:34.498000 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:34.497988 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:10:34.498107 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:10:34.498039 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs podName:75a41da5-156a-4785-9e7b-63eaf701e05b nodeName:}" failed. No retries permitted until 2026-07-06 19:10:50.498028002 +0000 UTC m=+74.792819667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs") pod "router-default-5756b9455-szd25" (UID: "75a41da5-156a-4785-9e7b-63eaf701e05b") : secret "router-metrics-certs-default" not found Jul 06 19:10:37.538445 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:37.538417 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j44lf" Jul 06 19:10:40.346439 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.346406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:40.348896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.348873 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4dc23f88-f5d2-4e14-998f-115c787f95e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8n4q\" (UID: \"4dc23f88-f5d2-4e14-998f-115c787f95e0\") " pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:40.364269 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.364242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jdr5p\"" Jul 06 19:10:40.373012 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.372989 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8n4q" Jul 06 19:10:40.498423 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.498392 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8n4q"] Jul 06 19:10:40.501402 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:40.501372 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc23f88_f5d2_4e14_998f_115c787f95e0.slice/crio-a3f0d38991d9e753211085d5973b92eab0248152d67cb9b9307128aba4262c14 WatchSource:0}: Error finding container a3f0d38991d9e753211085d5973b92eab0248152d67cb9b9307128aba4262c14: Status 404 returned error can't find the container with id a3f0d38991d9e753211085d5973b92eab0248152d67cb9b9307128aba4262c14 Jul 06 19:10:40.661816 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:40.661729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8n4q" event={"ID":"4dc23f88-f5d2-4e14-998f-115c787f95e0","Type":"ContainerStarted","Data":"a3f0d38991d9e753211085d5973b92eab0248152d67cb9b9307128aba4262c14"} Jul 06 19:10:41.961954 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.961911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:41.962380 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.961996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:41.965142 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.965123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:10:41.965266 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.965173 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:10:41.975564 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.975523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7682152a-9bff-4bbe-ba36-319c9ffb818f-metrics-certs\") pod \"network-metrics-daemon-j26gh\" (UID: \"7682152a-9bff-4bbe-ba36-319c9ffb818f\") " pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:41.975692 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:41.975656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98a4ad15-afb7-488b-b93a-45db89cf7d44-original-pull-secret\") pod \"global-pull-secret-syncer-j8dkw\" (UID: \"98a4ad15-afb7-488b-b93a-45db89cf7d44\") " pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:42.139851 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.139814 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqjhw\"" Jul 06 19:10:42.148536 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.148503 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j26gh" Jul 06 19:10:42.150779 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.150755 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8dkw" Jul 06 19:10:42.164016 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.163990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:42.166971 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.166947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwhr\" (UniqueName: \"kubernetes.io/projected/86099fdc-7ffd-4bca-b889-5537cfd1cd49-kube-api-access-zrwhr\") pod \"network-check-target-t5j4j\" (UID: \"86099fdc-7ffd-4bca-b889-5537cfd1cd49\") " pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:42.448017 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.447984 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9tqph\"" Jul 06 19:10:42.456066 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:42.456039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:44.323851 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.323812 2575 scope.go:117] "RemoveContainer" containerID="05927151c56b6bff94b822ebc940c026df24ca83530ad6e11c5b00efa538cfc4" Jul 06 19:10:44.381296 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.381270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j26gh"] Jul 06 19:10:44.382072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.382052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:44.385048 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.385021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/527f2c12-3471-4997-a211-71bca0aff199-metrics-tls\") pod \"dns-default-rzgj7\" (UID: \"527f2c12-3471-4997-a211-71bca0aff199\") " pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:44.385210 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:44.385181 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7682152a_9bff_4bbe_ba36_319c9ffb818f.slice/crio-4df680b2f12a7f8b66a691277d0004e8e60c0b837d0047358990e793f0810ba8 WatchSource:0}: Error finding container 4df680b2f12a7f8b66a691277d0004e8e60c0b837d0047358990e793f0810ba8: Status 404 returned error can't find the container with id 4df680b2f12a7f8b66a691277d0004e8e60c0b837d0047358990e793f0810ba8 Jul 06 19:10:44.400810 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.400786 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5j4j"] Jul 06 19:10:44.403145 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:44.403119 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86099fdc_7ffd_4bca_b889_5537cfd1cd49.slice/crio-a2aafc8e09e82cdf9d87eab656a559c879573d21ee8d851edc509239cda77cb0 WatchSource:0}: Error finding container a2aafc8e09e82cdf9d87eab656a559c879573d21ee8d851edc509239cda77cb0: Status 404 returned error can't find the container with id a2aafc8e09e82cdf9d87eab656a559c879573d21ee8d851edc509239cda77cb0 Jul 06 19:10:44.411777 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.411747 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8dkw"] Jul 06 19:10:44.417767 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:44.417742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a4ad15_afb7_488b_b93a_45db89cf7d44.slice/crio-79095e7ce9073aadbd6b55febbad866ef71dece639981107e2326009021a622b WatchSource:0}: Error finding container 79095e7ce9073aadbd6b55febbad866ef71dece639981107e2326009021a622b: Status 404 returned error can't find the container with id 79095e7ce9073aadbd6b55febbad866ef71dece639981107e2326009021a622b Jul 06 19:10:44.607766 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.607687 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k95g\"" Jul 06 19:10:44.616315 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.616290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:44.679941 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.679917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:10:44.680098 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.680002 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" event={"ID":"49891cad-fa9b-413e-934b-62d0169b285c","Type":"ContainerStarted","Data":"53191b1d7240e9653e2507970b751ed658db08c3674d7c7f7897516a19703ab6"} Jul 06 19:10:44.680490 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.680458 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:44.682323 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.682298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8n4q" event={"ID":"4dc23f88-f5d2-4e14-998f-115c787f95e0","Type":"ContainerStarted","Data":"0bc5a9be9c2b960b0c5a6d0a25455340d1408423aeed3d300290d3c661a8bb96"} Jul 06 19:10:44.684112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.683872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5j4j" event={"ID":"86099fdc-7ffd-4bca-b889-5537cfd1cd49","Type":"ContainerStarted","Data":"35e8f0b1d43232dcba9d80ffbd3f5d3adaefb417a6d943d60cb7293397d99734"} Jul 06 19:10:44.684112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.683918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5j4j" event={"ID":"86099fdc-7ffd-4bca-b889-5537cfd1cd49","Type":"ContainerStarted","Data":"a2aafc8e09e82cdf9d87eab656a559c879573d21ee8d851edc509239cda77cb0"} Jul 06 19:10:44.684112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.683944 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:10:44.685199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.685177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j26gh" event={"ID":"7682152a-9bff-4bbe-ba36-319c9ffb818f","Type":"ContainerStarted","Data":"4df680b2f12a7f8b66a691277d0004e8e60c0b837d0047358990e793f0810ba8"} Jul 06 19:10:44.686302 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.686281 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8dkw" event={"ID":"98a4ad15-afb7-488b-b93a-45db89cf7d44","Type":"ContainerStarted","Data":"79095e7ce9073aadbd6b55febbad866ef71dece639981107e2326009021a622b"} Jul 06 19:10:44.712680 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.712624 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t5j4j" podStartSLOduration=67.71260341199999 podStartE2EDuration="1m7.712603412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:44.712122397 +0000 UTC m=+69.006914066" watchObservedRunningTime="2026-07-06 19:10:44.712603412 +0000 UTC m=+69.007395080" Jul 06 19:10:44.747803 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.747766 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rzgj7"] Jul 06 19:10:44.752335 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:44.752299 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527f2c12_3471_4997_a211_71bca0aff199.slice/crio-38dccd8aba9635d3fcff4e6da7dce63c80a0c4a452287d19598483a56f812071 WatchSource:0}: Error finding container 38dccd8aba9635d3fcff4e6da7dce63c80a0c4a452287d19598483a56f812071: Status 404 returned error can't find the container with id 38dccd8aba9635d3fcff4e6da7dce63c80a0c4a452287d19598483a56f812071 Jul 06 19:10:44.971373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:44.971341 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-zz2nv" Jul 06 19:10:45.696591 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:45.696453 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8n4q" event={"ID":"4dc23f88-f5d2-4e14-998f-115c787f95e0","Type":"ContainerStarted","Data":"43f3a762aebcc8faf86430a233654381dfb239f510a53c5b6fc6a055ed58d585"} Jul 06 19:10:45.699437 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:45.699403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j26gh" event={"ID":"7682152a-9bff-4bbe-ba36-319c9ffb818f","Type":"ContainerStarted","Data":"bd65dd019b213f1ba3907055e9f61d3c40bb3733739b283ce297c294b9634a9b"} Jul 06 19:10:45.699579 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:45.699461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j26gh" event={"ID":"7682152a-9bff-4bbe-ba36-319c9ffb818f","Type":"ContainerStarted","Data":"471d02abdb6c4ba30eb7464bff9d833b649f528da1794db44301b256dc8c43ac"} Jul 06 19:10:45.701127 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:45.701099 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzgj7" event={"ID":"527f2c12-3471-4997-a211-71bca0aff199","Type":"ContainerStarted","Data":"38dccd8aba9635d3fcff4e6da7dce63c80a0c4a452287d19598483a56f812071"} Jul 06 19:10:45.716994 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:45.716928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j26gh" podStartSLOduration=67.759531102 podStartE2EDuration="1m8.716913833s" totalImagesPullingTime="957.382731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:45.7167974 +0000 UTC m=+70.011589066" watchObservedRunningTime="2026-07-06 19:10:45.716913833 +0000 UTC m=+70.011705499" Jul 06 19:10:50.537034 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.536995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:50.537439 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.537053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:50.537661 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.537641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75a41da5-156a-4785-9e7b-63eaf701e05b-service-ca-bundle\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:50.539585 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.539562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75a41da5-156a-4785-9e7b-63eaf701e05b-metrics-certs\") pod \"router-default-5756b9455-szd25\" (UID: \"75a41da5-156a-4785-9e7b-63eaf701e05b\") " pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:50.723019 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.722981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzgj7" event={"ID":"527f2c12-3471-4997-a211-71bca0aff199","Type":"ContainerStarted","Data":"a38f521c8dec9d36047c4753f5776f59d89c3b134db64e1a10c8240a20c6da81"} Jul 06 19:10:50.723204 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.723045 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rzgj7" Jul 06 19:10:50.723204 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.723063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rzgj7" event={"ID":"527f2c12-3471-4997-a211-71bca0aff199","Type":"ContainerStarted","Data":"64c93dbb8c4294d0b39fe4c6b27a21c2d84c36708bf5190a0dce032d96738cf6"} Jul 06 19:10:50.724930 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.724904 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8n4q" event={"ID":"4dc23f88-f5d2-4e14-998f-115c787f95e0","Type":"ContainerStarted","Data":"e2bc28408e34272c166d7e0a7c242e254042c5baa59d57eb267abff3d2c26610"} Jul 06 19:10:50.730168 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.730142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8dkw" event={"ID":"98a4ad15-afb7-488b-b93a-45db89cf7d44","Type":"ContainerStarted","Data":"9a9f011f8de723b2249a7298150527dc5a821bb7df91c7031723b6b0d36830aa"} Jul 06 19:10:50.737700 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.737683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mwp64\"" Jul 06 19:10:50.742506 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.742461 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rzgj7" podStartSLOduration=33.47678841 podStartE2EDuration="38.74244656s" totalImagesPullingTime="5.26565815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.742284285 +0000 UTC m=+75.037075962" watchObservedRunningTime="2026-07-06 19:10:50.74244656 +0000 UTC m=+75.037238227" Jul 06 19:10:50.745827 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.745810 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:50.758817 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.758771 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8n4q" podStartSLOduration=17.421165108 podStartE2EDuration="26.758752752s" totalImagesPullingTime="9.337587644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:10:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.757773113 +0000 UTC m=+75.052564780" watchObservedRunningTime="2026-07-06 19:10:50.758752752 +0000 UTC m=+75.053544418" Jul 06 19:10:50.772584 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.772521 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j8dkw" podStartSLOduration=68.152233508 podStartE2EDuration="1m13.772503037s" totalImagesPullingTime="5.620269529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:50.772012289 +0000 UTC m=+75.066803954" watchObservedRunningTime="2026-07-06 19:10:50.772503037 +0000 UTC m=+75.067294702" Jul 06 19:10:50.872734 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:50.872702 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5756b9455-szd25"] Jul 06 19:10:50.875519 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:50.875490 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a41da5_156a_4785_9e7b_63eaf701e05b.slice/crio-511660bd4b45cad444c257c930d4c524785b199f2077cec7ff210e467ceaa00b WatchSource:0}: Error finding container 511660bd4b45cad444c257c930d4c524785b199f2077cec7ff210e467ceaa00b: Status 404 returned error can't find the container with id 511660bd4b45cad444c257c930d4c524785b199f2077cec7ff210e467ceaa00b Jul 06 19:10:51.589936 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.589900 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222"] Jul 06 19:10:51.592335 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.592318 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.594732 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.594709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 19:10:51.594838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.594760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 19:10:51.594838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.594792 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 19:10:51.595891 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.595876 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 19:10:51.596237 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.596209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 19:10:51.596292 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.596211 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 19:10:51.596378 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.596361 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 19:10:51.604314 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.604293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222"] Jul 06 19:10:51.646646 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.646860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.646860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.646860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dznzw\" (UniqueName: \"kubernetes.io/projected/7b292720-0058-47c5-ac69-bce7dde70ffc-kube-api-access-dznzw\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.646860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.646860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.646841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b292720-0058-47c5-ac69-bce7dde70ffc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.735880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.735843 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5756b9455-szd25" event={"ID":"75a41da5-156a-4785-9e7b-63eaf701e05b","Type":"ContainerStarted","Data":"88dcda2cf8ec71c1e95239275497cce40a666ec14663894c1a8e66f1eaefa820"} Jul 06 19:10:51.736066 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.735901 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5756b9455-szd25" event={"ID":"75a41da5-156a-4785-9e7b-63eaf701e05b","Type":"ContainerStarted","Data":"511660bd4b45cad444c257c930d4c524785b199f2077cec7ff210e467ceaa00b"} Jul 06 19:10:51.746562 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.746525 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:51.747677 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.747799 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.747799 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.747799 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dznzw\" (UniqueName: \"kubernetes.io/projected/7b292720-0058-47c5-ac69-bce7dde70ffc-kube-api-access-dznzw\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.747799 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.747981 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.747806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b292720-0058-47c5-ac69-bce7dde70ffc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.748511 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.748485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b292720-0058-47c5-ac69-bce7dde70ffc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.749310 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.749292 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:51.751084 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.751057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-ca\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.751189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.751089 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.751189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.751125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.751189 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.751167 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b292720-0058-47c5-ac69-bce7dde70ffc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.759939 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.759899 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5756b9455-szd25" podStartSLOduration=33.759885377 podStartE2EDuration="33.759885377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:51.759743246 +0000 UTC m=+76.054534912" watchObservedRunningTime="2026-07-06 19:10:51.759885377 +0000 UTC m=+76.054677037" Jul 06 19:10:51.763493 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.763472 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dznzw\" (UniqueName: \"kubernetes.io/projected/7b292720-0058-47c5-ac69-bce7dde70ffc-kube-api-access-dznzw\") pod \"cluster-proxy-proxy-agent-7b5dd79958-77222\" (UID: \"7b292720-0058-47c5-ac69-bce7dde70ffc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:51.911434 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:51.911347 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" Jul 06 19:10:52.046773 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:52.046737 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222"] Jul 06 19:10:52.049230 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:10:52.049202 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b292720_0058_47c5_ac69_bce7dde70ffc.slice/crio-6afcb219ac62bd02f6b92552e06ce287a1822938a4b4e25af616dad34b246d20 WatchSource:0}: Error finding container 6afcb219ac62bd02f6b92552e06ce287a1822938a4b4e25af616dad34b246d20: Status 404 returned error can't find the container with id 6afcb219ac62bd02f6b92552e06ce287a1822938a4b4e25af616dad34b246d20 Jul 06 19:10:52.743069 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:52.743017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" event={"ID":"7b292720-0058-47c5-ac69-bce7dde70ffc","Type":"ContainerStarted","Data":"6afcb219ac62bd02f6b92552e06ce287a1822938a4b4e25af616dad34b246d20"} Jul 06 19:10:52.743629 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:52.743251 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:52.744913 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:52.744888 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5756b9455-szd25" Jul 06 19:10:55.757609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:55.757453 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" event={"ID":"7b292720-0058-47c5-ac69-bce7dde70ffc","Type":"ContainerStarted","Data":"869b910f8ab4790c261746ee7a5ecc5f3300a2c7bdcf15b95152ab521bfa1fee"} Jul 06 19:10:55.757609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:55.757500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" event={"ID":"7b292720-0058-47c5-ac69-bce7dde70ffc","Type":"ContainerStarted","Data":"25d3602f6cb53b5820c6229c968c64a878fb348f6a208a91ae111a625c977481"} Jul 06 19:10:55.757609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:55.757519 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" event={"ID":"7b292720-0058-47c5-ac69-bce7dde70ffc","Type":"ContainerStarted","Data":"791f2be3efc44f63168aa4f68d714f5421df0c2f4bf35017726a4737de91cdf6"} Jul 06 19:10:55.779418 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:10:55.779370 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b5dd79958-77222" podStartSLOduration=1.416221596 podStartE2EDuration="4.779355366s" totalImagesPullingTime="3.36313377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:55.778637341 +0000 UTC m=+80.073429008" watchObservedRunningTime="2026-07-06 19:10:55.779355366 +0000 UTC m=+80.074147031" Jul 06 19:11:00.738077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:00.738039 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rzgj7" Jul 06 19:11:06.753567 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.753510 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4q496"] Jul 06 19:11:06.756823 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.756802 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.759589 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.759569 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:11:06.759741 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.759726 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:11:06.760304 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.760291 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rphr7\"" Jul 06 19:11:06.760363 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.760346 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:11:06.760609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.760587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:11:06.760654 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.760588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:11:06.760654 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.760588 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:11:06.854492 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-textfile\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854492 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-root\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9sw\" (UniqueName: \"kubernetes.io/projected/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-kube-api-access-9s9sw\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-wtmp\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854747 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-metrics-client-ca\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.854956 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.854760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-sys\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.955830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.955776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.955830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.955829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9sw\" (UniqueName: \"kubernetes.io/projected/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-kube-api-access-9s9sw\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.955941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-wtmp\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.955973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-metrics-client-ca\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-sys\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-textfile\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956077 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-root\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956123 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-wtmp\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-sys\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956196 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-root\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:11:06.956228 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:11:06.956351 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:11:06.956293 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls podName:eb0ede0b-5e8e-446e-a65e-b8adbc0bda36 nodeName:}" failed. No retries permitted until 2026-07-06 19:11:07.456271889 +0000 UTC m=+91.751063536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls") pod "node-exporter-4q496" (UID: "eb0ede0b-5e8e-446e-a65e-b8adbc0bda36") : secret "node-exporter-tls" not found Jul 06 19:11:06.956718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-textfile\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.956718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.956586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-metrics-client-ca\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.958526 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.958506 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:06.964410 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:06.964388 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9sw\" (UniqueName: \"kubernetes.io/projected/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-kube-api-access-9s9sw\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:07.459342 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.459302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:07.462059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.462031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb0ede0b-5e8e-446e-a65e-b8adbc0bda36-node-exporter-tls\") pod \"node-exporter-4q496\" (UID: \"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36\") " pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:07.665440 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.665402 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q496" Jul 06 19:11:07.676813 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:11:07.676779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0ede0b_5e8e_446e_a65e_b8adbc0bda36.slice/crio-1b8970ccb2d45473a08c8e676a8c5e9bb79c769e96cc9aa183ddeb656559052b WatchSource:0}: Error finding container 1b8970ccb2d45473a08c8e676a8c5e9bb79c769e96cc9aa183ddeb656559052b: Status 404 returned error can't find the container with id 1b8970ccb2d45473a08c8e676a8c5e9bb79c769e96cc9aa183ddeb656559052b Jul 06 19:11:07.784575 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.784480 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:07.788064 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.788049 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.791160 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791134 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:11:07.791313 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791225 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:11:07.791313 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791227 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:11:07.791313 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791250 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:11:07.791313 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:11:07.791701 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:11:07.791701 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791696 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:11:07.791877 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791711 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hr988\"" Jul 06 19:11:07.791877 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.791700 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:11:07.792939 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.792915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:11:07.797592 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.797570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q496" event={"ID":"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36","Type":"ContainerStarted","Data":"1b8970ccb2d45473a08c8e676a8c5e9bb79c769e96cc9aa183ddeb656559052b"} Jul 06 19:11:07.804240 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.804220 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:07.863490 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-web-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863708 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-out\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsh7v\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-kube-api-access-vsh7v\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.863876 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.864085 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.864085 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.863935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.964825 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.964789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.964825 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.964827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965031 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.964846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965031 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.964971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965031 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965031 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-web-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-out\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965239 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsh7v\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-kube-api-access-vsh7v\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.965521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:11:07.965454 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 19:11:07.965521 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:11:07.965518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls podName:ffb03af0-574f-46cc-8a6f-8df3c54c8fbf nodeName:}" failed. No retries permitted until 2026-07-06 19:11:08.465496192 +0000 UTC m=+92.760287838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ffb03af0-574f-46cc-8a6f-8df3c54c8fbf") : secret "alertmanager-main-tls" not found Jul 06 19:11:07.965928 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.965768 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968673 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968795 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968795 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968758 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968795 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968769 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-out\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968841 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-web-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.968859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.968948 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:11:07.968851 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle podName:ffb03af0-574f-46cc-8a6f-8df3c54c8fbf nodeName:}" failed. No retries permitted until 2026-07-06 19:11:08.468831662 +0000 UTC m=+92.763623309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ffb03af0-574f-46cc-8a6f-8df3c54c8fbf") : configmap references non-existent config key: ca-bundle.crt Jul 06 19:11:07.969102 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.969084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.969226 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.969207 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:07.976926 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:07.976905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsh7v\" (UniqueName: \"kubernetes.io/projected/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-kube-api-access-vsh7v\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.469111 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.469074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.469322 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.469168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.470004 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.469975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.471996 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.471973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ffb03af0-574f-46cc-8a6f-8df3c54c8fbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.698916 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.698877 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:11:08.866299 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:08.866268 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:11:08.869844 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:11:08.869817 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb03af0_574f_46cc_8a6f_8df3c54c8fbf.slice/crio-edfd96fe289678f8795010c892ddef020daf51258f8826261c8f4f826a3cc48a WatchSource:0}: Error finding container edfd96fe289678f8795010c892ddef020daf51258f8826261c8f4f826a3cc48a: Status 404 returned error can't find the container with id edfd96fe289678f8795010c892ddef020daf51258f8826261c8f4f826a3cc48a Jul 06 19:11:09.806431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:09.806394 2575 generic.go:356] "Generic (PLEG): container finished" podID="eb0ede0b-5e8e-446e-a65e-b8adbc0bda36" containerID="095641086a71fe756dae910a599e7799f79e24e916799a89ae03b377a76a8087" exitCode=0 Jul 06 19:11:09.806631 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:09.806483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q496" event={"ID":"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36","Type":"ContainerDied","Data":"095641086a71fe756dae910a599e7799f79e24e916799a89ae03b377a76a8087"} Jul 06 19:11:09.807914 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:09.807879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"edfd96fe289678f8795010c892ddef020daf51258f8826261c8f4f826a3cc48a"} Jul 06 19:11:10.815089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:10.815046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q496" event={"ID":"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36","Type":"ContainerStarted","Data":"afa9ef292135bd6a367af932d1e4a1e36599c1c75dcf239df129349b79f1fd4d"} Jul 06 19:11:10.815522 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:10.815122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q496" event={"ID":"eb0ede0b-5e8e-446e-a65e-b8adbc0bda36","Type":"ContainerStarted","Data":"d2afdfc0bf5f00424469b28d3ee0b3ea7ba48617a288ce01e35ac04fa547cb05"} Jul 06 19:11:10.816659 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:10.816634 2575 generic.go:356] "Generic (PLEG): container finished" podID="ffb03af0-574f-46cc-8a6f-8df3c54c8fbf" containerID="90b8dd358a0519c6d2f9d0e622637a062f6a966a4f2154e8c729d27438b1724d" exitCode=0 Jul 06 19:11:10.816752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:10.816692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerDied","Data":"90b8dd358a0519c6d2f9d0e622637a062f6a966a4f2154e8c729d27438b1724d"} Jul 06 19:11:10.835006 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:10.834949 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4q496" podStartSLOduration=3.684164404 podStartE2EDuration="4.834933522s" totalImagesPullingTime="1.075887612s" totalInitContainerRuntime="74.881506ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:10.834041293 +0000 UTC m=+95.128832983" watchObservedRunningTime="2026-07-06 19:11:10.834933522 +0000 UTC m=+95.129725188" Jul 06 19:11:12.828694 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:12.828526 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"4729dd369ea84b248d275978ca267f7af77ec2e1f1822540f513a60809aacff4"} Jul 06 19:11:12.829086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:12.828743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"c370363205c83f3b790ba889b4299e7746208fef03ebf21335b8b30e43d53e12"} Jul 06 19:11:12.829086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:12.828792 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"3c9748944200eb189bdfd167fa80db83c3a607fde242024c2de3ae0640308ee1"} Jul 06 19:11:12.829086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:12.828834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"2133e9a21664e28b8eb61ab8b53a8d48a9dc44c229f6539cf97d1bf266df902d"} Jul 06 19:11:13.835176 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:13.835093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"6dfd6bc3e728f1052c6024af873ea85fd84368b4a8579d37ea82372f2f78f9c4"} Jul 06 19:11:13.835176 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:13.835157 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ffb03af0-574f-46cc-8a6f-8df3c54c8fbf","Type":"ContainerStarted","Data":"377c70080fe1fe87280737fed5eafbe53020aec586405b0027865380fd99b021"} Jul 06 19:11:13.868830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:13.868775 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.294673065 podStartE2EDuration="6.868757928s" totalImagesPullingTime="3.552231759s" totalInitContainerRuntime="21.853104ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:11:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:11:13.866711204 +0000 UTC m=+98.161502873" watchObservedRunningTime="2026-07-06 19:11:13.868757928 +0000 UTC m=+98.163549594" Jul 06 19:11:15.704437 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:15.704408 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t5j4j" Jul 06 19:11:39.925786 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:39.925753 2575 generic.go:356] "Generic (PLEG): container finished" podID="745bf144-0d11-4b3a-a4cd-bab882f86c09" containerID="40591dac7abd1f7871043e8b83ac41402ede0d550b40f7ad43d254b3209d5295" exitCode=0 Jul 06 19:11:39.926187 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:39.925826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" event={"ID":"745bf144-0d11-4b3a-a4cd-bab882f86c09","Type":"ContainerDied","Data":"40591dac7abd1f7871043e8b83ac41402ede0d550b40f7ad43d254b3209d5295"} Jul 06 19:11:39.926187 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:39.926111 2575 scope.go:117] "RemoveContainer" containerID="40591dac7abd1f7871043e8b83ac41402ede0d550b40f7ad43d254b3209d5295" Jul 06 19:11:40.930679 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:11:40.930645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7ct58" event={"ID":"745bf144-0d11-4b3a-a4cd-bab882f86c09","Type":"ContainerStarted","Data":"dfc361a14923348afc89c763e93b8704fc9c7140914f4a768bca101e16e2a298"} Jul 06 19:12:30.982696 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.982609 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cf6659646-dhs54"] Jul 06 19:12:30.985300 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.985280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:30.987615 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987591 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:12:30.987615 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987609 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bwb49\"" Jul 06 19:12:30.987813 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987630 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:12:30.987813 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987591 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:12:30.987813 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:12:30.987813 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.987717 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:12:30.992995 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:30.992971 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:12:31.001295 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.001261 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf6659646-dhs54"] Jul 06 19:12:31.108790 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.108979 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-metrics-client-ca\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.108979 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.108979 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.108979 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-federate-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.109141 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.108995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-serving-certs-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.109141 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.109015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.109141 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.109031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhr6\" (UniqueName: \"kubernetes.io/projected/cb9bbad3-f4fd-4810-8055-357ab830f3d8-kube-api-access-dnhr6\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210161 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-federate-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210161 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-serving-certs-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhr6\" (UniqueName: \"kubernetes.io/projected/cb9bbad3-f4fd-4810-8055-357ab830f3d8-kube-api-access-dnhr6\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210305 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-metrics-client-ca\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.210427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.210366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.211071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.211044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-serving-certs-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.211298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.211119 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-metrics-client-ca\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.211381 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.211355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.213176 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.213057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-telemeter-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.213176 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.213113 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.213495 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.213472 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-federate-client-tls\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.213596 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.213478 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb9bbad3-f4fd-4810-8055-357ab830f3d8-secret-telemeter-client\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.218350 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.218324 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhr6\" (UniqueName: \"kubernetes.io/projected/cb9bbad3-f4fd-4810-8055-357ab830f3d8-kube-api-access-dnhr6\") pod \"telemeter-client-7cf6659646-dhs54\" (UID: \"cb9bbad3-f4fd-4810-8055-357ab830f3d8\") " pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.296886 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.296781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" Jul 06 19:12:31.446507 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:31.446475 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf6659646-dhs54"] Jul 06 19:12:31.448389 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:12:31.448357 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9bbad3_f4fd_4810_8055_357ab830f3d8.slice/crio-fbf219325b515c145a395e7b67e8ab5544ccc14aa556f765ac4298e866445d1e WatchSource:0}: Error finding container fbf219325b515c145a395e7b67e8ab5544ccc14aa556f765ac4298e866445d1e: Status 404 returned error can't find the container with id fbf219325b515c145a395e7b67e8ab5544ccc14aa556f765ac4298e866445d1e Jul 06 19:12:32.113461 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:32.113424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" event={"ID":"cb9bbad3-f4fd-4810-8055-357ab830f3d8","Type":"ContainerStarted","Data":"fbf219325b515c145a395e7b67e8ab5544ccc14aa556f765ac4298e866445d1e"} Jul 06 19:12:34.122799 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:34.122762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" event={"ID":"cb9bbad3-f4fd-4810-8055-357ab830f3d8","Type":"ContainerStarted","Data":"d63089516b5c14c75977e1cce59b1a1cb4a65ffa16174733479a1e87a4d9fd3c"} Jul 06 19:12:34.123210 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:34.122832 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" event={"ID":"cb9bbad3-f4fd-4810-8055-357ab830f3d8","Type":"ContainerStarted","Data":"2d9388eee2a168a17a67207f1f5fdd696b9a7da9fca1abf510af833920265972"} Jul 06 19:12:34.123210 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:34.122857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" event={"ID":"cb9bbad3-f4fd-4810-8055-357ab830f3d8","Type":"ContainerStarted","Data":"8f19678d2104e3f769ea6411ec7074c0c705f78bd927f1fcfad9153c7a24d045"} Jul 06 19:12:34.143306 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:12:34.143252 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cf6659646-dhs54" podStartSLOduration=1.656879979 podStartE2EDuration="4.143228869s" totalImagesPullingTime="2.48634889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:34.14289634 +0000 UTC m=+178.437688006" watchObservedRunningTime="2026-07-06 19:12:34.143228869 +0000 UTC m=+178.438020535" Jul 06 19:14:34.604635 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.604600 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr"] Jul 06 19:14:34.606750 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.606732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.609292 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.609270 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:14:34.610352 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.610332 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:14:34.610352 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.610349 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:14:34.610523 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.610367 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ckxcj\"" Jul 06 19:14:34.610523 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.610369 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:14:34.610523 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.610415 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:14:34.623519 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.623496 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr"] Jul 06 19:14:34.784068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.783951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.784068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.784025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-metrics-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.784068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.784074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q4h\" (UniqueName: \"kubernetes.io/projected/4374558b-4a42-4db6-8116-bdafc2d29427-kube-api-access-24q4h\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.784305 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.784173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4374558b-4a42-4db6-8116-bdafc2d29427-manager-config\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.885086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.884997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.885086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.885056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-metrics-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.885086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.885087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q4h\" (UniqueName: \"kubernetes.io/projected/4374558b-4a42-4db6-8116-bdafc2d29427-kube-api-access-24q4h\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.885311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.885119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4374558b-4a42-4db6-8116-bdafc2d29427-manager-config\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.885778 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.885753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4374558b-4a42-4db6-8116-bdafc2d29427-manager-config\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.887814 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.887779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-metrics-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.887932 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.887779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4374558b-4a42-4db6-8116-bdafc2d29427-cert\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.897143 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.897116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q4h\" (UniqueName: \"kubernetes.io/projected/4374558b-4a42-4db6-8116-bdafc2d29427-kube-api-access-24q4h\") pod \"lws-controller-manager-78958bf977-r5hwr\" (UID: \"4374558b-4a42-4db6-8116-bdafc2d29427\") " pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:34.916056 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:34.916019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:35.070246 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:35.070223 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr"] Jul 06 19:14:35.072763 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:14:35.072737 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4374558b_4a42_4db6_8116_bdafc2d29427.slice/crio-ed842927c5c7a8a59371921dcd4ef643e621e75dc4897e0988b255de0791d42a WatchSource:0}: Error finding container ed842927c5c7a8a59371921dcd4ef643e621e75dc4897e0988b255de0791d42a: Status 404 returned error can't find the container with id ed842927c5c7a8a59371921dcd4ef643e621e75dc4897e0988b255de0791d42a Jul 06 19:14:35.555617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:35.555581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" event={"ID":"4374558b-4a42-4db6-8116-bdafc2d29427","Type":"ContainerStarted","Data":"ed842927c5c7a8a59371921dcd4ef643e621e75dc4897e0988b255de0791d42a"} Jul 06 19:14:36.068173 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.068140 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85"] Jul 06 19:14:36.071412 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.071388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.074142 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.074111 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:14:36.074860 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.074844 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:14:36.074986 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.074965 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:14:36.075064 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.075020 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wpwt9\"" Jul 06 19:14:36.075064 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.075040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:14:36.095062 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.095032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85"] Jul 06 19:14:36.125801 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.125768 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:14:36.131262 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.131234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:14:36.131695 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.131674 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:14:36.136505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.136484 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:14:36.138038 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.138022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:14:36.196525 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.196470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-webhook-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.196525 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.196526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ghf\" (UniqueName: \"kubernetes.io/projected/524d804f-ff6a-447c-9310-d328fe48f18c-kube-api-access-g7ghf\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.196805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.196624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-manifests\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.196805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.196659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-tmp\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.196805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.196682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.297880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.297725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-webhook-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.297880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.297759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ghf\" (UniqueName: \"kubernetes.io/projected/524d804f-ff6a-447c-9310-d328fe48f18c-kube-api-access-g7ghf\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.297880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.297808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-manifests\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.297880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.297844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-tmp\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.297880 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.297872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.306777 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.298184 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-manifests\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.306777 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.300044 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:14:36.306777 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.300379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/524d804f-ff6a-447c-9310-d328fe48f18c-tmp\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.306777 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.306184 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:14:36.311057 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.311027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.311185 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.311142 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/524d804f-ff6a-447c-9310-d328fe48f18c-webhook-cert\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.317019 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.316985 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:14:36.327917 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.327852 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ghf\" (UniqueName: \"kubernetes.io/projected/524d804f-ff6a-447c-9310-d328fe48f18c-kube-api-access-g7ghf\") pod \"opendatahub-operator-controller-manager-55c47dfb7f-z6w85\" (UID: \"524d804f-ff6a-447c-9310-d328fe48f18c\") " pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.385112 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.385083 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wpwt9\"" Jul 06 19:14:36.393048 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.393023 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:36.528649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.528616 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85"] Jul 06 19:14:36.532568 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:14:36.532528 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524d804f_ff6a_447c_9310_d328fe48f18c.slice/crio-944bfa48c8295d51c96ecb78dd0c3746e1c405606b19d596ddbb6b6398bf25af WatchSource:0}: Error finding container 944bfa48c8295d51c96ecb78dd0c3746e1c405606b19d596ddbb6b6398bf25af: Status 404 returned error can't find the container with id 944bfa48c8295d51c96ecb78dd0c3746e1c405606b19d596ddbb6b6398bf25af Jul 06 19:14:36.560208 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:36.560171 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" event={"ID":"524d804f-ff6a-447c-9310-d328fe48f18c","Type":"ContainerStarted","Data":"944bfa48c8295d51c96ecb78dd0c3746e1c405606b19d596ddbb6b6398bf25af"} Jul 06 19:14:40.578706 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:40.578660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" event={"ID":"524d804f-ff6a-447c-9310-d328fe48f18c","Type":"ContainerStarted","Data":"cd42ca5fdf5512483178edd2b76d0acb6462b25fc0f9a04b62f327328b1b5215"} Jul 06 19:14:41.583918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:41.583871 2575 generic.go:356] "Generic (PLEG): container finished" podID="524d804f-ff6a-447c-9310-d328fe48f18c" containerID="cd42ca5fdf5512483178edd2b76d0acb6462b25fc0f9a04b62f327328b1b5215" exitCode=0 Jul 06 19:14:41.584367 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:41.583961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" event={"ID":"524d804f-ff6a-447c-9310-d328fe48f18c","Type":"ContainerDied","Data":"cd42ca5fdf5512483178edd2b76d0acb6462b25fc0f9a04b62f327328b1b5215"} Jul 06 19:14:41.584410 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:41.584399 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:14:42.590861 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:42.590824 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" event={"ID":"524d804f-ff6a-447c-9310-d328fe48f18c","Type":"ContainerStarted","Data":"715009accff6e3d81d9ad3c2a5996abf2dc0d4fcd421a648e68706bc11b05d66"} Jul 06 19:14:42.591321 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:42.590970 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:42.610881 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:42.610827 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" podStartSLOduration=1.413304355 podStartE2EDuration="6.610812505s" totalImagesPullingTime="4.175545758s" totalInitContainerRuntime="1.021962392s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:42.608956623 +0000 UTC m=+306.903748289" watchObservedRunningTime="2026-07-06 19:14:42.610812505 +0000 UTC m=+306.905604170" Jul 06 19:14:53.597084 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:53.597005 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55c47dfb7f-z6w85" Jul 06 19:14:53.634970 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:53.634914 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" event={"ID":"4374558b-4a42-4db6-8116-bdafc2d29427","Type":"ContainerStarted","Data":"9a0c06aa639d6dadbb3f4b48f25c68724ebd3b7b3736aa4307d455dd3251b4bf"} Jul 06 19:14:53.635135 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:53.635051 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:14:53.652896 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:14:53.652840 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" podStartSLOduration=1.444168827 podStartE2EDuration="19.652819959s" totalImagesPullingTime="18.208651132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:53.652167651 +0000 UTC m=+317.946959352" watchObservedRunningTime="2026-07-06 19:14:53.652819959 +0000 UTC m=+317.947611625" Jul 06 19:15:04.366221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.366185 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt"] Jul 06 19:15:04.372141 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.372116 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.374482 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.374455 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:15:04.374482 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.374477 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:15:04.374686 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.374477 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6hkf6\"" Jul 06 19:15:04.374686 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.374504 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:15:04.374686 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.374613 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:15:04.381563 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.381525 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt"] Jul 06 19:15:04.429029 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.428999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsg44\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-kube-api-access-fsg44\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429110 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9225492a-f0b2-4a74-95b0-cd36f7ac077e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.429218 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.429206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530470 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsg44\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-kube-api-access-fsg44\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9225492a-f0b2-4a74-95b0-cd36f7ac077e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.530932 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.530687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.531568 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.531512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.533086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.533065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9225492a-f0b2-4a74-95b0-cd36f7ac077e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.533431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.533402 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.533712 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.533691 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.533980 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.533960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9225492a-f0b2-4a74-95b0-cd36f7ac077e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.541897 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.541871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.548226 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.548207 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsg44\" (UniqueName: \"kubernetes.io/projected/9225492a-f0b2-4a74-95b0-cd36f7ac077e-kube-api-access-fsg44\") pod \"istiod-openshift-gateway-94bb8fbfd-h6vbt\" (UID: \"9225492a-f0b2-4a74-95b0-cd36f7ac077e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.641168 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.641091 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78958bf977-r5hwr" Jul 06 19:15:04.681672 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.681645 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:04.831854 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:04.831795 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt"] Jul 06 19:15:04.835037 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:15:04.834994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9225492a_f0b2_4a74_95b0_cd36f7ac077e.slice/crio-16a8de19dedfc2010319655db5712fe2fd765fec7057f41dca8bbd8175c6d3b6 WatchSource:0}: Error finding container 16a8de19dedfc2010319655db5712fe2fd765fec7057f41dca8bbd8175c6d3b6: Status 404 returned error can't find the container with id 16a8de19dedfc2010319655db5712fe2fd765fec7057f41dca8bbd8175c6d3b6 Jul 06 19:15:05.683839 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:05.683710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" event={"ID":"9225492a-f0b2-4a74-95b0-cd36f7ac077e","Type":"ContainerStarted","Data":"16a8de19dedfc2010319655db5712fe2fd765fec7057f41dca8bbd8175c6d3b6"} Jul 06 19:15:07.384267 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:07.384228 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 19:15:07.384565 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:07.384297 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 19:15:07.694272 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:07.694236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" event={"ID":"9225492a-f0b2-4a74-95b0-cd36f7ac077e","Type":"ContainerStarted","Data":"5c8a7100027ba5b436e59e778e9c9970670cfc55acd3395f2c81c53ed4b1d805"} Jul 06 19:15:07.694473 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:07.694362 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:15:07.718673 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:07.718615 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" podStartSLOduration=1.171505518 podStartE2EDuration="3.71859762s" totalImagesPullingTime="2.547092102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:07.717647538 +0000 UTC m=+332.012439203" watchObservedRunningTime="2026-07-06 19:15:07.71859762 +0000 UTC m=+332.013389286" Jul 06 19:15:08.700004 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:15:08.699974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-h6vbt" Jul 06 19:17:43.799500 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.799456 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:17:43.802907 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.802885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.805348 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.805313 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 19:17:43.805577 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.805559 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:17:43.805649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.805605 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:17:43.806483 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.806461 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bdxch\"" Jul 06 19:17:43.813441 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.813419 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:17:43.829565 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.829514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.829728 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.829583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjtx\" (UniqueName: \"kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.891762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.891732 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:17:43.930461 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.930424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.930658 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.930475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjtx\" (UniqueName: \"kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.931071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.931050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:43.938604 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:43.938542 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjtx\" (UniqueName: \"kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx\") pod \"limitador-limitador-64c94fd64f-k9dhd\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:44.119138 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:44.119038 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:44.253454 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:44.253432 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:17:44.255901 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:17:44.255872 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404e4fc6_a623_4e8a_9457_4f62189c5460.slice/crio-54b49f1b7d76e0117e0eb96e682a88d3edaadc1b118e3366a5b69ac7153349c8 WatchSource:0}: Error finding container 54b49f1b7d76e0117e0eb96e682a88d3edaadc1b118e3366a5b69ac7153349c8: Status 404 returned error can't find the container with id 54b49f1b7d76e0117e0eb96e682a88d3edaadc1b118e3366a5b69ac7153349c8 Jul 06 19:17:44.323007 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:44.322967 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" event={"ID":"404e4fc6-a623-4e8a-9457-4f62189c5460","Type":"ContainerStarted","Data":"54b49f1b7d76e0117e0eb96e682a88d3edaadc1b118e3366a5b69ac7153349c8"} Jul 06 19:17:47.337256 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:47.337224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" event={"ID":"404e4fc6-a623-4e8a-9457-4f62189c5460","Type":"ContainerStarted","Data":"acc631eabcebcb3c2adc340e91f6fcb290037bec92bdf2e9de7634273984d4c1"} Jul 06 19:17:47.337703 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:47.337354 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:47.351633 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:47.351581 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" podStartSLOduration=1.7916407410000001 podStartE2EDuration="4.351539449s" totalImagesPullingTime="2.559898708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:47.35108725 +0000 UTC m=+491.645878945" watchObservedRunningTime="2026-07-06 19:17:47.351539449 +0000 UTC m=+491.646331114" Jul 06 19:17:58.342574 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:58.342520 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:58.959461 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:58.959423 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:17:58.959654 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:58.959610 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" podUID="404e4fc6-a623-4e8a-9457-4f62189c5460" containerName="limitador" containerID="cri-o://acc631eabcebcb3c2adc340e91f6fcb290037bec92bdf2e9de7634273984d4c1" gracePeriod=30 Jul 06 19:17:59.386185 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.386157 2575 generic.go:356] "Generic (PLEG): container finished" podID="404e4fc6-a623-4e8a-9457-4f62189c5460" containerID="acc631eabcebcb3c2adc340e91f6fcb290037bec92bdf2e9de7634273984d4c1" exitCode=0 Jul 06 19:17:59.386491 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.386232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" event={"ID":"404e4fc6-a623-4e8a-9457-4f62189c5460","Type":"ContainerDied","Data":"acc631eabcebcb3c2adc340e91f6fcb290037bec92bdf2e9de7634273984d4c1"} Jul 06 19:17:59.497028 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.497007 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:17:59.555810 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.555723 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file\") pod \"404e4fc6-a623-4e8a-9457-4f62189c5460\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " Jul 06 19:17:59.555810 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.555783 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmjtx\" (UniqueName: \"kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx\") pod \"404e4fc6-a623-4e8a-9457-4f62189c5460\" (UID: \"404e4fc6-a623-4e8a-9457-4f62189c5460\") " Jul 06 19:17:59.556113 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.556091 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file" (OuterVolumeSpecName: "config-file") pod "404e4fc6-a623-4e8a-9457-4f62189c5460" (UID: "404e4fc6-a623-4e8a-9457-4f62189c5460"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:17:59.558032 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.558008 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx" (OuterVolumeSpecName: "kube-api-access-vmjtx") pod "404e4fc6-a623-4e8a-9457-4f62189c5460" (UID: "404e4fc6-a623-4e8a-9457-4f62189c5460"). InnerVolumeSpecName "kube-api-access-vmjtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:17:59.656786 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.656750 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/404e4fc6-a623-4e8a-9457-4f62189c5460-config-file\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:17:59.656786 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:17:59.656778 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmjtx\" (UniqueName: \"kubernetes.io/projected/404e4fc6-a623-4e8a-9457-4f62189c5460-kube-api-access-vmjtx\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:18:00.391334 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:00.391306 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" Jul 06 19:18:00.391776 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:00.391340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k9dhd" event={"ID":"404e4fc6-a623-4e8a-9457-4f62189c5460","Type":"ContainerDied","Data":"54b49f1b7d76e0117e0eb96e682a88d3edaadc1b118e3366a5b69ac7153349c8"} Jul 06 19:18:00.391776 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:00.391407 2575 scope.go:117] "RemoveContainer" containerID="acc631eabcebcb3c2adc340e91f6fcb290037bec92bdf2e9de7634273984d4c1" Jul 06 19:18:00.407092 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:00.407059 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:18:00.413049 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:00.413017 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k9dhd"] Jul 06 19:18:02.328655 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.328618 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404e4fc6-a623-4e8a-9457-4f62189c5460" path="/var/lib/kubelet/pods/404e4fc6-a623-4e8a-9457-4f62189c5460/volumes" Jul 06 19:18:02.422213 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.422183 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-sq4bn"] Jul 06 19:18:02.422480 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.422468 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404e4fc6-a623-4e8a-9457-4f62189c5460" containerName="limitador" Jul 06 19:18:02.422529 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.422482 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="404e4fc6-a623-4e8a-9457-4f62189c5460" containerName="limitador" Jul 06 19:18:02.422585 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.422567 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="404e4fc6-a623-4e8a-9457-4f62189c5460" containerName="limitador" Jul 06 19:18:02.427227 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.427208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.429565 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.429523 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 19:18:02.429670 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.429523 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h4c9n\"" Jul 06 19:18:02.432123 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.432102 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-sq4bn"] Jul 06 19:18:02.477901 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.477872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56j2j\" (UniqueName: \"kubernetes.io/projected/2e446f84-5f31-4397-9a90-226190dbb9b3-kube-api-access-56j2j\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.477901 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.477899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e446f84-5f31-4397-9a90-226190dbb9b3-data\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.578529 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.578492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56j2j\" (UniqueName: \"kubernetes.io/projected/2e446f84-5f31-4397-9a90-226190dbb9b3-kube-api-access-56j2j\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.578529 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.578527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e446f84-5f31-4397-9a90-226190dbb9b3-data\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.578957 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.578914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2e446f84-5f31-4397-9a90-226190dbb9b3-data\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.588749 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.588719 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56j2j\" (UniqueName: \"kubernetes.io/projected/2e446f84-5f31-4397-9a90-226190dbb9b3-kube-api-access-56j2j\") pod \"postgres-69fb4594cf-sq4bn\" (UID: \"2e446f84-5f31-4397-9a90-226190dbb9b3\") " pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.738698 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.738661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:02.864453 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:02.864372 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-sq4bn"] Jul 06 19:18:02.867279 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:18:02.867245 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e446f84_5f31_4397_9a90_226190dbb9b3.slice/crio-c95f5e7b32c5c7d6d4e35aefd601c5b2e7c1ae416c5a0543ae72312ee6399914 WatchSource:0}: Error finding container c95f5e7b32c5c7d6d4e35aefd601c5b2e7c1ae416c5a0543ae72312ee6399914: Status 404 returned error can't find the container with id c95f5e7b32c5c7d6d4e35aefd601c5b2e7c1ae416c5a0543ae72312ee6399914 Jul 06 19:18:03.410321 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:03.410285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-sq4bn" event={"ID":"2e446f84-5f31-4397-9a90-226190dbb9b3","Type":"ContainerStarted","Data":"c95f5e7b32c5c7d6d4e35aefd601c5b2e7c1ae416c5a0543ae72312ee6399914"} Jul 06 19:18:09.441458 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:09.441427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-sq4bn" event={"ID":"2e446f84-5f31-4397-9a90-226190dbb9b3","Type":"ContainerStarted","Data":"8e0a10a485300e57394c6b5108074c4fbe7d3da8a345a1e6e1073cf076c5321c"} Jul 06 19:18:09.441926 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:09.441571 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:09.459204 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:09.459156 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-sq4bn" podStartSLOduration=1.754062082 podStartE2EDuration="7.459140695s" totalImagesPullingTime="5.705078613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:09.457721 +0000 UTC m=+513.752512667" watchObservedRunningTime="2026-07-06 19:18:09.459140695 +0000 UTC m=+513.753932360" Jul 06 19:18:15.476306 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:15.476270 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-sq4bn" Jul 06 19:18:16.440245 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.440209 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:18:16.442413 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.442395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.445199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.445175 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:18:16.445333 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.445189 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:18:16.445333 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.445254 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7q8l6\"" Jul 06 19:18:16.446111 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.446092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 19:18:16.452169 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.452148 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:18:16.595817 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.595777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.596171 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.595828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8fb\" (UniqueName: \"kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.696535 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.696450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.696535 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.696502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8fb\" (UniqueName: \"kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.699152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.699120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.704754 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.704732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8fb\" (UniqueName: \"kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb\") pod \"authorino-5dbc88cd8-st252\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.751191 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.751169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:18:16.882607 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:16.882534 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:18:16.884834 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:18:16.884807 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd18a62_e98b_464a_b9e4_6267b3f87c78.slice/crio-680fefecce39de2b635bbab89e53a36bf65ca665abe7c77525ce075ca0ca0fa9 WatchSource:0}: Error finding container 680fefecce39de2b635bbab89e53a36bf65ca665abe7c77525ce075ca0ca0fa9: Status 404 returned error can't find the container with id 680fefecce39de2b635bbab89e53a36bf65ca665abe7c77525ce075ca0ca0fa9 Jul 06 19:18:17.478068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:17.478025 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbc88cd8-st252" event={"ID":"1dd18a62-e98b-464a-b9e4-6267b3f87c78","Type":"ContainerStarted","Data":"680fefecce39de2b635bbab89e53a36bf65ca665abe7c77525ce075ca0ca0fa9"} Jul 06 19:18:20.494939 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:20.494889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbc88cd8-st252" event={"ID":"1dd18a62-e98b-464a-b9e4-6267b3f87c78","Type":"ContainerStarted","Data":"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5"} Jul 06 19:18:20.509769 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:20.509718 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dbc88cd8-st252" podStartSLOduration=1.032551641 podStartE2EDuration="4.509703167s" totalImagesPullingTime="3.477151526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:20.509264434 +0000 UTC m=+524.804056101" watchObservedRunningTime="2026-07-06 19:18:20.509703167 +0000 UTC m=+524.804494833" Jul 06 19:18:24.999848 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:24.999812 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:18:25.002101 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.002082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.004454 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.004426 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 19:18:25.004454 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.004441 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lm8jz\"" Jul 06 19:18:25.004649 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.004427 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 19:18:25.014039 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.014016 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:18:25.178996 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.178952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bpbt\" (UniqueName: \"kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.179169 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.179026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.280541 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.280448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bpbt\" (UniqueName: \"kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.280541 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.280510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.283080 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.283061 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.289033 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.288994 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bpbt\" (UniqueName: \"kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt\") pod \"maas-controller-6bc9784b98-tgm86\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.312509 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.312454 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:25.447634 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.447476 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:18:25.451073 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:18:25.451035 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28e13b9_d7cb_4263_bc73_1c0db7f048f0.slice/crio-2fa12047a9704d52b791441fe1c746f4201a3ba02b91f9b8d09f136f25262496 WatchSource:0}: Error finding container 2fa12047a9704d52b791441fe1c746f4201a3ba02b91f9b8d09f136f25262496: Status 404 returned error can't find the container with id 2fa12047a9704d52b791441fe1c746f4201a3ba02b91f9b8d09f136f25262496 Jul 06 19:18:25.516478 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:25.516440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-tgm86" event={"ID":"b28e13b9-d7cb-4263-bc73-1c0db7f048f0","Type":"ContainerStarted","Data":"2fa12047a9704d52b791441fe1c746f4201a3ba02b91f9b8d09f136f25262496"} Jul 06 19:18:28.532211 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:28.532168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-tgm86" event={"ID":"b28e13b9-d7cb-4263-bc73-1c0db7f048f0","Type":"ContainerStarted","Data":"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988"} Jul 06 19:18:28.532698 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:28.532301 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:28.549110 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:28.549060 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc9784b98-tgm86" podStartSLOduration=2.156046139 podStartE2EDuration="4.54904574s" totalImagesPullingTime="2.392999601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:28.547759997 +0000 UTC m=+532.842551690" watchObservedRunningTime="2026-07-06 19:18:28.54904574 +0000 UTC m=+532.843837405" Jul 06 19:18:39.542735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:39.542701 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:18:58.473149 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.473117 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-742hq"] Jul 06 19:18:58.476151 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.476133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.478800 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.478775 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 19:18:58.478925 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.478775 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jnzld\"" Jul 06 19:18:58.483662 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.483637 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-742hq"] Jul 06 19:18:58.564792 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.564756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720633bd-61e4-472a-9c13-54c6113e6704-plugins-config-volume\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.564972 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.564809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2dvt\" (UniqueName: \"kubernetes.io/projected/720633bd-61e4-472a-9c13-54c6113e6704-kube-api-access-q2dvt\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.665800 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.665770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720633bd-61e4-472a-9c13-54c6113e6704-plugins-config-volume\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.665984 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.665829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2dvt\" (UniqueName: \"kubernetes.io/projected/720633bd-61e4-472a-9c13-54c6113e6704-kube-api-access-q2dvt\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.666527 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.666508 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720633bd-61e4-472a-9c13-54c6113e6704-plugins-config-volume\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.673906 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.673887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2dvt\" (UniqueName: \"kubernetes.io/projected/720633bd-61e4-472a-9c13-54c6113e6704-kube-api-access-q2dvt\") pod \"payload-pre-processing-7964457696-742hq\" (UID: \"720633bd-61e4-472a-9c13-54c6113e6704\") " pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.787733 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.787648 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:18:58.919629 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:58.919605 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-742hq"] Jul 06 19:18:58.921949 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:18:58.921923 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720633bd_61e4_472a_9c13_54c6113e6704.slice/crio-3a6be8872663e917aee729140106da32b46342d97475145225dc606a87d87704 WatchSource:0}: Error finding container 3a6be8872663e917aee729140106da32b46342d97475145225dc606a87d87704: Status 404 returned error can't find the container with id 3a6be8872663e917aee729140106da32b46342d97475145225dc606a87d87704 Jul 06 19:18:59.662648 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:18:59.662611 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" event={"ID":"720633bd-61e4-472a-9c13-54c6113e6704","Type":"ContainerStarted","Data":"3a6be8872663e917aee729140106da32b46342d97475145225dc606a87d87704"} Jul 06 19:19:00.667979 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:00.667940 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" event={"ID":"720633bd-61e4-472a-9c13-54c6113e6704","Type":"ContainerStarted","Data":"f6e29b2b2a6c3f5a2107310399ca00b2d566def17c6fc9d776ff3503734d4de0"} Jul 06 19:19:00.668383 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:00.668063 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:19:00.684801 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:00.684745 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" podStartSLOduration=1.158822368 podStartE2EDuration="2.684729332s" totalImagesPullingTime="1.525906964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:00.683507486 +0000 UTC m=+564.978299152" watchObservedRunningTime="2026-07-06 19:19:00.684729332 +0000 UTC m=+564.979520997" Jul 06 19:19:11.675073 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:11.675042 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-742hq" Jul 06 19:19:36.154568 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.154524 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:19:36.157390 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.157367 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:19:36.159486 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.159461 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:19:36.162280 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.162259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:19:36.890485 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.890452 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc"] Jul 06 19:19:36.893048 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.893030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:36.896195 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.896171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:19:36.896311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.896229 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:19:36.896311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.896231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 19:19:36.896432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.896310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwzf5\"" Jul 06 19:19:36.905739 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:36.905711 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc"] Jul 06 19:19:37.003528 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.003726 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.003726 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5ft\" (UniqueName: \"kubernetes.io/projected/fc9c26af-9668-4e68-9706-3b3fb583d1ee-kube-api-access-sd5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.003726 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.003840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.003840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.003753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5ft\" (UniqueName: \"kubernetes.io/projected/fc9c26af-9668-4e68-9706-3b3fb583d1ee-kube-api-access-sd5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105588 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105657 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.105657 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.105639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.107533 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.107513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc9c26af-9668-4e68-9706-3b3fb583d1ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.107805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.107786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc9c26af-9668-4e68-9706-3b3fb583d1ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.115602 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.115535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5ft\" (UniqueName: \"kubernetes.io/projected/fc9c26af-9668-4e68-9706-3b3fb583d1ee-kube-api-access-sd5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lsrgc\" (UID: \"fc9c26af-9668-4e68-9706-3b3fb583d1ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.204444 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.204402 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:37.337792 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.337770 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc"] Jul 06 19:19:37.340256 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:19:37.340230 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9c26af_9668_4e68_9706_3b3fb583d1ee.slice/crio-4ff0dc11869f1b927c75f54165dd490d199758999907c5c4ca92169fcae5c37a WatchSource:0}: Error finding container 4ff0dc11869f1b927c75f54165dd490d199758999907c5c4ca92169fcae5c37a: Status 404 returned error can't find the container with id 4ff0dc11869f1b927c75f54165dd490d199758999907c5c4ca92169fcae5c37a Jul 06 19:19:37.832667 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:37.832626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" event={"ID":"fc9c26af-9668-4e68-9706-3b3fb583d1ee","Type":"ContainerStarted","Data":"4ff0dc11869f1b927c75f54165dd490d199758999907c5c4ca92169fcae5c37a"} Jul 06 19:19:38.838909 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:38.838874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" event={"ID":"fc9c26af-9668-4e68-9706-3b3fb583d1ee","Type":"ContainerStarted","Data":"6922caa62e597f1a263bd3ebc1cc2db6d2185e1f9a8f0082d93eb6f1284bd7dd"} Jul 06 19:19:38.857076 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:38.857021 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" podStartSLOduration=1.814248321 podStartE2EDuration="2.857006552s" totalImagesPullingTime="1.042758231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:38.855263953 +0000 UTC m=+603.150055620" watchObservedRunningTime="2026-07-06 19:19:38.857006552 +0000 UTC m=+603.151798258" Jul 06 19:19:47.205501 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:47.205459 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:47.205924 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:47.205525 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:47.218042 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:47.218015 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:47.888853 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:47.888813 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lsrgc" Jul 06 19:19:49.198814 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.198767 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8"] Jul 06 19:19:49.201715 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.201692 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.204354 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.204331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 19:19:49.212315 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.212285 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8"] Jul 06 19:19:49.316462 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.316685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pfbp\" (UniqueName: \"kubernetes.io/projected/ea88b427-8ffe-4d46-bf0b-8ebc191be226-kube-api-access-6pfbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.316685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.316685 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.316842 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.316842 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.316717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.417928 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.417896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pfbp\" (UniqueName: \"kubernetes.io/projected/ea88b427-8ffe-4d46-bf0b-8ebc191be226-kube-api-access-6pfbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.417942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.417969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.417990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.418103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418334 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.418180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418455 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.418424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418455 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.418435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.418636 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.418471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.420302 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.420274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea88b427-8ffe-4d46-bf0b-8ebc191be226-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.420529 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.420513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea88b427-8ffe-4d46-bf0b-8ebc191be226-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.429020 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.428997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pfbp\" (UniqueName: \"kubernetes.io/projected/ea88b427-8ffe-4d46-bf0b-8ebc191be226-kube-api-access-6pfbp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8\" (UID: \"ea88b427-8ffe-4d46-bf0b-8ebc191be226\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.512521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.512430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:49.643634 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.643607 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8"] Jul 06 19:19:49.646268 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:19:49.646238 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea88b427_8ffe_4d46_bf0b_8ebc191be226.slice/crio-98cb596ba1068620db4a9af8ff4aafb4a8108264fe9ea402f9f97b243f88ac9d WatchSource:0}: Error finding container 98cb596ba1068620db4a9af8ff4aafb4a8108264fe9ea402f9f97b243f88ac9d: Status 404 returned error can't find the container with id 98cb596ba1068620db4a9af8ff4aafb4a8108264fe9ea402f9f97b243f88ac9d Jul 06 19:19:49.647580 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.647563 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:19:49.886765 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.886737 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" event={"ID":"ea88b427-8ffe-4d46-bf0b-8ebc191be226","Type":"ContainerStarted","Data":"46d75ef421c7f2fc9a1ea0f6a1546fb974f3506c7d948b09cf16749e52b45b29"} Jul 06 19:19:49.886900 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.886786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" event={"ID":"ea88b427-8ffe-4d46-bf0b-8ebc191be226","Type":"ContainerStarted","Data":"98cb596ba1068620db4a9af8ff4aafb4a8108264fe9ea402f9f97b243f88ac9d"} Jul 06 19:19:49.905346 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:49.905297 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" podStartSLOduration=0.746991785 podStartE2EDuration="905.281317ms" totalImagesPullingTime="158.289532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:19:49.90350619 +0000 UTC m=+614.198297855" watchObservedRunningTime="2026-07-06 19:19:49.905281317 +0000 UTC m=+614.200072983" Jul 06 19:19:59.512787 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:59.512702 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:59.512787 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:59.512759 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:59.525362 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:59.525328 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:19:59.941252 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:19:59.941211 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8" Jul 06 19:20:07.076645 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.076610 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m"] Jul 06 19:20:07.082075 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.082048 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.084264 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.084243 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 19:20:07.089118 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.089090 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m"] Jul 06 19:20:07.177411 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.177697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177421 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdssb\" (UniqueName: \"kubernetes.io/projected/d8e91d24-106a-4756-adf3-401d3a00a81b-kube-api-access-tdssb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.177697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.177697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.177697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e91d24-106a-4756-adf3-401d3a00a81b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.177697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.177651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278087 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e91d24-106a-4756-adf3-401d3a00a81b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdssb\" (UniqueName: \"kubernetes.io/projected/d8e91d24-106a-4756-adf3-401d3a00a81b-kube-api-access-tdssb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278638 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278618 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.278699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.278670 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.280601 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.280572 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8e91d24-106a-4756-adf3-401d3a00a81b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.280755 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.280738 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8e91d24-106a-4756-adf3-401d3a00a81b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.285910 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.285891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdssb\" (UniqueName: \"kubernetes.io/projected/d8e91d24-106a-4756-adf3-401d3a00a81b-kube-api-access-tdssb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ln92m\" (UID: \"d8e91d24-106a-4756-adf3-401d3a00a81b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.393152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.393058 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:07.529278 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.529255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m"] Jul 06 19:20:07.531072 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:20:07.531042 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e91d24_106a_4756_adf3_401d3a00a81b.slice/crio-6ce7a15211dddb12bdb648a8678d7ec2645be6e884b83c384fdd3eb23094f939 WatchSource:0}: Error finding container 6ce7a15211dddb12bdb648a8678d7ec2645be6e884b83c384fdd3eb23094f939: Status 404 returned error can't find the container with id 6ce7a15211dddb12bdb648a8678d7ec2645be6e884b83c384fdd3eb23094f939 Jul 06 19:20:07.966690 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.966648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" event={"ID":"d8e91d24-106a-4756-adf3-401d3a00a81b","Type":"ContainerStarted","Data":"15e0dcbec5f7cc04e4e9d8a6143a5337ef6c0a36292913899ecdd47e9526c2eb"} Jul 06 19:20:07.966862 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.966738 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" event={"ID":"d8e91d24-106a-4756-adf3-401d3a00a81b","Type":"ContainerStarted","Data":"6ce7a15211dddb12bdb648a8678d7ec2645be6e884b83c384fdd3eb23094f939"} Jul 06 19:20:07.983930 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:07.983875 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" podStartSLOduration=0.754633587 podStartE2EDuration="983.858302ms" totalImagesPullingTime="229.224715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:07.981538598 +0000 UTC m=+632.276330261" watchObservedRunningTime="2026-07-06 19:20:07.983858302 +0000 UTC m=+632.278649968" Jul 06 19:20:17.393509 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:17.393470 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:17.394027 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:17.393538 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:17.406604 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:17.406570 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:20:18.023918 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:20:18.023890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ln92m" Jul 06 19:21:25.978508 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:25.978422 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:21:25.979057 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:25.978645 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5dbc88cd8-st252" podUID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" containerName="authorino" containerID="cri-o://1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5" gracePeriod=30 Jul 06 19:21:26.227315 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.227284 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:21:26.316199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.316101 2575 generic.go:356] "Generic (PLEG): container finished" podID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" containerID="1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5" exitCode=0 Jul 06 19:21:26.316199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.316149 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbc88cd8-st252" Jul 06 19:21:26.316199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.316191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbc88cd8-st252" event={"ID":"1dd18a62-e98b-464a-b9e4-6267b3f87c78","Type":"ContainerDied","Data":"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5"} Jul 06 19:21:26.316474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.316233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbc88cd8-st252" event={"ID":"1dd18a62-e98b-464a-b9e4-6267b3f87c78","Type":"ContainerDied","Data":"680fefecce39de2b635bbab89e53a36bf65ca665abe7c77525ce075ca0ca0fa9"} Jul 06 19:21:26.316474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.316251 2575 scope.go:117] "RemoveContainer" containerID="1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5" Jul 06 19:21:26.325038 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.325015 2575 scope.go:117] "RemoveContainer" containerID="1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5" Jul 06 19:21:26.325378 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:21:26.325355 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5\": container with ID starting with 1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5 not found: ID does not exist" containerID="1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5" Jul 06 19:21:26.325459 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.325387 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5"} err="failed to get container status \"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5\": rpc error: code = NotFound desc = could not find container \"1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5\": container with ID starting with 1b5fbcb44bab0e095b35c8114c6f1afcf26b08b54f8ae81ffa50b66645e833a5 not found: ID does not exist" Jul 06 19:21:26.393689 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.393634 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert\") pod \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " Jul 06 19:21:26.393689 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.393705 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn8fb\" (UniqueName: \"kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb\") pod \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\" (UID: \"1dd18a62-e98b-464a-b9e4-6267b3f87c78\") " Jul 06 19:21:26.396033 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.395996 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb" (OuterVolumeSpecName: "kube-api-access-jn8fb") pod "1dd18a62-e98b-464a-b9e4-6267b3f87c78" (UID: "1dd18a62-e98b-464a-b9e4-6267b3f87c78"). InnerVolumeSpecName "kube-api-access-jn8fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:21:26.404800 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.404760 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1dd18a62-e98b-464a-b9e4-6267b3f87c78" (UID: "1dd18a62-e98b-464a-b9e4-6267b3f87c78"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:21:26.494443 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.494408 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd18a62-e98b-464a-b9e4-6267b3f87c78-tls-cert\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:21:26.494443 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.494438 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn8fb\" (UniqueName: \"kubernetes.io/projected/1dd18a62-e98b-464a-b9e4-6267b3f87c78-kube-api-access-jn8fb\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:21:26.658252 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.658211 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:21:26.685489 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:26.685442 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dbc88cd8-st252"] Jul 06 19:21:28.328837 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:21:28.328807 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" path="/var/lib/kubelet/pods/1dd18a62-e98b-464a-b9e4-6267b3f87c78/volumes" Jul 06 19:22:37.907303 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:37.907259 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:22:37.907945 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:37.907652 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bc9784b98-tgm86" podUID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" containerName="manager" containerID="cri-o://4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988" gracePeriod=30 Jul 06 19:22:38.165596 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.165518 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:22:38.222762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.222732 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bpbt\" (UniqueName: \"kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt\") pod \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " Jul 06 19:22:38.222762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.222765 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert\") pod \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\" (UID: \"b28e13b9-d7cb-4263-bc73-1c0db7f048f0\") " Jul 06 19:22:38.225120 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.225081 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt" (OuterVolumeSpecName: "kube-api-access-9bpbt") pod "b28e13b9-d7cb-4263-bc73-1c0db7f048f0" (UID: "b28e13b9-d7cb-4263-bc73-1c0db7f048f0"). InnerVolumeSpecName "kube-api-access-9bpbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:22:38.225120 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.225112 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b28e13b9-d7cb-4263-bc73-1c0db7f048f0" (UID: "b28e13b9-d7cb-4263-bc73-1c0db7f048f0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:22:38.323937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.323887 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bpbt\" (UniqueName: \"kubernetes.io/projected/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-kube-api-access-9bpbt\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:22:38.323937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.323929 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b28e13b9-d7cb-4263-bc73-1c0db7f048f0-webhook-cert\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:22:38.637242 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.637201 2575 generic.go:356] "Generic (PLEG): container finished" podID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" containerID="4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988" exitCode=0 Jul 06 19:22:38.637432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.637250 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-tgm86" Jul 06 19:22:38.637432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.637258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-tgm86" event={"ID":"b28e13b9-d7cb-4263-bc73-1c0db7f048f0","Type":"ContainerDied","Data":"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988"} Jul 06 19:22:38.637432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.637320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-tgm86" event={"ID":"b28e13b9-d7cb-4263-bc73-1c0db7f048f0","Type":"ContainerDied","Data":"2fa12047a9704d52b791441fe1c746f4201a3ba02b91f9b8d09f136f25262496"} Jul 06 19:22:38.637432 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.637335 2575 scope.go:117] "RemoveContainer" containerID="4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988" Jul 06 19:22:38.646115 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.646095 2575 scope.go:117] "RemoveContainer" containerID="4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988" Jul 06 19:22:38.646384 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:22:38.646367 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988\": container with ID starting with 4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988 not found: ID does not exist" containerID="4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988" Jul 06 19:22:38.646437 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.646392 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988"} err="failed to get container status \"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988\": rpc error: code = NotFound desc = could not find container \"4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988\": container with ID starting with 4681ebd0026da57a4af8513dd1300cafc06b3a9a4fe9adfcb2db828b875a1988 not found: ID does not exist" Jul 06 19:22:38.652700 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.652657 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:22:38.655966 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:38.655941 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-tgm86"] Jul 06 19:22:39.407759 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.407718 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bc9784b98-hthlp"] Jul 06 19:22:39.408134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408048 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" containerName="authorino" Jul 06 19:22:39.408134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408059 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" containerName="authorino" Jul 06 19:22:39.408134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408069 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" containerName="manager" Jul 06 19:22:39.408134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408074 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" containerName="manager" Jul 06 19:22:39.408134 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408131 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" containerName="manager" Jul 06 19:22:39.408289 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.408141 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd18a62-e98b-464a-b9e4-6267b3f87c78" containerName="authorino" Jul 06 19:22:39.412142 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.412126 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.415167 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.415143 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 19:22:39.415412 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.415397 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 19:22:39.416271 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.416253 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lm8jz\"" Jul 06 19:22:39.422814 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.422794 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-hthlp"] Jul 06 19:22:39.535456 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.535415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j544f\" (UniqueName: \"kubernetes.io/projected/d4824ffd-5402-48dd-97f4-615367531ce5-kube-api-access-j544f\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.535675 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.535472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4824ffd-5402-48dd-97f4-615367531ce5-webhook-cert\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.636576 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.636510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4824ffd-5402-48dd-97f4-615367531ce5-webhook-cert\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.636752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.636659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j544f\" (UniqueName: \"kubernetes.io/projected/d4824ffd-5402-48dd-97f4-615367531ce5-kube-api-access-j544f\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.639330 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.639298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4824ffd-5402-48dd-97f4-615367531ce5-webhook-cert\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.645802 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.645772 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j544f\" (UniqueName: \"kubernetes.io/projected/d4824ffd-5402-48dd-97f4-615367531ce5-kube-api-access-j544f\") pod \"maas-controller-6bc9784b98-hthlp\" (UID: \"d4824ffd-5402-48dd-97f4-615367531ce5\") " pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.721890 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.721851 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:39.862295 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:39.862255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bc9784b98-hthlp"] Jul 06 19:22:39.866333 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:22:39.866306 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4824ffd_5402_48dd_97f4_615367531ce5.slice/crio-f0a6cf80c90dccca4b1ddf9c9a245c5af74fb53c34642005f0e780f5ae8016ce WatchSource:0}: Error finding container f0a6cf80c90dccca4b1ddf9c9a245c5af74fb53c34642005f0e780f5ae8016ce: Status 404 returned error can't find the container with id f0a6cf80c90dccca4b1ddf9c9a245c5af74fb53c34642005f0e780f5ae8016ce Jul 06 19:22:40.329887 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:40.329856 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28e13b9-d7cb-4263-bc73-1c0db7f048f0" path="/var/lib/kubelet/pods/b28e13b9-d7cb-4263-bc73-1c0db7f048f0/volumes" Jul 06 19:22:40.649508 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:40.649409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-hthlp" event={"ID":"d4824ffd-5402-48dd-97f4-615367531ce5","Type":"ContainerStarted","Data":"70ad201cd096092ec77944f03dbc47020918d1014b7c1c11e53c1884d1338d50"} Jul 06 19:22:40.649952 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:40.649504 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bc9784b98-hthlp" event={"ID":"d4824ffd-5402-48dd-97f4-615367531ce5","Type":"ContainerStarted","Data":"f0a6cf80c90dccca4b1ddf9c9a245c5af74fb53c34642005f0e780f5ae8016ce"} Jul 06 19:22:40.649952 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:40.649589 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:22:40.666513 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:40.666459 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bc9784b98-hthlp" podStartSLOduration=1.219756145 podStartE2EDuration="1.666443885s" totalImagesPullingTime="446.68774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:22:40.665700467 +0000 UTC m=+784.960492134" watchObservedRunningTime="2026-07-06 19:22:40.666443885 +0000 UTC m=+784.961235550" Jul 06 19:22:51.660844 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:22:51.660801 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bc9784b98-hthlp" Jul 06 19:24:36.183244 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:24:36.183212 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:24:36.186486 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:24:36.186467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:24:36.188661 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:24:36.188641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:24:36.191635 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:24:36.191619 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:29:36.214675 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:29:36.214644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:29:36.215314 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:29:36.215294 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:29:36.219311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:29:36.219290 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:29:36.220110 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:29:36.220094 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:34:36.243072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:36.243043 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:34:36.244762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:36.244737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:34:36.247826 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:36.247803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:34:36.249378 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:36.249358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:34:37.160721 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.160685 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:37.164004 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.163984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.174586 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.174563 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-215c8b19-serving-cert\"" Jul 06 19:34:37.174718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.174675 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:34:37.184487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.184459 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:37.282744 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.282706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzmdt\" (UniqueName: \"kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.283166 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.282778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.283166 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.282808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.383853 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.383821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzmdt\" (UniqueName: \"kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.384072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.383898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.384072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.383927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.384666 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.384641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.386523 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.386501 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.402019 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.401985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzmdt\" (UniqueName: \"kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt\") pod \"maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.473907 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.473874 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:37.622533 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.622509 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:37.624172 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:34:37.624148 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd94269_3e4a_44fe_9fa0_7d4a244c8ae9.slice/crio-24c7620c5ab43877148c296bc5aa1de1d6bc7912713501bbbb0011589fdc2d08 WatchSource:0}: Error finding container 24c7620c5ab43877148c296bc5aa1de1d6bc7912713501bbbb0011589fdc2d08: Status 404 returned error can't find the container with id 24c7620c5ab43877148c296bc5aa1de1d6bc7912713501bbbb0011589fdc2d08 Jul 06 19:34:37.625498 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.625479 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:34:37.787414 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:37.787321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" event={"ID":"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9","Type":"ContainerStarted","Data":"24c7620c5ab43877148c296bc5aa1de1d6bc7912713501bbbb0011589fdc2d08"} Jul 06 19:34:39.797776 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:39.797733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" event={"ID":"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9","Type":"ContainerStarted","Data":"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86"} Jul 06 19:34:39.798165 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:39.797869 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:39.830176 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:39.830116 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" podStartSLOduration=1.200996229 podStartE2EDuration="2.830100841s" totalImagesPullingTime="1.629104612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:39.829361366 +0000 UTC m=+1504.124153044" watchObservedRunningTime="2026-07-06 19:34:39.830100841 +0000 UTC m=+1504.124892506" Jul 06 19:34:42.508104 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.508071 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:42.508763 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.508245 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" podUID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" containerName="maas-api" containerID="cri-o://09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86" gracePeriod=30 Jul 06 19:34:42.762814 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.762747 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:42.815033 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.814987 2575 generic.go:356] "Generic (PLEG): container finished" podID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" containerID="09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86" exitCode=0 Jul 06 19:34:42.815222 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.815036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" event={"ID":"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9","Type":"ContainerDied","Data":"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86"} Jul 06 19:34:42.815222 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.815046 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" Jul 06 19:34:42.815222 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.815120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9" event={"ID":"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9","Type":"ContainerDied","Data":"24c7620c5ab43877148c296bc5aa1de1d6bc7912713501bbbb0011589fdc2d08"} Jul 06 19:34:42.815222 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.815143 2575 scope.go:117] "RemoveContainer" containerID="09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86" Jul 06 19:34:42.823666 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.823620 2575 scope.go:117] "RemoveContainer" containerID="09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86" Jul 06 19:34:42.823905 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:42.823883 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86\": container with ID starting with 09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86 not found: ID does not exist" containerID="09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86" Jul 06 19:34:42.823949 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.823911 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86"} err="failed to get container status \"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86\": rpc error: code = NotFound desc = could not find container \"09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86\": container with ID starting with 09a24689c0cf66752a89a91de36217aa65606ebd1695defe19ce9bbc9ba87a86 not found: ID does not exist" Jul 06 19:34:42.837274 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.837247 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls\") pod \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " Jul 06 19:34:42.837386 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.837352 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca\") pod \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " Jul 06 19:34:42.837433 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.837384 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzmdt\" (UniqueName: \"kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt\") pod \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\" (UID: \"8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9\") " Jul 06 19:34:42.837705 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.837682 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" (UID: "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:42.839596 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.839570 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt" (OuterVolumeSpecName: "kube-api-access-mzmdt") pod "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" (UID: "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9"). InnerVolumeSpecName "kube-api-access-mzmdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:42.839694 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.839649 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" (UID: "8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:34:42.938834 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.938787 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:42.938834 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.938822 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzmdt\" (UniqueName: \"kubernetes.io/projected/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-kube-api-access-mzmdt\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:42.938834 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:42.938834 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:43.146583 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:43.146534 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:43.150303 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:43.150276 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-215c8b19-6f8bb47c75-cq9x9"] Jul 06 19:34:44.329344 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:44.329305 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" path="/var/lib/kubelet/pods/8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9/volumes" Jul 06 19:34:50.405204 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.405169 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:50.405617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.405511 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" containerName="maas-api" Jul 06 19:34:50.405617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.405522 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" containerName="maas-api" Jul 06 19:34:50.405617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.405593 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd94269-3e4a-44fe-9fa0-7d4a244c8ae9" containerName="maas-api" Jul 06 19:34:50.410741 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.410711 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.413023 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.413000 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-e58cbfec-serving-cert\"" Jul 06 19:34:50.413358 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.413337 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:34:50.433859 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.433825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:50.507009 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.506965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4fk\" (UniqueName: \"kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.507190 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.507022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.507190 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.507117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.607838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.607800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4fk\" (UniqueName: \"kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.607838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.607849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.608079 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.607878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.608079 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:50.607967 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-e58cbfec-serving-cert: secret "maas-api-e2e-ait-e58cbfec-serving-cert" not found Jul 06 19:34:50.608079 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:50.608045 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls podName:ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:51.108028222 +0000 UTC m=+1515.402819867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls") pod "maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" (UID: "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1") : secret "maas-api-e2e-ait-e58cbfec-serving-cert" not found Jul 06 19:34:50.608525 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.608506 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:50.629290 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:50.629256 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4fk\" (UniqueName: \"kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:51.112486 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:51.112445 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:51.112700 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:51.112640 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-e58cbfec-serving-cert: secret "maas-api-e2e-ait-e58cbfec-serving-cert" not found Jul 06 19:34:51.112744 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:51.112705 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls podName:ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:52.112690031 +0000 UTC m=+1516.407481675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls") pod "maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" (UID: "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1") : secret "maas-api-e2e-ait-e58cbfec-serving-cert" not found Jul 06 19:34:52.123221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.123172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:52.125816 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.125787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:52.223148 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.223107 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:52.370199 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.370171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:52.372804 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:34:52.372773 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9bdbef_7dc4_4baa_820e_f5dc4b1a0ab1.slice/crio-43ee2393eb980900a47948630dd391b8e906814b417b967298ef3f4c5b3a550f WatchSource:0}: Error finding container 43ee2393eb980900a47948630dd391b8e906814b417b967298ef3f4c5b3a550f: Status 404 returned error can't find the container with id 43ee2393eb980900a47948630dd391b8e906814b417b967298ef3f4c5b3a550f Jul 06 19:34:52.861491 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.861451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" event={"ID":"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1","Type":"ContainerStarted","Data":"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c"} Jul 06 19:34:52.861722 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.861512 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" event={"ID":"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1","Type":"ContainerStarted","Data":"43ee2393eb980900a47948630dd391b8e906814b417b967298ef3f4c5b3a550f"} Jul 06 19:34:52.861722 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.861534 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:52.881070 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:52.881014 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" podStartSLOduration=2.484918209 podStartE2EDuration="2.880996852s" totalImagesPullingTime="396.078643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:52.880142451 +0000 UTC m=+1517.174934116" watchObservedRunningTime="2026-07-06 19:34:52.880996852 +0000 UTC m=+1517.175788518" Jul 06 19:34:55.844373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:55.844280 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:55.844829 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:55.844491 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" podUID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" containerName="maas-api" containerID="cri-o://cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c" gracePeriod=30 Jul 06 19:34:56.096829 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.096762 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:56.158065 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.158028 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j4fk\" (UniqueName: \"kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk\") pod \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " Jul 06 19:34:56.158273 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.158124 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") pod \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " Jul 06 19:34:56.158273 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.158159 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca\") pod \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\" (UID: \"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1\") " Jul 06 19:34:56.158592 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.158520 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" (UID: "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:56.160345 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.160322 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk" (OuterVolumeSpecName: "kube-api-access-5j4fk") pod "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" (UID: "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1"). InnerVolumeSpecName "kube-api-access-5j4fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:56.160429 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.160341 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" (UID: "ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:34:56.258937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.258895 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j4fk\" (UniqueName: \"kubernetes.io/projected/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-kube-api-access-5j4fk\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:56.258937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.258927 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:56.258937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.258936 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:34:56.879006 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.878969 2575 generic.go:356] "Generic (PLEG): container finished" podID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" containerID="cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c" exitCode=0 Jul 06 19:34:56.879434 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.879021 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" Jul 06 19:34:56.879434 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.879063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" event={"ID":"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1","Type":"ContainerDied","Data":"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c"} Jul 06 19:34:56.879434 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.879118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t" event={"ID":"ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1","Type":"ContainerDied","Data":"43ee2393eb980900a47948630dd391b8e906814b417b967298ef3f4c5b3a550f"} Jul 06 19:34:56.879434 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.879141 2575 scope.go:117] "RemoveContainer" containerID="cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c" Jul 06 19:34:56.887898 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.887880 2575 scope.go:117] "RemoveContainer" containerID="cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c" Jul 06 19:34:56.888128 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:34:56.888110 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c\": container with ID starting with cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c not found: ID does not exist" containerID="cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c" Jul 06 19:34:56.888181 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.888136 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c"} err="failed to get container status \"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c\": rpc error: code = NotFound desc = could not find container \"cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c\": container with ID starting with cb4effbe3ae1f798782d0ebc694ae589a7dd23a9a74cef43f54cd04765f20f3c not found: ID does not exist" Jul 06 19:34:56.895096 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.895064 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:56.898889 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:56.898870 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-e58cbfec-7c89fc69-gpc9t"] Jul 06 19:34:58.328837 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:34:58.328798 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" path="/var/lib/kubelet/pods/ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1/volumes" Jul 06 19:35:09.001724 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.001691 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:09.002078 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.002062 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" containerName="maas-api" Jul 06 19:35:09.002078 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.002074 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" containerName="maas-api" Jul 06 19:35:09.002147 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.002138 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed9bdbef-7dc4-4baa-820e-f5dc4b1a0ab1" containerName="maas-api" Jul 06 19:35:09.005056 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.005035 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.008220 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.008195 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-afb205a6-serving-cert\"" Jul 06 19:35:09.008220 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.008209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:35:09.027312 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.027284 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:09.174193 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.174152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.174369 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.174271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.174369 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.174316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fxk\" (UniqueName: \"kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.275718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.275622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.275718 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.275701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.275943 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.275733 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fxk\" (UniqueName: \"kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.276445 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.276421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.278449 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.278424 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.285049 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.285021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fxk\" (UniqueName: \"kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk\") pod \"maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.318519 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.318485 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.455204 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.455180 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:09.457258 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:35:09.457230 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1c9959_e156_4766_9fce_1d3f47b6f27f.slice/crio-1f1760babfa5bdc83c8cf3b9358bcbeb2adf606920697b2e29378b396c4a4a81 WatchSource:0}: Error finding container 1f1760babfa5bdc83c8cf3b9358bcbeb2adf606920697b2e29378b396c4a4a81: Status 404 returned error can't find the container with id 1f1760babfa5bdc83c8cf3b9358bcbeb2adf606920697b2e29378b396c4a4a81 Jul 06 19:35:09.944408 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.944370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" event={"ID":"6e1c9959-e156-4766-9fce-1d3f47b6f27f","Type":"ContainerStarted","Data":"7992c72f17e302059411579fb0484434993b686c4ff9699fbd63b1432a50c60e"} Jul 06 19:35:09.944627 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.944454 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" event={"ID":"6e1c9959-e156-4766-9fce-1d3f47b6f27f","Type":"ContainerStarted","Data":"1f1760babfa5bdc83c8cf3b9358bcbeb2adf606920697b2e29378b396c4a4a81"} Jul 06 19:35:09.944627 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.944474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:09.965988 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:09.965934 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" podStartSLOduration=1.701010602 podStartE2EDuration="1.965918019s" totalImagesPullingTime="264.907417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:09.963722796 +0000 UTC m=+1534.258514464" watchObservedRunningTime="2026-07-06 19:35:09.965918019 +0000 UTC m=+1534.260709685" Jul 06 19:35:13.734162 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:13.734125 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:13.734752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:13.734357 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" podUID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" containerName="maas-api" containerID="cri-o://7992c72f17e302059411579fb0484434993b686c4ff9699fbd63b1432a50c60e" gracePeriod=30 Jul 06 19:35:13.964186 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:13.964158 2575 generic.go:356] "Generic (PLEG): container finished" podID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" containerID="7992c72f17e302059411579fb0484434993b686c4ff9699fbd63b1432a50c60e" exitCode=0 Jul 06 19:35:13.964315 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:13.964202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" event={"ID":"6e1c9959-e156-4766-9fce-1d3f47b6f27f","Type":"ContainerDied","Data":"7992c72f17e302059411579fb0484434993b686c4ff9699fbd63b1432a50c60e"} Jul 06 19:35:13.979894 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:13.979863 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:14.019697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.019605 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca\") pod \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " Jul 06 19:35:14.019697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.019671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6fxk\" (UniqueName: \"kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk\") pod \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " Jul 06 19:35:14.019697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.019697 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls\") pod \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\" (UID: \"6e1c9959-e156-4766-9fce-1d3f47b6f27f\") " Jul 06 19:35:14.020043 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.020014 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e1c9959-e156-4766-9fce-1d3f47b6f27f" (UID: "6e1c9959-e156-4766-9fce-1d3f47b6f27f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:35:14.021998 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.021973 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e1c9959-e156-4766-9fce-1d3f47b6f27f" (UID: "6e1c9959-e156-4766-9fce-1d3f47b6f27f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:35:14.022081 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.021980 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk" (OuterVolumeSpecName: "kube-api-access-n6fxk") pod "6e1c9959-e156-4766-9fce-1d3f47b6f27f" (UID: "6e1c9959-e156-4766-9fce-1d3f47b6f27f"). InnerVolumeSpecName "kube-api-access-n6fxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:14.120841 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.120788 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e1c9959-e156-4766-9fce-1d3f47b6f27f-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:35:14.120841 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.120834 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6fxk\" (UniqueName: \"kubernetes.io/projected/6e1c9959-e156-4766-9fce-1d3f47b6f27f-kube-api-access-n6fxk\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:35:14.120841 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.120845 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e1c9959-e156-4766-9fce-1d3f47b6f27f-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:35:14.970040 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.970003 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" Jul 06 19:35:14.970040 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.970026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg" event={"ID":"6e1c9959-e156-4766-9fce-1d3f47b6f27f","Type":"ContainerDied","Data":"1f1760babfa5bdc83c8cf3b9358bcbeb2adf606920697b2e29378b396c4a4a81"} Jul 06 19:35:14.970577 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.970091 2575 scope.go:117] "RemoveContainer" containerID="7992c72f17e302059411579fb0484434993b686c4ff9699fbd63b1432a50c60e" Jul 06 19:35:14.988877 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.988843 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:14.995437 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:14.995407 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-afb205a6-8fc449f46-j2lbg"] Jul 06 19:35:16.329267 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:35:16.329230 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" path="/var/lib/kubelet/pods/6e1c9959-e156-4766-9fce-1d3f47b6f27f/volumes" Jul 06 19:36:59.343590 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.343499 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:36:59.344046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.343933 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" containerName="maas-api" Jul 06 19:36:59.344046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.343948 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" containerName="maas-api" Jul 06 19:36:59.344046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.344000 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1c9959-e156-4766-9fce-1d3f47b6f27f" containerName="maas-api" Jul 06 19:36:59.346915 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.346899 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.349635 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.349612 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-02f24e54-serving-cert\"" Jul 06 19:36:59.349772 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.349620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:36:59.360811 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.360782 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:36:59.418610 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.418572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.418795 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.418651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qg72\" (UniqueName: \"kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.418854 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.418803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.520283 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.520245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qg72\" (UniqueName: \"kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.520508 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.520350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.520508 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.520390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.520662 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:36:59.520510 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-02f24e54-serving-cert: secret "maas-api-e2e-mt-02f24e54-serving-cert" not found Jul 06 19:36:59.520662 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:36:59.520602 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls podName:17b31b50-e57a-4cb5-a6ba-76beee07cede nodeName:}" failed. No retries permitted until 2026-07-06 19:37:00.020581108 +0000 UTC m=+1644.315372759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls") pod "maas-api-e2e-mt-02f24e54-8969f877-9778c" (UID: "17b31b50-e57a-4cb5-a6ba-76beee07cede") : secret "maas-api-e2e-mt-02f24e54-serving-cert" not found Jul 06 19:36:59.521089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.521065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:36:59.552474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:36:59.552437 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qg72\" (UniqueName: \"kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:00.026499 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:00.026458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:00.029066 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:00.029044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") pod \"maas-api-e2e-mt-02f24e54-8969f877-9778c\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:00.257217 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:00.257177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:00.404872 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:00.404850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:37:00.407187 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:37:00.407158 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b31b50_e57a_4cb5_a6ba_76beee07cede.slice/crio-010b11b7e86280c864b8edd7925a9e4fc946ff3c1274d5df4664519c1741f6a3 WatchSource:0}: Error finding container 010b11b7e86280c864b8edd7925a9e4fc946ff3c1274d5df4664519c1741f6a3: Status 404 returned error can't find the container with id 010b11b7e86280c864b8edd7925a9e4fc946ff3c1274d5df4664519c1741f6a3 Jul 06 19:37:00.436595 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:00.436560 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" event={"ID":"17b31b50-e57a-4cb5-a6ba-76beee07cede","Type":"ContainerStarted","Data":"010b11b7e86280c864b8edd7925a9e4fc946ff3c1274d5df4664519c1741f6a3"} Jul 06 19:37:01.442350 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:01.442309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" event={"ID":"17b31b50-e57a-4cb5-a6ba-76beee07cede","Type":"ContainerStarted","Data":"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50"} Jul 06 19:37:01.442881 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:01.442441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:01.478029 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:01.477964 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" podStartSLOduration=2.004416805 podStartE2EDuration="2.477945959s" totalImagesPullingTime="473.529154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:01.477794355 +0000 UTC m=+1645.772586022" watchObservedRunningTime="2026-07-06 19:37:01.477945959 +0000 UTC m=+1645.772737639" Jul 06 19:37:07.453683 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:07.453651 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:11.946775 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:11.946739 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:37:11.947249 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:11.947005 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" podUID="17b31b50-e57a-4cb5-a6ba-76beee07cede" containerName="maas-api" containerID="cri-o://e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50" gracePeriod=30 Jul 06 19:37:12.199328 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.199256 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:12.236768 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.236663 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca\") pod \"17b31b50-e57a-4cb5-a6ba-76beee07cede\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " Jul 06 19:37:12.236768 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.236726 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") pod \"17b31b50-e57a-4cb5-a6ba-76beee07cede\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " Jul 06 19:37:12.237001 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.236796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qg72\" (UniqueName: \"kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72\") pod \"17b31b50-e57a-4cb5-a6ba-76beee07cede\" (UID: \"17b31b50-e57a-4cb5-a6ba-76beee07cede\") " Jul 06 19:37:12.237049 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.236993 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17b31b50-e57a-4cb5-a6ba-76beee07cede" (UID: "17b31b50-e57a-4cb5-a6ba-76beee07cede"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:37:12.239837 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.239778 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72" (OuterVolumeSpecName: "kube-api-access-5qg72") pod "17b31b50-e57a-4cb5-a6ba-76beee07cede" (UID: "17b31b50-e57a-4cb5-a6ba-76beee07cede"). InnerVolumeSpecName "kube-api-access-5qg72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:37:12.240809 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.240765 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17b31b50-e57a-4cb5-a6ba-76beee07cede" (UID: "17b31b50-e57a-4cb5-a6ba-76beee07cede"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:37:12.337543 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.337511 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17b31b50-e57a-4cb5-a6ba-76beee07cede-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:37:12.337543 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.337539 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17b31b50-e57a-4cb5-a6ba-76beee07cede-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:37:12.337543 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.337570 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qg72\" (UniqueName: \"kubernetes.io/projected/17b31b50-e57a-4cb5-a6ba-76beee07cede-kube-api-access-5qg72\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:37:12.496420 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.496323 2575 generic.go:356] "Generic (PLEG): container finished" podID="17b31b50-e57a-4cb5-a6ba-76beee07cede" containerID="e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50" exitCode=0 Jul 06 19:37:12.496420 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.496368 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" Jul 06 19:37:12.496420 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.496382 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" event={"ID":"17b31b50-e57a-4cb5-a6ba-76beee07cede","Type":"ContainerDied","Data":"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50"} Jul 06 19:37:12.496749 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.496437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c" event={"ID":"17b31b50-e57a-4cb5-a6ba-76beee07cede","Type":"ContainerDied","Data":"010b11b7e86280c864b8edd7925a9e4fc946ff3c1274d5df4664519c1741f6a3"} Jul 06 19:37:12.496749 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.496463 2575 scope.go:117] "RemoveContainer" containerID="e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50" Jul 06 19:37:12.505296 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.505271 2575 scope.go:117] "RemoveContainer" containerID="e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50" Jul 06 19:37:12.505594 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:37:12.505573 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50\": container with ID starting with e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50 not found: ID does not exist" containerID="e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50" Jul 06 19:37:12.505647 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.505604 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50"} err="failed to get container status \"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50\": rpc error: code = NotFound desc = could not find container \"e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50\": container with ID starting with e60af6699a79dd741028ef0b509e74c664114be4022dfa7ee6c4f12ae7812e50 not found: ID does not exist" Jul 06 19:37:12.513870 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.513836 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:37:12.518924 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:12.518892 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-02f24e54-8969f877-9778c"] Jul 06 19:37:14.328878 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:14.328844 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b31b50-e57a-4cb5-a6ba-76beee07cede" path="/var/lib/kubelet/pods/17b31b50-e57a-4cb5-a6ba-76beee07cede/volumes" Jul 06 19:37:43.372713 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.372678 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:37:43.373115 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.373048 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b31b50-e57a-4cb5-a6ba-76beee07cede" containerName="maas-api" Jul 06 19:37:43.373115 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.373060 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b31b50-e57a-4cb5-a6ba-76beee07cede" containerName="maas-api" Jul 06 19:37:43.373115 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.373108 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b31b50-e57a-4cb5-a6ba-76beee07cede" containerName="maas-api" Jul 06 19:37:43.378771 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.378736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.383580 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.383536 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-7f0c7a26-serving-cert\"" Jul 06 19:37:43.383744 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.383616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:37:43.393559 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.393509 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:37:43.517749 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.517710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.517936 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.517760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwkx\" (UniqueName: \"kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.517936 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.517809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.619238 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.619202 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.619409 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.619252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwkx\" (UniqueName: \"kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.619536 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.619511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.619956 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.619937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.622005 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.621984 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.627971 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.627895 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwkx\" (UniqueName: \"kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx\") pod \"maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.689463 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.689434 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:43.827613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:43.827501 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:37:43.830521 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:37:43.830494 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec268f1_3e5e_434e_8884_56ca904142d1.slice/crio-32a290a9fe3ecba551927eeb41fa67460560d4f7199d45abe0e27cc9b2432f01 WatchSource:0}: Error finding container 32a290a9fe3ecba551927eeb41fa67460560d4f7199d45abe0e27cc9b2432f01: Status 404 returned error can't find the container with id 32a290a9fe3ecba551927eeb41fa67460560d4f7199d45abe0e27cc9b2432f01 Jul 06 19:37:44.637907 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:44.637795 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" event={"ID":"7ec268f1-3e5e-434e-8884-56ca904142d1","Type":"ContainerStarted","Data":"9cf9cdb92ea0f2f6a74cee9f30033080a03748cfe81f27eaa9ab33d74c06e001"} Jul 06 19:37:44.637907 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:44.637854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" event={"ID":"7ec268f1-3e5e-434e-8884-56ca904142d1","Type":"ContainerStarted","Data":"32a290a9fe3ecba551927eeb41fa67460560d4f7199d45abe0e27cc9b2432f01"} Jul 06 19:37:44.637907 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:44.637892 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:37:44.663119 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:44.663066 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" podStartSLOduration=1.289783398 podStartE2EDuration="1.663048788s" totalImagesPullingTime="373.26539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:44.661660344 +0000 UTC m=+1688.956452010" watchObservedRunningTime="2026-07-06 19:37:44.663048788 +0000 UTC m=+1688.957840452" Jul 06 19:37:50.647938 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:37:50.647907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:38:20.580003 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.579966 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:38:20.580602 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.580239 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerName="maas-api" containerID="cri-o://9cf9cdb92ea0f2f6a74cee9f30033080a03748cfe81f27eaa9ab33d74c06e001" gracePeriod=30 Jul 06 19:38:20.642494 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.642456 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.33:8443/health\": dial tcp 10.134.0.33:8443: connect: connection refused" Jul 06 19:38:20.792336 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.792303 2575 generic.go:356] "Generic (PLEG): container finished" podID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerID="9cf9cdb92ea0f2f6a74cee9f30033080a03748cfe81f27eaa9ab33d74c06e001" exitCode=0 Jul 06 19:38:20.792490 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.792374 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" event={"ID":"7ec268f1-3e5e-434e-8884-56ca904142d1","Type":"ContainerDied","Data":"9cf9cdb92ea0f2f6a74cee9f30033080a03748cfe81f27eaa9ab33d74c06e001"} Jul 06 19:38:20.826206 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.826184 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:38:20.947581 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.947522 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca\") pod \"7ec268f1-3e5e-434e-8884-56ca904142d1\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " Jul 06 19:38:20.947772 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.947646 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls\") pod \"7ec268f1-3e5e-434e-8884-56ca904142d1\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " Jul 06 19:38:20.947772 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.947691 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnwkx\" (UniqueName: \"kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx\") pod \"7ec268f1-3e5e-434e-8884-56ca904142d1\" (UID: \"7ec268f1-3e5e-434e-8884-56ca904142d1\") " Jul 06 19:38:20.947955 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.947923 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ec268f1-3e5e-434e-8884-56ca904142d1" (UID: "7ec268f1-3e5e-434e-8884-56ca904142d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:38:20.949891 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.949859 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ec268f1-3e5e-434e-8884-56ca904142d1" (UID: "7ec268f1-3e5e-434e-8884-56ca904142d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:38:20.949988 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:20.949919 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx" (OuterVolumeSpecName: "kube-api-access-lnwkx") pod "7ec268f1-3e5e-434e-8884-56ca904142d1" (UID: "7ec268f1-3e5e-434e-8884-56ca904142d1"). InnerVolumeSpecName "kube-api-access-lnwkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:21.048470 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.048432 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec268f1-3e5e-434e-8884-56ca904142d1-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:38:21.048470 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.048465 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnwkx\" (UniqueName: \"kubernetes.io/projected/7ec268f1-3e5e-434e-8884-56ca904142d1-kube-api-access-lnwkx\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:38:21.048470 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.048474 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec268f1-3e5e-434e-8884-56ca904142d1-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:38:21.798882 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.798852 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" Jul 06 19:38:21.798882 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.798869 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw" event={"ID":"7ec268f1-3e5e-434e-8884-56ca904142d1","Type":"ContainerDied","Data":"32a290a9fe3ecba551927eeb41fa67460560d4f7199d45abe0e27cc9b2432f01"} Jul 06 19:38:21.799355 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.798927 2575 scope.go:117] "RemoveContainer" containerID="9cf9cdb92ea0f2f6a74cee9f30033080a03748cfe81f27eaa9ab33d74c06e001" Jul 06 19:38:21.820221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.820196 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:38:21.822354 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:21.822333 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-7f0c7a26-5f4b794f65-gzlsw"] Jul 06 19:38:22.329684 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:38:22.329652 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" path="/var/lib/kubelet/pods/7ec268f1-3e5e-434e-8884-56ca904142d1/volumes" Jul 06 19:39:36.269116 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:39:36.269080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:39:36.271653 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:39:36.271634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:39:36.274198 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:39:36.274180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:39:36.276633 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:39:36.276615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:40:13.292024 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.291993 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:40:13.292517 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.292499 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerName="maas-api" Jul 06 19:40:13.292579 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.292521 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerName="maas-api" Jul 06 19:40:13.292661 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.292645 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec268f1-3e5e-434e-8884-56ca904142d1" containerName="maas-api" Jul 06 19:40:13.296107 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.296081 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.299803 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.299777 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8cc450-serving-cert\"" Jul 06 19:40:13.299932 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.299787 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:40:13.309005 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.308972 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:40:13.436955 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.436914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmcpp\" (UniqueName: \"kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.437130 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.436976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.437130 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.437077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.538002 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.537961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.538200 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.538037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.538200 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.538065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmcpp\" (UniqueName: \"kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.538603 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.538581 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.540504 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.540481 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.549687 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.549633 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmcpp\" (UniqueName: \"kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp\") pod \"maas-api-e2e-inf-a-8cc450-96557484b-4kdpv\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.606389 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.606353 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:13.750449 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.750424 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:40:13.752627 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:40:13.752599 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c8b80e_e5a0_4be8_ad3a_c332963790be.slice/crio-2afe6e01ca7dc382ae954a6e53aa07b226751a282357e9fdcba3c5fbdd6a3780 WatchSource:0}: Error finding container 2afe6e01ca7dc382ae954a6e53aa07b226751a282357e9fdcba3c5fbdd6a3780: Status 404 returned error can't find the container with id 2afe6e01ca7dc382ae954a6e53aa07b226751a282357e9fdcba3c5fbdd6a3780 Jul 06 19:40:13.754098 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:13.754077 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:40:14.294427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:14.294381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" event={"ID":"54c8b80e-e5a0-4be8-ad3a-c332963790be","Type":"ContainerStarted","Data":"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043"} Jul 06 19:40:14.294810 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:14.294438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" event={"ID":"54c8b80e-e5a0-4be8-ad3a-c332963790be","Type":"ContainerStarted","Data":"2afe6e01ca7dc382ae954a6e53aa07b226751a282357e9fdcba3c5fbdd6a3780"} Jul 06 19:40:14.294810 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:14.294465 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:14.313493 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:14.313441 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" podStartSLOduration=0.892462232 podStartE2EDuration="1.313427917s" totalImagesPullingTime="420.965685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:14.313362601 +0000 UTC m=+1838.608154267" watchObservedRunningTime="2026-07-06 19:40:14.313427917 +0000 UTC m=+1838.608219581" Jul 06 19:40:20.304276 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:20.304248 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:40:21.467921 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.467881 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:40:21.472053 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.472033 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.474816 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.474790 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-930663-serving-cert\"" Jul 06 19:40:21.485643 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.485611 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:40:21.612089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.612050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqgc\" (UniqueName: \"kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.612089 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.612092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.612306 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.612111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.713534 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.713494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqgc\" (UniqueName: \"kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.713534 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.713532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.713785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.713586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.713785 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:40:21.713711 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-930663-serving-cert: secret "maas-api-e2e-inf-b-930663-serving-cert" not found Jul 06 19:40:21.713785 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:40:21.713775 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls podName:0a0f48d1-73f8-4db2-a20d-cd22314eb6c7 nodeName:}" failed. No retries permitted until 2026-07-06 19:40:22.213757669 +0000 UTC m=+1846.508549312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls") pod "maas-api-e2e-inf-b-930663-d8cdf8977-v465j" (UID: "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7") : secret "maas-api-e2e-inf-b-930663-serving-cert" not found Jul 06 19:40:21.714178 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.714160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:21.722901 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:21.722847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqgc\" (UniqueName: \"kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:22.218431 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:22.218390 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:22.220977 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:22.220947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") pod \"maas-api-e2e-inf-b-930663-d8cdf8977-v465j\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:22.384059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:22.384019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:22.525054 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:22.525027 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:40:22.527425 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:40:22.527397 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0f48d1_73f8_4db2_a20d_cd22314eb6c7.slice/crio-afeaa3481e551cc9397ceb20b74fa434b26a528160bc36745bd4d621bf5522c8 WatchSource:0}: Error finding container afeaa3481e551cc9397ceb20b74fa434b26a528160bc36745bd4d621bf5522c8: Status 404 returned error can't find the container with id afeaa3481e551cc9397ceb20b74fa434b26a528160bc36745bd4d621bf5522c8 Jul 06 19:40:23.337622 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:23.337584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" event={"ID":"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7","Type":"ContainerStarted","Data":"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862"} Jul 06 19:40:23.337805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:23.337639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" event={"ID":"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7","Type":"ContainerStarted","Data":"afeaa3481e551cc9397ceb20b74fa434b26a528160bc36745bd4d621bf5522c8"} Jul 06 19:40:23.337805 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:23.337721 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:40:23.357804 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:23.357743 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" podStartSLOduration=2.03424414 podStartE2EDuration="2.357723886s" totalImagesPullingTime="323.479746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:23.356727415 +0000 UTC m=+1847.651519080" watchObservedRunningTime="2026-07-06 19:40:23.357723886 +0000 UTC m=+1847.652515553" Jul 06 19:40:29.347230 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:40:29.347180 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:41:26.264278 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.264245 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:41:26.264807 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.264433 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" podUID="54c8b80e-e5a0-4be8-ad3a-c332963790be" containerName="maas-api" containerID="cri-o://8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043" gracePeriod=30 Jul 06 19:41:26.513070 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.513044 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:41:26.583221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.583128 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca\") pod \"54c8b80e-e5a0-4be8-ad3a-c332963790be\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " Jul 06 19:41:26.583221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.583166 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls\") pod \"54c8b80e-e5a0-4be8-ad3a-c332963790be\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " Jul 06 19:41:26.583221 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.583197 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmcpp\" (UniqueName: \"kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp\") pod \"54c8b80e-e5a0-4be8-ad3a-c332963790be\" (UID: \"54c8b80e-e5a0-4be8-ad3a-c332963790be\") " Jul 06 19:41:26.583596 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.583539 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54c8b80e-e5a0-4be8-ad3a-c332963790be" (UID: "54c8b80e-e5a0-4be8-ad3a-c332963790be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:41:26.585445 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.585412 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54c8b80e-e5a0-4be8-ad3a-c332963790be" (UID: "54c8b80e-e5a0-4be8-ad3a-c332963790be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:41:26.585560 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.585450 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp" (OuterVolumeSpecName: "kube-api-access-vmcpp") pod "54c8b80e-e5a0-4be8-ad3a-c332963790be" (UID: "54c8b80e-e5a0-4be8-ad3a-c332963790be"). InnerVolumeSpecName "kube-api-access-vmcpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:41:26.627153 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.627114 2575 generic.go:356] "Generic (PLEG): container finished" podID="54c8b80e-e5a0-4be8-ad3a-c332963790be" containerID="8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043" exitCode=0 Jul 06 19:41:26.627332 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.627160 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" Jul 06 19:41:26.627332 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.627201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" event={"ID":"54c8b80e-e5a0-4be8-ad3a-c332963790be","Type":"ContainerDied","Data":"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043"} Jul 06 19:41:26.627332 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.627259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv" event={"ID":"54c8b80e-e5a0-4be8-ad3a-c332963790be","Type":"ContainerDied","Data":"2afe6e01ca7dc382ae954a6e53aa07b226751a282357e9fdcba3c5fbdd6a3780"} Jul 06 19:41:26.627332 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.627289 2575 scope.go:117] "RemoveContainer" containerID="8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043" Jul 06 19:41:26.636809 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.636789 2575 scope.go:117] "RemoveContainer" containerID="8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043" Jul 06 19:41:26.637070 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:41:26.637050 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043\": container with ID starting with 8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043 not found: ID does not exist" containerID="8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043" Jul 06 19:41:26.637137 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.637092 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043"} err="failed to get container status \"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043\": rpc error: code = NotFound desc = could not find container \"8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043\": container with ID starting with 8b3ed0792651044024753e98a21bf1ef1767399b867c0b0087a05fbe22526043 not found: ID does not exist" Jul 06 19:41:26.659071 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.659030 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:41:26.677506 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.677472 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8cc450-96557484b-4kdpv"] Jul 06 19:41:26.684274 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.684247 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b80e-e5a0-4be8-ad3a-c332963790be-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:41:26.684365 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.684277 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b80e-e5a0-4be8-ad3a-c332963790be-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:41:26.684365 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:26.684286 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmcpp\" (UniqueName: \"kubernetes.io/projected/54c8b80e-e5a0-4be8-ad3a-c332963790be-kube-api-access-vmcpp\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:41:28.329493 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:41:28.329458 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c8b80e-e5a0-4be8-ad3a-c332963790be" path="/var/lib/kubelet/pods/54c8b80e-e5a0-4be8-ad3a-c332963790be/volumes" Jul 06 19:42:09.307617 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.307580 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:42:09.308156 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.307884 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerName="maas-api" containerID="cri-o://69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862" gracePeriod=30 Jul 06 19:42:09.342607 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.342567 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.35:8443/health\": dial tcp 10.134.0.35:8443: connect: connection refused" Jul 06 19:42:09.554222 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.554193 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:42:09.660983 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.660906 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") pod \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " Jul 06 19:42:09.660983 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.660947 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca\") pod \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " Jul 06 19:42:09.661151 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.661004 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qqgc\" (UniqueName: \"kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc\") pod \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\" (UID: \"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7\") " Jul 06 19:42:09.661351 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.661322 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" (UID: "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:42:09.663059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.663033 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc" (OuterVolumeSpecName: "kube-api-access-9qqgc") pod "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" (UID: "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7"). InnerVolumeSpecName "kube-api-access-9qqgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:09.663059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.663044 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" (UID: "0a0f48d1-73f8-4db2-a20d-cd22314eb6c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:42:09.762329 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.762299 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:09.762329 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.762325 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:09.762329 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.762334 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qqgc\" (UniqueName: \"kubernetes.io/projected/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7-kube-api-access-9qqgc\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:09.823920 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.823888 2575 generic.go:356] "Generic (PLEG): container finished" podID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerID="69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862" exitCode=0 Jul 06 19:42:09.824091 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.823948 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" Jul 06 19:42:09.824091 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.823972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" event={"ID":"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7","Type":"ContainerDied","Data":"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862"} Jul 06 19:42:09.824091 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.824055 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j" event={"ID":"0a0f48d1-73f8-4db2-a20d-cd22314eb6c7","Type":"ContainerDied","Data":"afeaa3481e551cc9397ceb20b74fa434b26a528160bc36745bd4d621bf5522c8"} Jul 06 19:42:09.824091 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.824084 2575 scope.go:117] "RemoveContainer" containerID="69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862" Jul 06 19:42:09.833144 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.833129 2575 scope.go:117] "RemoveContainer" containerID="69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862" Jul 06 19:42:09.833397 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:09.833378 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862\": container with ID starting with 69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862 not found: ID does not exist" containerID="69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862" Jul 06 19:42:09.833456 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.833404 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862"} err="failed to get container status \"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862\": rpc error: code = NotFound desc = could not find container \"69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862\": container with ID starting with 69697571a8adf28ff0eace627cf6bdf9211481d4f7b1826b8dad80500bc9a862 not found: ID does not exist" Jul 06 19:42:09.862332 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.862308 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:42:09.873063 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:09.873042 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-930663-d8cdf8977-v465j"] Jul 06 19:42:10.328655 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:10.328622 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" path="/var/lib/kubelet/pods/0a0f48d1-73f8-4db2-a20d-cd22314eb6c7/volumes" Jul 06 19:42:19.024829 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.024795 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025153 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c8b80e-e5a0-4be8-ad3a-c332963790be" containerName="maas-api" Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025166 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c8b80e-e5a0-4be8-ad3a-c332963790be" containerName="maas-api" Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025173 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerName="maas-api" Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025178 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerName="maas-api" Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025237 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c8b80e-e5a0-4be8-ad3a-c332963790be" containerName="maas-api" Jul 06 19:42:19.025505 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.025246 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0f48d1-73f8-4db2-a20d-cd22314eb6c7" containerName="maas-api" Jul 06 19:42:19.029493 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.029476 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.032029 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.032003 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-3fd8ac-serving-cert\"" Jul 06 19:42:19.032029 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.032019 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:42:19.040717 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.040693 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:19.146379 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.146335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.146584 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.146466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.146584 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.146525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t487w\" (UniqueName: \"kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.247421 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.247381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t487w\" (UniqueName: \"kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.247634 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.247436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.247634 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.247502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.248238 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.248220 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.250080 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.250048 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.259947 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.259921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t487w\" (UniqueName: \"kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w\") pod \"maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.338898 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.338815 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:19.485802 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.485771 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:19.488837 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:42:19.488805 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32821631_d565_410c_98d8_4a762a0d6d56.slice/crio-a6049f9f10bfb1cd457665bf5e6c09b2f07af34bd6224b8772fea14ce1c6394d WatchSource:0}: Error finding container a6049f9f10bfb1cd457665bf5e6c09b2f07af34bd6224b8772fea14ce1c6394d: Status 404 returned error can't find the container with id a6049f9f10bfb1cd457665bf5e6c09b2f07af34bd6224b8772fea14ce1c6394d Jul 06 19:42:19.868784 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:19.868754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" event={"ID":"32821631-d565-410c-98d8-4a762a0d6d56","Type":"ContainerStarted","Data":"a6049f9f10bfb1cd457665bf5e6c09b2f07af34bd6224b8772fea14ce1c6394d"} Jul 06 19:42:20.875011 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:20.874961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" event={"ID":"32821631-d565-410c-98d8-4a762a0d6d56","Type":"ContainerStarted","Data":"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4"} Jul 06 19:42:20.875389 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:20.875033 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:20.894495 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:20.894446 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" podStartSLOduration=2.498717692 podStartE2EDuration="2.894430663s" totalImagesPullingTime="395.712971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:20.893501179 +0000 UTC m=+1965.188292856" watchObservedRunningTime="2026-07-06 19:42:20.894430663 +0000 UTC m=+1965.189222327" Jul 06 19:42:26.885180 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:26.885100 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:27.100836 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.100798 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:27.105039 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.105013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.107742 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.107416 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-99607e-serving-cert\"" Jul 06 19:42:27.109729 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.109690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.109830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.109742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djnq\" (UniqueName: \"kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.109885 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.109824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.117503 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.117476 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:27.210326 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.210284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.210558 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.210396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.210558 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.210420 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djnq\" (UniqueName: \"kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.210930 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:27.210895 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-99607e-serving-cert: secret "maas-api-e2e-api-b-99607e-serving-cert" not found Jul 06 19:42:27.211091 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:27.211019 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls podName:a7750437-0f80-4537-b03f-cbcc95a702fe nodeName:}" failed. No retries permitted until 2026-07-06 19:42:27.710997798 +0000 UTC m=+1972.005789444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls") pod "maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" (UID: "a7750437-0f80-4537-b03f-cbcc95a702fe") : secret "maas-api-e2e-api-b-99607e-serving-cert" not found Jul 06 19:42:27.211928 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.211903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.222124 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.222097 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djnq\" (UniqueName: \"kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.714914 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:27.714880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:27.715112 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:27.715038 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-99607e-serving-cert: secret "maas-api-e2e-api-b-99607e-serving-cert" not found Jul 06 19:42:27.715112 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:27.715100 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls podName:a7750437-0f80-4537-b03f-cbcc95a702fe nodeName:}" failed. No retries permitted until 2026-07-06 19:42:28.715085741 +0000 UTC m=+1973.009877387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls") pod "maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" (UID: "a7750437-0f80-4537-b03f-cbcc95a702fe") : secret "maas-api-e2e-api-b-99607e-serving-cert" not found Jul 06 19:42:28.721786 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:28.721744 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:28.724349 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:28.724323 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:28.917167 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:28.917128 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:29.048530 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:29.048500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:29.051085 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:42:29.051056 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7750437_0f80_4537_b03f_cbcc95a702fe.slice/crio-69ec27d37bbeaecf2f4a48ee50a89a65a829c37cc1b8f70b4477231dd8ef750d WatchSource:0}: Error finding container 69ec27d37bbeaecf2f4a48ee50a89a65a829c37cc1b8f70b4477231dd8ef750d: Status 404 returned error can't find the container with id 69ec27d37bbeaecf2f4a48ee50a89a65a829c37cc1b8f70b4477231dd8ef750d Jul 06 19:42:29.917336 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:29.917298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" event={"ID":"a7750437-0f80-4537-b03f-cbcc95a702fe","Type":"ContainerStarted","Data":"548b287105854581d4cdc9e36fdb2a6f05a72ef70ff3bcb5e95495e6836d5df0"} Jul 06 19:42:29.917735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:29.917349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" event={"ID":"a7750437-0f80-4537-b03f-cbcc95a702fe","Type":"ContainerStarted","Data":"69ec27d37bbeaecf2f4a48ee50a89a65a829c37cc1b8f70b4477231dd8ef750d"} Jul 06 19:42:29.917735 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:29.917410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:29.941861 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:29.940963 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" podStartSLOduration=2.584666757 podStartE2EDuration="2.940942974s" totalImagesPullingTime="356.276217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:29.940856137 +0000 UTC m=+1974.235647821" watchObservedRunningTime="2026-07-06 19:42:29.940942974 +0000 UTC m=+1974.235734644" Jul 06 19:42:35.927767 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:35.927739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:40.529322 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.529278 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:40.529855 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.529567 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" podUID="32821631-d565-410c-98d8-4a762a0d6d56" containerName="maas-api" containerID="cri-o://ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4" gracePeriod=30 Jul 06 19:42:40.777759 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.777732 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:40.803300 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.803214 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t487w\" (UniqueName: \"kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w\") pod \"32821631-d565-410c-98d8-4a762a0d6d56\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " Jul 06 19:42:40.803300 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.803274 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls\") pod \"32821631-d565-410c-98d8-4a762a0d6d56\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " Jul 06 19:42:40.803588 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.803310 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca\") pod \"32821631-d565-410c-98d8-4a762a0d6d56\" (UID: \"32821631-d565-410c-98d8-4a762a0d6d56\") " Jul 06 19:42:40.803734 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.803708 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32821631-d565-410c-98d8-4a762a0d6d56" (UID: "32821631-d565-410c-98d8-4a762a0d6d56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:42:40.805577 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.805522 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32821631-d565-410c-98d8-4a762a0d6d56" (UID: "32821631-d565-410c-98d8-4a762a0d6d56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:42:40.805675 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.805604 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w" (OuterVolumeSpecName: "kube-api-access-t487w") pod "32821631-d565-410c-98d8-4a762a0d6d56" (UID: "32821631-d565-410c-98d8-4a762a0d6d56"). InnerVolumeSpecName "kube-api-access-t487w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:40.904838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.904780 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32821631-d565-410c-98d8-4a762a0d6d56-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:40.904838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.904823 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t487w\" (UniqueName: \"kubernetes.io/projected/32821631-d565-410c-98d8-4a762a0d6d56-kube-api-access-t487w\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:40.904838 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.904832 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32821631-d565-410c-98d8-4a762a0d6d56-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:40.967224 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.967188 2575 generic.go:356] "Generic (PLEG): container finished" podID="32821631-d565-410c-98d8-4a762a0d6d56" containerID="ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4" exitCode=0 Jul 06 19:42:40.967408 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.967244 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" Jul 06 19:42:40.967408 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.967246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" event={"ID":"32821631-d565-410c-98d8-4a762a0d6d56","Type":"ContainerDied","Data":"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4"} Jul 06 19:42:40.967525 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.967414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748" event={"ID":"32821631-d565-410c-98d8-4a762a0d6d56","Type":"ContainerDied","Data":"a6049f9f10bfb1cd457665bf5e6c09b2f07af34bd6224b8772fea14ce1c6394d"} Jul 06 19:42:40.967525 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.967453 2575 scope.go:117] "RemoveContainer" containerID="ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4" Jul 06 19:42:40.976887 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.976864 2575 scope.go:117] "RemoveContainer" containerID="ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4" Jul 06 19:42:40.977192 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:40.977173 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4\": container with ID starting with ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4 not found: ID does not exist" containerID="ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4" Jul 06 19:42:40.977255 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.977207 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4"} err="failed to get container status \"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4\": rpc error: code = NotFound desc = could not find container \"ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4\": container with ID starting with ee75c123a973d0d0145abfa7e59cc5030adb81a4d7090858b01f7bc128913dc4 not found: ID does not exist" Jul 06 19:42:40.989054 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.989021 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:40.993590 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:40.993567 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-3fd8ac-58cf59db47-9c748"] Jul 06 19:42:42.328438 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:42.328406 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32821631-d565-410c-98d8-4a762a0d6d56" path="/var/lib/kubelet/pods/32821631-d565-410c-98d8-4a762a0d6d56/volumes" Jul 06 19:42:47.788215 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:47.788181 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:47.788703 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:47.788445 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" podUID="a7750437-0f80-4537-b03f-cbcc95a702fe" containerName="maas-api" containerID="cri-o://548b287105854581d4cdc9e36fdb2a6f05a72ef70ff3bcb5e95495e6836d5df0" gracePeriod=30 Jul 06 19:42:48.001298 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.001266 2575 generic.go:356] "Generic (PLEG): container finished" podID="a7750437-0f80-4537-b03f-cbcc95a702fe" containerID="548b287105854581d4cdc9e36fdb2a6f05a72ef70ff3bcb5e95495e6836d5df0" exitCode=0 Jul 06 19:42:48.001466 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.001311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" event={"ID":"a7750437-0f80-4537-b03f-cbcc95a702fe","Type":"ContainerDied","Data":"548b287105854581d4cdc9e36fdb2a6f05a72ef70ff3bcb5e95495e6836d5df0"} Jul 06 19:42:48.037477 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.037450 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:48.072510 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.072424 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") pod \"a7750437-0f80-4537-b03f-cbcc95a702fe\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " Jul 06 19:42:48.072510 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.072472 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2djnq\" (UniqueName: \"kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq\") pod \"a7750437-0f80-4537-b03f-cbcc95a702fe\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " Jul 06 19:42:48.072510 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.072511 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca\") pod \"a7750437-0f80-4537-b03f-cbcc95a702fe\" (UID: \"a7750437-0f80-4537-b03f-cbcc95a702fe\") " Jul 06 19:42:48.072903 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.072882 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7750437-0f80-4537-b03f-cbcc95a702fe" (UID: "a7750437-0f80-4537-b03f-cbcc95a702fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:42:48.074772 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.074740 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7750437-0f80-4537-b03f-cbcc95a702fe" (UID: "a7750437-0f80-4537-b03f-cbcc95a702fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:42:48.074879 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.074859 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq" (OuterVolumeSpecName: "kube-api-access-2djnq") pod "a7750437-0f80-4537-b03f-cbcc95a702fe" (UID: "a7750437-0f80-4537-b03f-cbcc95a702fe"). InnerVolumeSpecName "kube-api-access-2djnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:42:48.173200 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.173143 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7750437-0f80-4537-b03f-cbcc95a702fe-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:48.173200 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.173190 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2djnq\" (UniqueName: \"kubernetes.io/projected/a7750437-0f80-4537-b03f-cbcc95a702fe-kube-api-access-2djnq\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:48.173200 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:48.173200 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7750437-0f80-4537-b03f-cbcc95a702fe-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:42:49.006563 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:49.006511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" event={"ID":"a7750437-0f80-4537-b03f-cbcc95a702fe","Type":"ContainerDied","Data":"69ec27d37bbeaecf2f4a48ee50a89a65a829c37cc1b8f70b4477231dd8ef750d"} Jul 06 19:42:49.007027 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:49.006593 2575 scope.go:117] "RemoveContainer" containerID="548b287105854581d4cdc9e36fdb2a6f05a72ef70ff3bcb5e95495e6836d5df0" Jul 06 19:42:49.007027 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:49.006521 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r" Jul 06 19:42:49.022128 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:49.022103 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:49.026609 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:49.026585 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-99607e-7d5cb9f6b5-b6w9r"] Jul 06 19:42:50.328581 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:50.328527 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7750437-0f80-4537-b03f-cbcc95a702fe" path="/var/lib/kubelet/pods/a7750437-0f80-4537-b03f-cbcc95a702fe/volumes" Jul 06 19:42:57.225318 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.225260 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:42:57.225875 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.225854 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7750437-0f80-4537-b03f-cbcc95a702fe" containerName="maas-api" Jul 06 19:42:57.225936 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.225882 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7750437-0f80-4537-b03f-cbcc95a702fe" containerName="maas-api" Jul 06 19:42:57.225936 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.225931 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32821631-d565-410c-98d8-4a762a0d6d56" containerName="maas-api" Jul 06 19:42:57.226009 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.225940 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="32821631-d565-410c-98d8-4a762a0d6d56" containerName="maas-api" Jul 06 19:42:57.226080 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.226052 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="32821631-d565-410c-98d8-4a762a0d6d56" containerName="maas-api" Jul 06 19:42:57.226287 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.226268 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7750437-0f80-4537-b03f-cbcc95a702fe" containerName="maas-api" Jul 06 19:42:57.230899 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.230879 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.233216 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.233192 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-26761c-serving-cert\"" Jul 06 19:42:57.233333 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.233272 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kjghq\"" Jul 06 19:42:57.244309 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.244286 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:42:57.359005 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.358952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.359178 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.359079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.359178 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.359148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrcr\" (UniqueName: \"kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.460614 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.460572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.460785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.460628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.460785 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.460668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrcr\" (UniqueName: \"kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.460785 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:57.460699 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-26761c-serving-cert: secret "maas-api-e2e-shared-a-26761c-serving-cert" not found Jul 06 19:42:57.460785 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:42:57.460772 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls podName:e02fed25-ac04-4b5e-861d-a6346a47c924 nodeName:}" failed. No retries permitted until 2026-07-06 19:42:57.960753085 +0000 UTC m=+2002.255544741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls") pod "maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" (UID: "e02fed25-ac04-4b5e-861d-a6346a47c924") : secret "maas-api-e2e-shared-a-26761c-serving-cert" not found Jul 06 19:42:57.461249 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.461230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.471669 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.471637 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrcr\" (UniqueName: \"kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.965717 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.965680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:57.968314 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:57.968293 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") pod \"maas-api-e2e-shared-a-26761c-86697996b8-hbzgc\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:58.141786 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:58.141753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:58.279171 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:58.279138 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:42:58.281845 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:42:58.281819 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02fed25_ac04_4b5e_861d_a6346a47c924.slice/crio-71b10bd4bca0a87c4e8b315d01c4812433618faa5aec7d53ff49a878106e8e58 WatchSource:0}: Error finding container 71b10bd4bca0a87c4e8b315d01c4812433618faa5aec7d53ff49a878106e8e58: Status 404 returned error can't find the container with id 71b10bd4bca0a87c4e8b315d01c4812433618faa5aec7d53ff49a878106e8e58 Jul 06 19:42:59.052877 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:59.052833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" event={"ID":"e02fed25-ac04-4b5e-861d-a6346a47c924","Type":"ContainerStarted","Data":"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844"} Jul 06 19:42:59.053048 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:59.052896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" event={"ID":"e02fed25-ac04-4b5e-861d-a6346a47c924","Type":"ContainerStarted","Data":"71b10bd4bca0a87c4e8b315d01c4812433618faa5aec7d53ff49a878106e8e58"} Jul 06 19:42:59.053048 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:59.052923 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:42:59.073065 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:42:59.073011 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" podStartSLOduration=1.493923361 podStartE2EDuration="2.072996246s" totalImagesPullingTime="579.072885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:59.07076342 +0000 UTC m=+2003.365555082" watchObservedRunningTime="2026-07-06 19:42:59.072996246 +0000 UTC m=+2003.367788003" Jul 06 19:43:05.063991 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.063963 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:43:05.290809 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.290771 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:43:05.294406 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.294384 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.297937 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.297914 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-bb8c15-serving-cert\"" Jul 06 19:43:05.309012 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.308981 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:43:05.434001 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.433968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.434179 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.434022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.434179 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.434099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7j7x\" (UniqueName: \"kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.534630 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.534591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.534811 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.534647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.534811 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.534675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7j7x\" (UniqueName: \"kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.534811 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:43:05.534745 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-bb8c15-serving-cert: secret "maas-api-e2e-shared-b-bb8c15-serving-cert" not found Jul 06 19:43:05.534911 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:43:05.534821 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls podName:b52e5874-c421-4fd2-8b34-e97ea1b091f8 nodeName:}" failed. No retries permitted until 2026-07-06 19:43:06.034802849 +0000 UTC m=+2010.329594511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls") pod "maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" (UID: "b52e5874-c421-4fd2-8b34-e97ea1b091f8") : secret "maas-api-e2e-shared-b-bb8c15-serving-cert" not found Jul 06 19:43:05.535387 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.535368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:05.555074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:05.555037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7j7x\" (UniqueName: \"kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:06.039498 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:06.039460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:06.039685 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:43:06.039633 2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-bb8c15-serving-cert: secret "maas-api-e2e-shared-b-bb8c15-serving-cert" not found Jul 06 19:43:06.039731 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:43:06.039718 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls podName:b52e5874-c421-4fd2-8b34-e97ea1b091f8 nodeName:}" failed. No retries permitted until 2026-07-06 19:43:07.039698097 +0000 UTC m=+2011.334489740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls") pod "maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" (UID: "b52e5874-c421-4fd2-8b34-e97ea1b091f8") : secret "maas-api-e2e-shared-b-bb8c15-serving-cert" not found Jul 06 19:43:07.050045 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:07.050002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:07.052704 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:07.052678 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:07.105825 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:07.105789 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:07.242995 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:07.242965 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:43:07.245476 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:43:07.245443 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52e5874_c421_4fd2_8b34_e97ea1b091f8.slice/crio-945b9f9afc5e3a30338038d1a3e8401891f0ded9916c3b21466305dd0df9a508 WatchSource:0}: Error finding container 945b9f9afc5e3a30338038d1a3e8401891f0ded9916c3b21466305dd0df9a508: Status 404 returned error can't find the container with id 945b9f9afc5e3a30338038d1a3e8401891f0ded9916c3b21466305dd0df9a508 Jul 06 19:43:08.095459 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:08.095421 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" event={"ID":"b52e5874-c421-4fd2-8b34-e97ea1b091f8","Type":"ContainerStarted","Data":"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb"} Jul 06 19:43:08.095997 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:08.095495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" event={"ID":"b52e5874-c421-4fd2-8b34-e97ea1b091f8","Type":"ContainerStarted","Data":"945b9f9afc5e3a30338038d1a3e8401891f0ded9916c3b21466305dd0df9a508"} Jul 06 19:43:08.095997 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:08.095568 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:43:08.114812 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:08.114765 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" podStartSLOduration=2.806370792 podStartE2EDuration="3.114751193s" totalImagesPullingTime="308.380401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:43:08.113505386 +0000 UTC m=+2012.408297052" watchObservedRunningTime="2026-07-06 19:43:08.114751193 +0000 UTC m=+2012.409542856" Jul 06 19:43:14.105300 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:43:14.105266 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:44:36.295704 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:44:36.295584 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:44:36.299774 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:44:36.299379 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:44:36.300823 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:44:36.300803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:44:36.304316 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:44:36.304293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:45:00.133957 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.133922 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh"] Jul 06 19:45:00.136445 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.136418 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:00.138592 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.138563 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq"] Jul 06 19:45:00.140699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.140679 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-8vjdw"] Jul 06 19:45:00.140840 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.140802 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:00.142988 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.142964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:00.145260 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.145239 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh"] Jul 06 19:45:00.150209 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.150185 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-8vjdw"] Jul 06 19:45:00.152940 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.152912 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq"] Jul 06 19:45:00.169492 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.169464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkr9s\" (UniqueName: \"kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh\" (UID: \"70c9c98e-c431-4485-9c8a-157c2066528d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:00.169652 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.169507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdqh\" (UniqueName: \"kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh\") pod \"maas-api-key-cleanup-29722785-8vjdw\" (UID: \"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d\") " pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:00.169652 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.169606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghj2j\" (UniqueName: \"kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j\") pod \"maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq\" (UID: \"a66309b0-3213-407b-8b49-5216715194b8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:00.270613 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.270575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghj2j\" (UniqueName: \"kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j\") pod \"maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq\" (UID: \"a66309b0-3213-407b-8b49-5216715194b8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:00.270798 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.270664 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkr9s\" (UniqueName: \"kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh\" (UID: \"70c9c98e-c431-4485-9c8a-157c2066528d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:00.270798 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.270712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdqh\" (UniqueName: \"kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh\") pod \"maas-api-key-cleanup-29722785-8vjdw\" (UID: \"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d\") " pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:00.281677 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.281644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkr9s\" (UniqueName: \"kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh\" (UID: \"70c9c98e-c431-4485-9c8a-157c2066528d\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:00.281886 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.281866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghj2j\" (UniqueName: \"kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j\") pod \"maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq\" (UID: \"a66309b0-3213-407b-8b49-5216715194b8\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:00.281935 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.281866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdqh\" (UniqueName: \"kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh\") pod \"maas-api-key-cleanup-29722785-8vjdw\" (UID: \"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d\") " pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:00.450991 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.450956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:00.459191 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.459168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:00.466316 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.466289 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:00.619733 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.619696 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh"] Jul 06 19:45:00.621512 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:45:00.621479 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c9c98e_c431_4485_9c8a_157c2066528d.slice/crio-1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd WatchSource:0}: Error finding container 1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd: Status 404 returned error can't find the container with id 1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd Jul 06 19:45:00.851917 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.851701 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq"] Jul 06 19:45:00.853515 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:00.853488 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-8vjdw"] Jul 06 19:45:00.854582 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:45:00.854532 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66309b0_3213_407b_8b49_5216715194b8.slice/crio-9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67 WatchSource:0}: Error finding container 9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67: Status 404 returned error can't find the container with id 9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67 Jul 06 19:45:00.855458 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:45:00.855433 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fc7e2a_bfbd_4c95_808e_f51dffd8a03d.slice/crio-0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3 WatchSource:0}: Error finding container 0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3: Status 404 returned error can't find the container with id 0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3 Jul 06 19:45:01.601535 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:01.601495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" event={"ID":"70c9c98e-c431-4485-9c8a-157c2066528d","Type":"ContainerStarted","Data":"1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd"} Jul 06 19:45:01.603065 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:01.602975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" event={"ID":"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d","Type":"ContainerStarted","Data":"0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3"} Jul 06 19:45:01.604311 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:01.604282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" event={"ID":"a66309b0-3213-407b-8b49-5216715194b8","Type":"ContainerStarted","Data":"9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67"} Jul 06 19:45:03.615486 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.615446 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" event={"ID":"70c9c98e-c431-4485-9c8a-157c2066528d","Type":"ContainerStarted","Data":"0c39e52c9fac41f09a20c1949e50b8e806f97e2b3d02a7d6138a8b3d8d15ec9f"} Jul 06 19:45:03.616987 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.616957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" event={"ID":"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d","Type":"ContainerStarted","Data":"7a2e3cdae3ca495b5592fb9af5d9ee17b40463c9e5f5bb887fcde5a67c1b47a8"} Jul 06 19:45:03.618422 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.618395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" event={"ID":"a66309b0-3213-407b-8b49-5216715194b8","Type":"ContainerStarted","Data":"5c863942b39d80935a28ca6514825de83e0c9f759d61d3e5e55f0b6e2389363e"} Jul 06 19:45:03.633489 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.633435 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" podStartSLOduration=1.101908251 podStartE2EDuration="3.633419296s" totalImagesPullingTime="2.531511045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.631174276 +0000 UTC m=+2127.925965940" watchObservedRunningTime="2026-07-06 19:45:03.633419296 +0000 UTC m=+2127.928210961" Jul 06 19:45:03.648304 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.648204 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" podStartSLOduration=1.354336317 podStartE2EDuration="3.648186499s" totalImagesPullingTime="2.293850182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.646294339 +0000 UTC m=+2127.941086005" watchObservedRunningTime="2026-07-06 19:45:03.648186499 +0000 UTC m=+2127.942978189" Jul 06 19:45:03.663941 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:03.663890 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" podStartSLOduration=1.3713730960000001 podStartE2EDuration="3.663873437s" totalImagesPullingTime="2.292500341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.663093805 +0000 UTC m=+2127.957885464" watchObservedRunningTime="2026-07-06 19:45:03.663873437 +0000 UTC m=+2127.958665144" Jul 06 19:45:04.624059 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.624021 2575 generic.go:356] "Generic (PLEG): container finished" podID="70c9c98e-c431-4485-9c8a-157c2066528d" containerID="0c39e52c9fac41f09a20c1949e50b8e806f97e2b3d02a7d6138a8b3d8d15ec9f" exitCode=0 Jul 06 19:45:04.624518 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.624104 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" event={"ID":"70c9c98e-c431-4485-9c8a-157c2066528d","Type":"ContainerDied","Data":"0c39e52c9fac41f09a20c1949e50b8e806f97e2b3d02a7d6138a8b3d8d15ec9f"} Jul 06 19:45:04.625582 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.625560 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d" containerID="7a2e3cdae3ca495b5592fb9af5d9ee17b40463c9e5f5bb887fcde5a67c1b47a8" exitCode=0 Jul 06 19:45:04.625688 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.625636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" event={"ID":"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d","Type":"ContainerDied","Data":"7a2e3cdae3ca495b5592fb9af5d9ee17b40463c9e5f5bb887fcde5a67c1b47a8"} Jul 06 19:45:04.626984 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.626966 2575 generic.go:356] "Generic (PLEG): container finished" podID="a66309b0-3213-407b-8b49-5216715194b8" containerID="5c863942b39d80935a28ca6514825de83e0c9f759d61d3e5e55f0b6e2389363e" exitCode=0 Jul 06 19:45:04.627051 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:04.627042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" event={"ID":"a66309b0-3213-407b-8b49-5216715194b8","Type":"ContainerDied","Data":"5c863942b39d80935a28ca6514825de83e0c9f759d61d3e5e55f0b6e2389363e"} Jul 06 19:45:05.767782 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.767753 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:05.815401 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.815371 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:05.822695 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.822670 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghj2j\" (UniqueName: \"kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j\") pod \"a66309b0-3213-407b-8b49-5216715194b8\" (UID: \"a66309b0-3213-407b-8b49-5216715194b8\") " Jul 06 19:45:05.824856 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.824825 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j" (OuterVolumeSpecName: "kube-api-access-ghj2j") pod "a66309b0-3213-407b-8b49-5216715194b8" (UID: "a66309b0-3213-407b-8b49-5216715194b8"). InnerVolumeSpecName "kube-api-access-ghj2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:05.842232 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.842205 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:05.923963 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.923932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzdqh\" (UniqueName: \"kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh\") pod \"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d\" (UID: \"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d\") " Jul 06 19:45:05.924141 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.924017 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkr9s\" (UniqueName: \"kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s\") pod \"70c9c98e-c431-4485-9c8a-157c2066528d\" (UID: \"70c9c98e-c431-4485-9c8a-157c2066528d\") " Jul 06 19:45:05.924376 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.924359 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghj2j\" (UniqueName: \"kubernetes.io/projected/a66309b0-3213-407b-8b49-5216715194b8-kube-api-access-ghj2j\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:45:05.926260 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.926235 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh" (OuterVolumeSpecName: "kube-api-access-hzdqh") pod "a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d" (UID: "a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d"). InnerVolumeSpecName "kube-api-access-hzdqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:05.926353 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:05.926266 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s" (OuterVolumeSpecName: "kube-api-access-rkr9s") pod "70c9c98e-c431-4485-9c8a-157c2066528d" (UID: "70c9c98e-c431-4485-9c8a-157c2066528d"). InnerVolumeSpecName "kube-api-access-rkr9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:45:06.025474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.025442 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzdqh\" (UniqueName: \"kubernetes.io/projected/a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d-kube-api-access-hzdqh\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:45:06.025474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.025470 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkr9s\" (UniqueName: \"kubernetes.io/projected/70c9c98e-c431-4485-9c8a-157c2066528d-kube-api-access-rkr9s\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:45:06.637208 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.637124 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" Jul 06 19:45:06.637208 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.637156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh" event={"ID":"70c9c98e-c431-4485-9c8a-157c2066528d","Type":"ContainerDied","Data":"1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd"} Jul 06 19:45:06.637411 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.637233 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f0f362fef85eee19fb29999a7827845ccb4f3c14815c56d7073f84d7d16e6cd" Jul 06 19:45:06.638363 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.638346 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" Jul 06 19:45:06.638363 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.638348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-8vjdw" event={"ID":"a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d","Type":"ContainerDied","Data":"0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3"} Jul 06 19:45:06.638521 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.638384 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0311e1ff437c8e3a5cc684356c3da893416cfa500ae7d26b5d8693d0c9d7daa3" Jul 06 19:45:06.639698 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.639678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" event={"ID":"a66309b0-3213-407b-8b49-5216715194b8","Type":"ContainerDied","Data":"9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67"} Jul 06 19:45:06.639771 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.639704 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq" Jul 06 19:45:06.639771 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:45:06.639717 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f7f8432dd670090147604c071275b9f721167203e5895a73bbfeb67db276a67" Jul 06 19:48:37.791149 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:37.791056 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:48:37.791758 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:37.791314 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" podUID="e02fed25-ac04-4b5e-861d-a6346a47c924" containerName="maas-api" containerID="cri-o://01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844" gracePeriod=30 Jul 06 19:48:37.818768 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:37.818734 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh"] Jul 06 19:48:37.823126 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:37.823098 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-26761c-29722785-5sblh"] Jul 06 19:48:38.044830 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.044740 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:48:38.152193 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.152150 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlrcr\" (UniqueName: \"kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr\") pod \"e02fed25-ac04-4b5e-861d-a6346a47c924\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " Jul 06 19:48:38.152368 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.152221 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca\") pod \"e02fed25-ac04-4b5e-861d-a6346a47c924\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " Jul 06 19:48:38.152368 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.152280 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") pod \"e02fed25-ac04-4b5e-861d-a6346a47c924\" (UID: \"e02fed25-ac04-4b5e-861d-a6346a47c924\") " Jul 06 19:48:38.152655 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.152627 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e02fed25-ac04-4b5e-861d-a6346a47c924" (UID: "e02fed25-ac04-4b5e-861d-a6346a47c924"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:48:38.154395 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.154370 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e02fed25-ac04-4b5e-861d-a6346a47c924" (UID: "e02fed25-ac04-4b5e-861d-a6346a47c924"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:48:38.154508 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.154397 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr" (OuterVolumeSpecName: "kube-api-access-dlrcr") pod "e02fed25-ac04-4b5e-861d-a6346a47c924" (UID: "e02fed25-ac04-4b5e-861d-a6346a47c924"). InnerVolumeSpecName "kube-api-access-dlrcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:48:38.253086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.253026 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02fed25-ac04-4b5e-861d-a6346a47c924-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:48:38.253086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.253078 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlrcr\" (UniqueName: \"kubernetes.io/projected/e02fed25-ac04-4b5e-861d-a6346a47c924-kube-api-access-dlrcr\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:48:38.253086 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.253089 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02fed25-ac04-4b5e-861d-a6346a47c924-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:48:38.329816 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.329731 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c9c98e-c431-4485-9c8a-157c2066528d" path="/var/lib/kubelet/pods/70c9c98e-c431-4485-9c8a-157c2066528d/volumes" Jul 06 19:48:38.601782 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.601689 2575 generic.go:356] "Generic (PLEG): container finished" podID="e02fed25-ac04-4b5e-861d-a6346a47c924" containerID="01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844" exitCode=0 Jul 06 19:48:38.601782 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.601742 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" Jul 06 19:48:38.601975 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.601772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" event={"ID":"e02fed25-ac04-4b5e-861d-a6346a47c924","Type":"ContainerDied","Data":"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844"} Jul 06 19:48:38.601975 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.601826 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc" event={"ID":"e02fed25-ac04-4b5e-861d-a6346a47c924","Type":"ContainerDied","Data":"71b10bd4bca0a87c4e8b315d01c4812433618faa5aec7d53ff49a878106e8e58"} Jul 06 19:48:38.601975 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.601847 2575 scope.go:117] "RemoveContainer" containerID="01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844" Jul 06 19:48:38.610159 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.610138 2575 scope.go:117] "RemoveContainer" containerID="01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844" Jul 06 19:48:38.610442 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:48:38.610421 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844\": container with ID starting with 01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844 not found: ID does not exist" containerID="01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844" Jul 06 19:48:38.610484 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.610453 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844"} err="failed to get container status \"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844\": rpc error: code = NotFound desc = could not find container \"01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844\": container with ID starting with 01c01283ba109822b5e5b497e9f81fdc53c2d9e497537e4fabea83320b31d844 not found: ID does not exist" Jul 06 19:48:38.617693 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.617670 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:48:38.621169 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:38.621140 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-26761c-86697996b8-hbzgc"] Jul 06 19:48:40.329953 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:48:40.329921 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e02fed25-ac04-4b5e-861d-a6346a47c924" path="/var/lib/kubelet/pods/e02fed25-ac04-4b5e-861d-a6346a47c924/volumes" Jul 06 19:49:21.235277 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.235182 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:49:21.235882 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.235455 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" podUID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" containerName="maas-api" containerID="cri-o://fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb" gracePeriod=30 Jul 06 19:49:21.264448 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.264413 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq"] Jul 06 19:49:21.266952 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.266921 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-bb8c15-29722785-lmzrq"] Jul 06 19:49:21.484789 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.484762 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:49:21.651638 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.651524 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7j7x\" (UniqueName: \"kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x\") pod \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " Jul 06 19:49:21.651638 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.651604 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") pod \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " Jul 06 19:49:21.651638 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.651626 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca\") pod \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\" (UID: \"b52e5874-c421-4fd2-8b34-e97ea1b091f8\") " Jul 06 19:49:21.651991 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.651968 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b52e5874-c421-4fd2-8b34-e97ea1b091f8" (UID: "b52e5874-c421-4fd2-8b34-e97ea1b091f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:49:21.653817 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.653783 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b52e5874-c421-4fd2-8b34-e97ea1b091f8" (UID: "b52e5874-c421-4fd2-8b34-e97ea1b091f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:49:21.653908 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.653873 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x" (OuterVolumeSpecName: "kube-api-access-f7j7x") pod "b52e5874-c421-4fd2-8b34-e97ea1b091f8" (UID: "b52e5874-c421-4fd2-8b34-e97ea1b091f8"). InnerVolumeSpecName "kube-api-access-f7j7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:49:21.752532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.752497 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7j7x\" (UniqueName: \"kubernetes.io/projected/b52e5874-c421-4fd2-8b34-e97ea1b091f8-kube-api-access-f7j7x\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:49:21.752532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.752527 2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52e5874-c421-4fd2-8b34-e97ea1b091f8-maas-api-tls\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:49:21.752532 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.752537 2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52e5874-c421-4fd2-8b34-e97ea1b091f8-openshift-service-ca\") on node \"ip-10-0-129-72.ec2.internal\" DevicePath \"\"" Jul 06 19:49:21.802557 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.802522 2575 generic.go:356] "Generic (PLEG): container finished" podID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" containerID="fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb" exitCode=0 Jul 06 19:49:21.802748 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.802584 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" Jul 06 19:49:21.802748 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.802616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" event={"ID":"b52e5874-c421-4fd2-8b34-e97ea1b091f8","Type":"ContainerDied","Data":"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb"} Jul 06 19:49:21.802748 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.802680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh" event={"ID":"b52e5874-c421-4fd2-8b34-e97ea1b091f8","Type":"ContainerDied","Data":"945b9f9afc5e3a30338038d1a3e8401891f0ded9916c3b21466305dd0df9a508"} Jul 06 19:49:21.802748 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.802712 2575 scope.go:117] "RemoveContainer" containerID="fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb" Jul 06 19:49:21.811401 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.811376 2575 scope.go:117] "RemoveContainer" containerID="fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb" Jul 06 19:49:21.811692 ip-10-0-129-72 kubenswrapper[2575]: E0706 19:49:21.811671 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb\": container with ID starting with fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb not found: ID does not exist" containerID="fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb" Jul 06 19:49:21.811762 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.811699 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb"} err="failed to get container status \"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb\": rpc error: code = NotFound desc = could not find container \"fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb\": container with ID starting with fb622d408eefa3f310871798f6081ba2b4a71b5bc3c9a12eae0d19761fe7a4cb not found: ID does not exist" Jul 06 19:49:21.822881 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.822852 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:49:21.826722 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:21.826695 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb8c15-f757b8cff-pjrmh"] Jul 06 19:49:22.329433 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:22.329398 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66309b0-3213-407b-8b49-5216715194b8" path="/var/lib/kubelet/pods/a66309b0-3213-407b-8b49-5216715194b8/volumes" Jul 06 19:49:22.329819 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:22.329786 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" path="/var/lib/kubelet/pods/b52e5874-c421-4fd2-8b34-e97ea1b091f8/volumes" Jul 06 19:49:32.771256 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:32.771226 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-8vjdw_a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d/cleanup/0.log" Jul 06 19:49:32.892152 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:32.892120 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc9784b98-hthlp_d4824ffd-5402-48dd-97f4-615367531ce5/manager/0.log" Jul 06 19:49:33.478195 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:33.478163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55c47dfb7f-z6w85_524d804f-ff6a-447c-9310-d328fe48f18c/manager/0.log" Jul 06 19:49:33.487677 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:33.487646 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55c47dfb7f-z6w85_524d804f-ff6a-447c-9310-d328fe48f18c/copy-manifests/0.log" Jul 06 19:49:33.595912 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:33.595879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-sq4bn_2e446f84-5f31-4397-9a90-226190dbb9b3/postgres/0.log" Jul 06 19:49:36.148704 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.148674 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-h6vbt_9225492a-f0b2-4a74-95b0-cd36f7ac077e/discovery/0.log" Jul 06 19:49:36.321420 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.321310 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:49:36.335752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.326995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:49:36.335752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.327015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:49:36.335752 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.332127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j44lf_891831f0-71eb-463d-90ea-a0bb8fc75a57/ovn-acl-logging/0.log" Jul 06 19:49:36.606487 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.606453 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-742hq_720633bd-61e4-472a-9c13-54c6113e6704/payload-pre-processing/0.log" Jul 06 19:49:36.835744 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:36.835660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5756b9455-szd25_75a41da5-156a-4785-9e7b-63eaf701e05b/router/0.log" Jul 06 19:49:37.417643 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:37.417606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lsrgc_fc9c26af-9668-4e68-9706-3b3fb583d1ee/main/0.log" Jul 06 19:49:37.527213 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:37.527180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbx8rd8_ea88b427-8ffe-4d46-bf0b-8ebc191be226/main/0.log" Jul 06 19:49:37.640903 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:37.640866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ln92m_d8e91d24-106a-4756-adf3-401d3a00a81b/main/0.log" Jul 06 19:49:45.206598 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:45.206537 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j8dkw_98a4ad15-afb7-488b-b93a-45db89cf7d44/global-pull-secret-syncer/0.log" Jul 06 19:49:45.378701 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:45.378664 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjldf_ea508f2b-2a9e-410b-8e7b-1e119197a9a1/konnectivity-agent/0.log" Jul 06 19:49:45.430196 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:45.430160 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-72.ec2.internal_bd71acd86f617aec832f721e4495c874/haproxy/0.log" Jul 06 19:49:52.022988 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.022951 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/alertmanager/0.log" Jul 06 19:49:52.044474 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.044448 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/config-reloader/0.log" Jul 06 19:49:52.064364 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.064327 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/kube-rbac-proxy-web/0.log" Jul 06 19:49:52.085984 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.085959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/kube-rbac-proxy/0.log" Jul 06 19:49:52.107589 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.107562 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/kube-rbac-proxy-metric/0.log" Jul 06 19:49:52.130841 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.130815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/prom-label-proxy/0.log" Jul 06 19:49:52.152243 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.152214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ffb03af0-574f-46cc-8a6f-8df3c54c8fbf/init-config-reloader/0.log" Jul 06 19:49:52.357934 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.357857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q496_eb0ede0b-5e8e-446e-a65e-b8adbc0bda36/node-exporter/0.log" Jul 06 19:49:52.376647 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.376618 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q496_eb0ede0b-5e8e-446e-a65e-b8adbc0bda36/kube-rbac-proxy/0.log" Jul 06 19:49:52.396867 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.396838 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q496_eb0ede0b-5e8e-446e-a65e-b8adbc0bda36/init-textfile/0.log" Jul 06 19:49:52.963948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.963919 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf6659646-dhs54_cb9bbad3-f4fd-4810-8055-357ab830f3d8/telemeter-client/0.log" Jul 06 19:49:52.999235 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:52.999208 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf6659646-dhs54_cb9bbad3-f4fd-4810-8055-357ab830f3d8/reload/0.log" Jul 06 19:49:53.022697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:53.022665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf6659646-dhs54_cb9bbad3-f4fd-4810-8055-357ab830f3d8/kube-rbac-proxy/0.log" Jul 06 19:49:55.084022 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.083992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/1.log" Jul 06 19:49:55.093559 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.093502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zz2nv_49891cad-fa9b-413e-934b-62d0169b285c/console-operator/2.log" Jul 06 19:49:55.607738 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.607704 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r"] Jul 06 19:49:55.608033 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608020 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" containerName="maas-api" Jul 06 19:49:55.608074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608034 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" containerName="maas-api" Jul 06 19:49:55.608074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608046 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02fed25-ac04-4b5e-861d-a6346a47c924" containerName="maas-api" Jul 06 19:49:55.608074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608052 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02fed25-ac04-4b5e-861d-a6346a47c924" containerName="maas-api" Jul 06 19:49:55.608074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608060 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d" containerName="cleanup" Jul 06 19:49:55.608074 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608066 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608079 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66309b0-3213-407b-8b49-5216715194b8" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608084 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66309b0-3213-407b-8b49-5216715194b8" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608099 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c9c98e-c431-4485-9c8a-157c2066528d" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608104 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c9c98e-c431-4485-9c8a-157c2066528d" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608156 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02fed25-ac04-4b5e-861d-a6346a47c924" containerName="maas-api" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608163 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66309b0-3213-407b-8b49-5216715194b8" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608168 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b52e5874-c421-4fd2-8b34-e97ea1b091f8" containerName="maas-api" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608176 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d" containerName="cleanup" Jul 06 19:49:55.608219 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.608182 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c9c98e-c431-4485-9c8a-157c2066528d" containerName="cleanup" Jul 06 19:49:55.611121 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.611100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.613182 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.613162 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p6v6j\"/\"default-dockercfg-f9kr7\"" Jul 06 19:49:55.613378 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.613360 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6v6j\"/\"openshift-service-ca.crt\"" Jul 06 19:49:55.613905 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.613889 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6v6j\"/\"kube-root-ca.crt\"" Jul 06 19:49:55.620267 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.620239 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r"] Jul 06 19:49:55.749697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.749602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-podres\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.749697 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.749654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-sys\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.749948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.749702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-proc\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.749948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.749732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-lib-modules\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.749948 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.749786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wgm4\" (UniqueName: \"kubernetes.io/projected/b9ca5210-3c96-40d0-a147-1f8032c4811c-kube-api-access-2wgm4\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.850916 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.850859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-lib-modules\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.850963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wgm4\" (UniqueName: \"kubernetes.io/projected/b9ca5210-3c96-40d0-a147-1f8032c4811c-kube-api-access-2wgm4\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.850994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-podres\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851046 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-sys\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851064 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-lib-modules\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-proc\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-proc\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-sys\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.851373 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.851152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ca5210-3c96-40d0-a147-1f8032c4811c-podres\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.858850 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.858781 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wgm4\" (UniqueName: \"kubernetes.io/projected/b9ca5210-3c96-40d0-a147-1f8032c4811c-kube-api-access-2wgm4\") pod \"perf-node-gather-daemonset-k8h4r\" (UID: \"b9ca5210-3c96-40d0-a147-1f8032c4811c\") " pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:55.921484 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:55.921450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:56.057626 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.057602 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r"] Jul 06 19:49:56.059745 ip-10-0-129-72 kubenswrapper[2575]: W0706 19:49:56.059718 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9ca5210_3c96_40d0_a147_1f8032c4811c.slice/crio-e462fbfaa8705657f3d0375f011fdb417f4a61bc6da77329b1e06e9416374360 WatchSource:0}: Error finding container e462fbfaa8705657f3d0375f011fdb417f4a61bc6da77329b1e06e9416374360: Status 404 returned error can't find the container with id e462fbfaa8705657f3d0375f011fdb417f4a61bc6da77329b1e06e9416374360 Jul 06 19:49:56.317172 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.317138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-tnzkl_4f0e325b-e770-42bf-b316-1ac066d8cbee/volume-data-source-validator/0.log" Jul 06 19:49:56.961883 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.961849 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" event={"ID":"b9ca5210-3c96-40d0-a147-1f8032c4811c","Type":"ContainerStarted","Data":"e5ce32b2731dc88bb1b74b815023a5d201e71fd35b197bd4ee28e1430f64d5cd"} Jul 06 19:49:56.962072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.961902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" event={"ID":"b9ca5210-3c96-40d0-a147-1f8032c4811c","Type":"ContainerStarted","Data":"e462fbfaa8705657f3d0375f011fdb417f4a61bc6da77329b1e06e9416374360"} Jul 06 19:49:56.962072 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.961982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:49:56.977638 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:56.977589 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" podStartSLOduration=1.977573004 podStartE2EDuration="1.977573004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:49:56.97697411 +0000 UTC m=+2421.271765775" watchObservedRunningTime="2026-07-06 19:49:56.977573004 +0000 UTC m=+2421.272364668" Jul 06 19:49:57.422407 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:57.422373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzgj7_527f2c12-3471-4997-a211-71bca0aff199/dns/0.log" Jul 06 19:49:57.441263 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:57.441232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rzgj7_527f2c12-3471-4997-a211-71bca0aff199/kube-rbac-proxy/0.log" Jul 06 19:49:57.461666 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:57.461630 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wwtf_7a879ec8-725e-4b58-ac3d-81937681ef12/dns-node-resolver/0.log" Jul 06 19:49:58.035120 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:58.035088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlrrb_a2331e94-f16f-4dfd-8c88-eecc20675809/node-ca/0.log" Jul 06 19:49:59.142655 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:59.142622 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-h6vbt_9225492a-f0b2-4a74-95b0-cd36f7ac077e/discovery/0.log" Jul 06 19:49:59.300068 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:59.300042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-742hq_720633bd-61e4-472a-9c13-54c6113e6704/payload-pre-processing/0.log" Jul 06 19:49:59.379283 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:49:59.379252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5756b9455-szd25_75a41da5-156a-4785-9e7b-63eaf701e05b/router/0.log" Jul 06 19:50:00.042660 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:00.042626 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k2dbz_3cf7a3dc-b978-4fb8-853b-700379445a8e/serve-healthcheck-canary/0.log" Jul 06 19:50:00.534766 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:00.534732 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8n4q_4dc23f88-f5d2-4e14-998f-115c787f95e0/kube-rbac-proxy/0.log" Jul 06 19:50:00.552750 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:00.552727 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8n4q_4dc23f88-f5d2-4e14-998f-115c787f95e0/exporter/0.log" Jul 06 19:50:00.573837 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:00.573811 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8n4q_4dc23f88-f5d2-4e14-998f-115c787f95e0/extractor/0.log" Jul 06 19:50:02.976385 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:02.976355 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p6v6j/perf-node-gather-daemonset-k8h4r" Jul 06 19:50:03.033938 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:03.033908 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-8vjdw_a8fc7e2a-bfbd-4c95-808e-f51dffd8a03d/cleanup/0.log" Jul 06 19:50:03.191693 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:03.191660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bc9784b98-hthlp_d4824ffd-5402-48dd-97f4-615367531ce5/manager/0.log" Jul 06 19:50:03.752126 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:03.752092 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55c47dfb7f-z6w85_524d804f-ff6a-447c-9310-d328fe48f18c/manager/0.log" Jul 06 19:50:03.780816 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:03.780790 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55c47dfb7f-z6w85_524d804f-ff6a-447c-9310-d328fe48f18c/copy-manifests/0.log" Jul 06 19:50:03.840952 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:03.840921 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-sq4bn_2e446f84-5f31-4397-9a90-226190dbb9b3/postgres/0.log" Jul 06 19:50:05.395705 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:05.395677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78958bf977-r5hwr_4374558b-4a42-4db6-8116-bdafc2d29427/manager/0.log" Jul 06 19:50:05.601017 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:05.600986 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-h6vbt_9225492a-f0b2-4a74-95b0-cd36f7ac077e/discovery/0.log" Jul 06 19:50:05.738615 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:05.738524 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-742hq_720633bd-61e4-472a-9c13-54c6113e6704/payload-pre-processing/0.log" Jul 06 19:50:05.798236 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:05.798192 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5756b9455-szd25_75a41da5-156a-4785-9e7b-63eaf701e05b/router/0.log" Jul 06 19:50:07.177959 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:07.177928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-h6vbt_9225492a-f0b2-4a74-95b0-cd36f7ac077e/discovery/0.log" Jul 06 19:50:07.313671 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:07.313638 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-742hq_720633bd-61e4-472a-9c13-54c6113e6704/payload-pre-processing/0.log" Jul 06 19:50:07.381763 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:07.381702 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5756b9455-szd25_75a41da5-156a-4785-9e7b-63eaf701e05b/router/0.log" Jul 06 19:50:11.924750 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:11.924720 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/kube-multus-additional-cni-plugins/0.log" Jul 06 19:50:11.944699 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:11.944667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/egress-router-binary-copy/0.log" Jul 06 19:50:11.964342 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:11.964316 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/cni-plugins/0.log" Jul 06 19:50:11.988480 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:11.988451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/bond-cni-plugin/0.log" Jul 06 19:50:12.012427 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.012401 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/routeoverride-cni/0.log" Jul 06 19:50:12.033676 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.033650 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/whereabouts-cni-bincopy/0.log" Jul 06 19:50:12.055634 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.055605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-75s6d_b32ecc89-69fb-4092-8d44-5990819e70e7/whereabouts-cni/0.log" Jul 06 19:50:12.249153 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.249054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gf6kz_69bc136b-e47c-49a2-9fab-d87688054f05/kube-multus/0.log" Jul 06 19:50:12.434146 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.434113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j26gh_7682152a-9bff-4bbe-ba36-319c9ffb818f/network-metrics-daemon/0.log" Jul 06 19:50:12.451173 ip-10-0-129-72 kubenswrapper[2575]: I0706 19:50:12.451142 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j26gh_7682152a-9bff-4bbe-ba36-319c9ffb818f/kube-rbac-proxy/0.log"