Sep 10 23:36:22.799452 ip-10-0-129-151 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 23:36:23.190797 ip-10-0-129-151 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:23.190797 ip-10-0-129-151 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 23:36:23.190797 ip-10-0-129-151 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:23.190797 ip-10-0-129-151 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 23:36:23.190797 ip-10-0-129-151 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 23:36:23.193820 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.193737    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 23:36:23.199789 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199772    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.199789 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199789    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199793    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199797    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199800    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199803    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199814    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199817    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199819    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199822    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199824    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199827    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199829    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199832    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199834    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199837    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199839    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199842    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199845    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199847    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199850    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.199853 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199853    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199856    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199859    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199862    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199865    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199868    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199870    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199873    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199875    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199878    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199880    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199883    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199886    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199888    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199891    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199893    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199896    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199898    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199901    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199903    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.200351 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199906    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199908    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199911    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199914    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199916    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199919    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199921    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199924    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199926    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199928    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199930    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199933    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199935    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199938    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199942    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199945    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199948    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199950    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199953    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199955    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.200879 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199959    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199964    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199967    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199970    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199973    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199975    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199978    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199981    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199983    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199986    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199988    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199991    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199993    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199995    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.199998    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200002    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200006    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200008    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200011    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200013    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.201384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200016    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200019    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200023    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200025    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200028    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200030    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200033    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200036    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200039    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200043    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200046    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200049    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200052    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200055    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200058    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200060    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200062    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200065    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200841    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.201855 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200855    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200859    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200862    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200866    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200869    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200872    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200875    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200878    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200881    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200884    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200887    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200890    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200893    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200896    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200898    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200901    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200904    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200906    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200909    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.202322 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200911    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200914    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200916    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200919    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200921    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200924    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200926    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200929    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200931    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200934    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200936    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200940    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200942    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200946    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200949    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200951    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200954    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200957    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200959    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200962    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.202785 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200965    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200967    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200970    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200973    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200975    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200977    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200980    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200982    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200985    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200987    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200990    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200992    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200994    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200997    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.200999    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201002    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201004    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201007    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201009    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201012    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.203274 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201015    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201017    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201020    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201022    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201025    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201028    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201031    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201033    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201036    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201038    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201041    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201043    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201045    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201049    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201052    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201054    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201057    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201059    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201062    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201065    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.203763 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201067    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201069    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201072    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201075    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201079    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201083    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201086    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201089    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201094    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201098    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201101    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201106    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201109    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201112    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201115    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201118    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201121    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201124    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.204373 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201128    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201519    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201524    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201527    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201530    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201533    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201535    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201538    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201541    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201544    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201546    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201549    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201551    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201554    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201557    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201559    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201562    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201565    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201567    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201570    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.204841 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201572    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201575    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201577    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201580    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201596    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201604    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201608    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201611    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201614    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201617    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201619    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201623    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201625    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201631    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201634    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201638    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201640    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201643    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201646    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.205334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201649    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201652    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201654    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201657    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201659    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201662    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201664    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201667    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201669    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201672    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201674    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201677    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201679    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201682    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201684    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201687    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201689    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201691    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201695    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201698    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.205816 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201700    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201703    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201705    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201708    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201711    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201714    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201716    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201719    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201722    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201724    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201727    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201729    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201732    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201734    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201737    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201739    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201742    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201744    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201748    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201751    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.206343 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201755    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201759    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201761    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201764    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201766    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201769    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201771    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201774    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201776    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201778    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201782    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201785    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201787    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201790    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201793    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201796    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201798    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201801    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201803    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201806    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.206827 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.201809    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201883    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201920    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201927    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201932    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201936    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201939    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201943    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201948    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201951    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201954    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201957    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201961    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201964    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201967    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201970    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201973    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201976    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201979    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201983    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201985    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201988    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201992    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201995    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 23:36:23.207354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.201999    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202002    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202006    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202009    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202012    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202014    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202017    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202020    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202023    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202028    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202031    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202034    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202037    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202039    2581 flags.go:64] FLAG: --enable-server="true"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202042    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202047    2581 flags.go:64] FLAG: --event-burst="100"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202050    2581 flags.go:64] FLAG: --event-qps="50"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202053    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202056    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202059    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202063    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202065    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202068    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202071    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202074    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 23:36:23.207917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202077    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202080    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202082    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202085    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202088    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202091    2581 flags.go:64] FLAG: --feature-gates=""
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202095    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202098    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202101    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202104    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202107    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202111    2581 flags.go:64] FLAG: --help="false"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202113    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202116    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202119    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202122    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202125    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202129    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202131    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202134    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202137    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202140    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202143    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202145    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 23:36:23.208534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202148    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202151    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202154    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202157    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202160    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202163    2581 flags.go:64] FLAG: --lock-file=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202166    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202169    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202172    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202177    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202180    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202183    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202186    2581 flags.go:64] FLAG: --logging-format="text"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202189    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202192    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202195    2581 flags.go:64] FLAG: --manifest-url=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202198    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202202    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202206    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202209    2581 flags.go:64] FLAG: --max-pods="110"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202212    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202215    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202218    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202221    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202224    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 23:36:23.209135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202227    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202230    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202238    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202241    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202244    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202247    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202250    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202255    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202258    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202261    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202264    2581 flags.go:64] FLAG: --port="10250"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202267    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202270    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005b5be3a9416441d"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202273    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202276    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202279    2581 flags.go:64] FLAG: --register-node="true"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202296    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202300    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202303    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202306    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202309    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202313    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202316    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202319    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202322    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 23:36:23.209777 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202325    2581 flags.go:64] FLAG: --runonce="false"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202328    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202331    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202334    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202337    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202340    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202343    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202346    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202349    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202352    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202356    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202358    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202361    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202364    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202367    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202370    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202375    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202378    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202381    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202384    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202387    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202390    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202392    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202395    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202398    2581 flags.go:64] FLAG: --v="2"
Sep 10 23:36:23.210456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202401    2581 flags.go:64] FLAG: --version="false"
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202405    2581 flags.go:64] FLAG: --vmodule=""
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202409    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.202413    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202527    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202530    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202535    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202538    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202541    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202543    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202546    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202549    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202551    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202554    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202556    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202559    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202562    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202565    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202568    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202570    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202573    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.211091 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202575    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202578    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202581    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202583    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202586    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202589    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202591    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202593    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202596    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202599    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202601    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202604    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202606    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202608    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202612    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202615    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202617    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202621    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202624    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.211771 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202626    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202629    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202632    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202635    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202637    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202640    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202643    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202645    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202648    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202650    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202653    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202655    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202658    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202661    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202663    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202666    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202668    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202671    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202673    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202676    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.212492 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202679    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202683    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202687    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202690    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202693    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202696    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202698    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202703    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202707    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202711    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202715    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202719    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202723    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202726    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202729    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202732    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202735    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202738    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202740    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.212990 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202743    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202746    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202748    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202751    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202754    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202756    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202759    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202762    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202764    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202767    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202769    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202772    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202774    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202777    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202779    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202782    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202784    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202787    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202789    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.213489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202792    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.213959 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202797    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.213959 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202800    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.213959 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202803    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.213959 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.202806    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.213959 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.203723    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:23.214358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.214336    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 23:36:23.214358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.214358    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 23:36:23.215255 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.215245    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 23:36:23.215306 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.215255    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 23:36:23.215393 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215383    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215395    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215399    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215403    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215407    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215410    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215413    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215417    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215420    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.215420 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215423    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215426    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215429    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215432    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215435    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215442    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215445    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215448    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215451    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215454    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215457    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215459    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215462    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215465    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215468    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215471    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215475    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215481    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215484    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.215646 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215488    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215498    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215501    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215504    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215507    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215509    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215512    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215515    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215517    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215520    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215526    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215528    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215531    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215534    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215536    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215541    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215544    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215546    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215549    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.216131 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215552    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215555    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215557    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215560    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215565    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215568    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215570    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215573    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215576    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215578    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215581    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215585    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215589    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215592    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215595    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215603    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215606    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215611    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215614    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215617    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.216615 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215620    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215622    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215625    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215628    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215630    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215633    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215636    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215639    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215642    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215647    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215651    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215654    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215657    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215659    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215662    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215665    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215667    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215670    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215673    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215676    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.217096 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215678    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215681    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215686    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215689    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215692    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215694    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215697    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215700    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215708    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215711    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215714    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215716    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.215722    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215980    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215985    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 23:36:23.217617 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215988    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215992    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.215997    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216000    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216003    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216006    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216009    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216012    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216016    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216020    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216024    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216027    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216030    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216033    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216039    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216042    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216045    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216048    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216051    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 23:36:23.217985 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216054    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216058    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216061    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216064    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216067    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216070    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216073    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216081    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216087    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216090    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216093    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216095    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216098    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216101    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216103    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216106    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216109    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216112    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216115    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216118    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 23:36:23.218474 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216123    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216126    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216129    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216132    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216134    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216137    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216140    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216143    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216146    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216148    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216151    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216160    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216162    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216167    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216170    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216173    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216176    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216178    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216181    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216183    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 23:36:23.218951 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216192    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216195    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216198    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216201    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216204    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216209    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216212    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216215    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216217    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216220    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216223    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216226    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216228    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216231    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216234    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216236    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216239    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216242    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216247    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216249    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 23:36:23.219477 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216252    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216255    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216257    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216260    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216263    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216265    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216268    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216271    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216274    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216276    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216281    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216300    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216303    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216312    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216315    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216317    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216320    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 23:36:23.219966 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:23.216323    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 23:36:23.220391 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.216328    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 23:36:23.220391 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.217374    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 23:36:23.221406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.221391    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 23:36:23.222514 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.222503    2581 server.go:1019] "Starting client certificate rotation"
Sep 10 23:36:23.222618 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.222604    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:36:23.222650 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.222636    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 23:36:23.225461 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.225448    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:36:23.226646 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.226629    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 23:36:23.237250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.237235    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 10 23:36:23.242973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.242956    2581 log.go:25] "Validated CRI v1 image API"
Sep 10 23:36:23.243801 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.243783    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 23:36:23.247903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.247878    2581 fs.go:135] Filesystem UUIDs: map[64bbd145-342b-4254-959b-76b981d2a9a6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c16448a1-67cb-4686-b272-4ee6166d5959:/dev/nvme0n1p4]
Sep 10 23:36:23.247969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.247901    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 23:36:23.252599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.252575    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:36:23.253469 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.253360    2581 manager.go:216] Machine: {Timestamp:2026-09-10 23:36:23.251890559 +0000 UTC m=+0.351472652 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101319 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec281f996ea731e5902ab4a80eb4ca1c SystemUUID:ec281f99-6ea7-31e5-902a-b4a80eb4ca1c BootID:ceb21648-e352-4dc8-84bb-3a2ff585adea Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:7e:8b:ef:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:7e:8b:ef:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:34:61:4e:5a:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 23:36:23.253469 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.253466    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 23:36:23.253562 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.253545    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 23:36:23.257243 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.257214    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 23:36:23.257410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.257253    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-151.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 23:36:23.258111 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.258101    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 23:36:23.258147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.258113    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 23:36:23.258147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.258122    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:36:23.258827 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.258816    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 23:36:23.260170 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.260161    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 23:36:23.264806 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264794    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:36:23.264921 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264911    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 23:36:23.264962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264940    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 23:36:23.264962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264949    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 23:36:23.265020 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264969    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 23:36:23.265020 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.264999    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 10 23:36:23.265020 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.265008    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 23:36:23.265554 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.265538    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:36:23.265604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.265579    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 23:36:23.269767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.269726    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 23:36:23.272636 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.272621    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 23:36:23.272703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.272653    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 23:36:23.274001 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.273984    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88fbj"
Sep 10 23:36:23.274812 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274800    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274818    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274824    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274829    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274837    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274843    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274856    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 23:36:23.274863 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274862    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 23:36:23.275044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274869    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 23:36:23.275044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274874    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 23:36:23.275044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274882    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 23:36:23.275044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.274887    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 23:36:23.275467 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.275445    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-151.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 23:36:23.275531 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.275487    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 23:36:23.276692 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.276670    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 23:36:23.276733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.276693    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 23:36:23.280511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.280499    2581 server.go:1268] "Started kubelet"
Sep 10 23:36:23.280615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.280588    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 23:36:23.280663 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.280599    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 23:36:23.280712 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.280687    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 23:36:23.281090 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.281070    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88fbj"
Sep 10 23:36:23.281409 ip-10-0-129-151 systemd[1]: Started Kubernetes Kubelet.
Sep 10 23:36:23.282313 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.282048    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 23:36:23.282608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.282590    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 23:36:23.285034 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.285013    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 23:36:23.287612 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.287598    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-151.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 23:36:23.288830 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.287691    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-151.ec2.internal.18d419dbadfc9910  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-151.ec2.internal,UID:ip-10-0-129-151.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-151.ec2.internal,},FirstTimestamp:2026-09-10 23:36:23.280474384 +0000 UTC m=+0.380056477,LastTimestamp:2026-09-10 23:36:23.280474384 +0000 UTC m=+0.380056477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-151.ec2.internal,}"
Sep 10 23:36:23.290923 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.290907    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 23:36:23.291599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.291583    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 23:36:23.291723 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.291706    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.292440 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292415    2581 factory.go:55] Registering systemd factory
Sep 10 23:36:23.292522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292467    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 10 23:36:23.292522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292418    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 23:36:23.292522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292422    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 23:36:23.292522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292504    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 23:36:23.292691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292565    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 23:36:23.292691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292574    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 23:36:23.292691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292679    2581 factory.go:153] Registering CRI-O factory
Sep 10 23:36:23.292787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292699    2581 factory.go:223] Registration of the crio container factory successfully
Sep 10 23:36:23.292787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292750    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 23:36:23.292787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292766    2581 factory.go:103] Registering Raw factory
Sep 10 23:36:23.292787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.292777    2581 manager.go:1196] Started watching for new ooms in manager
Sep 10 23:36:23.293196 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.293184    2581 manager.go:349] Starting recovery of all containers
Sep 10 23:36:23.293670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.293647    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:23.296628 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.296535    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-151.ec2.internal\" not found" node="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.304616 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.304581    2581 manager.go:354] Recovery completed
Sep 10 23:36:23.309774 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.309760    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.311717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.311699    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.311780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.311734    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.311780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.311746    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.312360 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.312345    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 23:36:23.312360 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.312357    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.312473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.312360    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 23:36:23.312473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.312380    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 23:36:23.313044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.313031    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.313107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.313055    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.313107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.313065    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.314563 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.314551    2581 policy_none.go:49] "None policy: Start"
Sep 10 23:36:23.314609 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.314567    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 23:36:23.314609 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.314577    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 23:36:23.316553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.316543    2581 policy_none.go:47] "Start"
Sep 10 23:36:23.354678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.354664    2581 manager.go:337] "Starting Device Plugin manager"
Sep 10 23:36:23.354764 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.354701    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 23:36:23.354764 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.354711    2581 server.go:87] "Starting device plugin registration server"
Sep 10 23:36:23.355069 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.355054    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 23:36:23.355134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.355072    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 23:36:23.355278 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.355250    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 23:36:23.355433 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.355421    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 23:36:23.355433 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.355434    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 23:36:23.355784 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.355768    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 23:36:23.355851 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.355820    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.440584 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.440552    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 23:36:23.442756 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.441880    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 23:36:23.442756 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.441935    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 23:36:23.442756 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.441963    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 23:36:23.442756 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.442010    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 23:36:23.443938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.443919    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:23.455175 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.455154    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.456043 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.456027    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.456121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.456056    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.456121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.456067    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.456121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.456088    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.463539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.463522    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.463625 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.463548    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-151.ec2.internal\": node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.476998 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.476974    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.542753 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.542710    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"]
Sep 10 23:36:23.542856 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.542806    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.543822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.543805    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.543903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.543838    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.543903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.543848    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.546108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546095    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.546225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.546264 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546242    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.546839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546821    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.546918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546851    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.546918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546867    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.546918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546828    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.547059 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546932    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.547059 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.546944    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.549087 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.549069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.549172 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.549095    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 23:36:23.549824 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.549809    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 23:36:23.549899 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.549834    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 23:36:23.549899 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.549844    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeHasSufficientPID"
Sep 10 23:36:23.577112 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.577089    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.581924 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.581907    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-151.ec2.internal\" not found" node="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.586450 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.586435    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-151.ec2.internal\" not found" node="ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.595513 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.595494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.595608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.595520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3203e1487e60b01c3cea04380828f485-config\") pod \"kube-apiserver-proxy-ip-10-0-129-151.ec2.internal\" (UID: \"3203e1487e60b01c3cea04380828f485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.595608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.595536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.678198 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.678171    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.696555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.696555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.696555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3203e1487e60b01c3cea04380828f485-config\") pod \"kube-apiserver-proxy-ip-10-0-129-151.ec2.internal\" (UID: \"3203e1487e60b01c3cea04380828f485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.696678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.696678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbfe5b4b33fd51fcd208722247de0d3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal\" (UID: \"bbfe5b4b33fd51fcd208722247de0d3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.696678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.696607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3203e1487e60b01c3cea04380828f485-config\") pod \"kube-apiserver-proxy-ip-10-0-129-151.ec2.internal\" (UID: \"3203e1487e60b01c3cea04380828f485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.778963 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.778923    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.879480 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.879457    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:23.884636 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.884607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.889918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:23.889719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:23.979783 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:23.979701    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:24.080235 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:24.080200    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:24.180772 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:24.180742    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:24.222382 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.222359    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 23:36:24.222794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.222507    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:36:24.222794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.222516    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 23:36:24.281897 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:24.281820    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-151.ec2.internal\" not found"
Sep 10 23:36:24.288738 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.288705    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 23:31:23 +0000 UTC" deadline="2028-04-12 13:33:05.523777546 +0000 UTC"
Sep 10 23:36:24.288738 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.288731    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13909h56m41.235049718s"
Sep 10 23:36:24.356119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.356100    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:24.392027 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.391997    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:24.402571 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.402548    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:36:24.403869 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.403853    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"
Sep 10 23:36:24.411511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.411492    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 23:36:24.499717 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:24.499686    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbfe5b4b33fd51fcd208722247de0d3f.slice/crio-c2837bf9998c79a4a7fcb49568d55c67713c015b234384cc85747722d92f4f33 WatchSource:0}: Error finding container c2837bf9998c79a4a7fcb49568d55c67713c015b234384cc85747722d92f4f33: Status 404 returned error can't find the container with id c2837bf9998c79a4a7fcb49568d55c67713c015b234384cc85747722d92f4f33
Sep 10 23:36:24.499922 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:24.499906    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3203e1487e60b01c3cea04380828f485.slice/crio-bbd3cdf66f47e8a33e011d085fe718c09ed51a0be2556e88e5228047d4c351c6 WatchSource:0}: Error finding container bbd3cdf66f47e8a33e011d085fe718c09ed51a0be2556e88e5228047d4c351c6: Status 404 returned error can't find the container with id bbd3cdf66f47e8a33e011d085fe718c09ed51a0be2556e88e5228047d4c351c6
Sep 10 23:36:24.503704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.503683    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:36:24.628603 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:24.628530    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:25.266307 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.266256    2581 apiserver.go:52] "Watching apiserver"
Sep 10 23:36:25.277663 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.277627    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 23:36:25.279877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.279524    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qbgn5","openshift-image-registry/node-ca-852dd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal","openshift-multus/multus-hlnpc","openshift-multus/network-metrics-daemon-g465n","openshift-network-operator/iptables-alerter-tdx5v","kube-system/global-pull-secret-syncer-gdztg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5","openshift-cluster-node-tuning-operator/tuned-p55tr","openshift-multus/multus-additional-cni-plugins-x5pkt","openshift-network-diagnostics/network-check-target-wkcxq","openshift-ovn-kubernetes/ovnkube-node-dhnp9","kube-system/konnectivity-agent-7kx7t","kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal"]
Sep 10 23:36:25.282182 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.282146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.282317 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.282253    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:25.284530 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.284507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.286999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.286807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 23:36:25.286999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.286820    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 23:36:25.286999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.286839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7445n\""
Sep 10 23:36:25.286999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.286971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.289004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.288961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vfpbn\""
Sep 10 23:36:25.289004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.288975    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.289186 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.289165    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.289250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.289186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 23:36:25.289498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.289478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.292023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.292006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.292134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.292049    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 23:36:25.292195 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.292172    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:25.292926 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.292860    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.292926 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.292900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.293122 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.293106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vds2\""
Sep 10 23:36:25.293181 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.293150    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 23:36:25.293332 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.293314    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 23:36:25.294526 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.294507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.296639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.296616    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.296753 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.296727    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 23:36:25.296825 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.296760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-szw92\""
Sep 10 23:36:25.297055 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.297041    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.297121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.297043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.299630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.299609    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.299762 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.299661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.299988 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.299970    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.300133 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.300114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ssrcc\""
Sep 10 23:36:25.302573 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.302551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.302698 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.302678    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.302877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.302859    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x2bxs\""
Sep 10 23:36:25.303260 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.303240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.305515 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.305496    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 23:36:25.305718 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.305698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.305839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.305770    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmxbz\""
Sep 10 23:36:25.305904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.305857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.305970 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.305951    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.306058 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.306121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-konnectivity-ca\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.306177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-netns\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.306281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e899174-6f8e-44ac-8f2f-bf0029031b95-iptables-alerter-script\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.306281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-cni-binary-copy\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-multus\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-kubelet-config\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.306511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-multus-certs\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-etc-kubernetes\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-socket-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.306511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-k8s-cni-cncf-io\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-bin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-kubelet\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-multus-daemon-config\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqgt\" (UniqueName: \"kubernetes.io/projected/1ac28577-b61f-4b9f-afb0-316141947106-kube-api-access-2cqgt\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e899174-6f8e-44ac-8f2f-bf0029031b95-host-slash\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-registration-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-sys-fs\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-socket-dir-parent\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-dbus\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njg92\" (UniqueName: \"kubernetes.io/projected/3e899174-6f8e-44ac-8f2f-bf0029031b95-kube-api-access-njg92\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-cnibin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.306846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-device-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.307054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.307054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-agent-certs\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.307054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.307054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.306988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-system-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.307054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.307012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2fr\" (UniqueName: \"kubernetes.io/projected/27274aa2-1585-40d5-8ff8-450894cde5d2-kube-api-access-mj2fr\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.307202 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.307053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5q4\" (UniqueName: \"kubernetes.io/projected/321ecfef-1611-45ce-8331-c0c50728b25c-kube-api-access-qk5q4\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.307202 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.307079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-hostroot\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.307202 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.307134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-conf-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.307595 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.307574    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 23:36:25.308387 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.308366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:25.308733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.308711    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 23:36:25.308803 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.308760    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:25.309486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.309449    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 23:36:25.310199 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.310182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t8hpb\""
Sep 10 23:36:25.311782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.311764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.314203 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.314181    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 23:36:25.315465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.315054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 23:36:25.315465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.315056    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 23:36:25.315465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.315207    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 23:36:25.315780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.315486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 23:36:25.316463 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.316444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wx56f\""
Sep 10 23:36:25.317357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.317337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 23:36:25.338635 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.338599    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9khl4"
Sep 10 23:36:25.347944 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.347916    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9khl4"
Sep 10 23:36:25.365530 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.365508    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:25.394672 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.394595    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 23:36:25.407615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-ovn\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-log-socket\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-conf\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84m7\" (UniqueName: \"kubernetes.io/projected/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-kube-api-access-g84m7\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cnibin\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.407772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-systemd\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-node-log\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-device-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-system-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2fr\" (UniqueName: \"kubernetes.io/projected/27274aa2-1585-40d5-8ff8-450894cde5d2-kube-api-access-mj2fr\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-system-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-device-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.407992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:25.408071 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-netns\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408299 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408299 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5q4\" (UniqueName: \"kubernetes.io/projected/321ecfef-1611-45ce-8331-c0c50728b25c-kube-api-access-qk5q4\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.408299 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-hostroot\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408299 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-conf-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-run\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.408450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-var-lib-kubelet\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.408450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-netd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-netns\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.408601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-modprobe-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.408601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-script-lib\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.408601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-multus\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af313ef3-846e-42ac-a5d3-fa795ec2f160-hosts-file\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-kubelet\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztmvm\" (UniqueName: \"kubernetes.io/projected/55f86f66-b73f-4efb-95e2-bebee778f6fc-kube-api-access-ztmvm\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-socket-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-k8s-cni-cncf-io\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-bin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-kubelet\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-multus-daemon-config\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.408768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqgt\" (UniqueName: \"kubernetes.io/projected/1ac28577-b61f-4b9f-afb0-316141947106-kube-api-access-2cqgt\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-lib-modules\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-registration-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-sys-fs\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-socket-dir-parent\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-host\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mfs\" (UniqueName: \"kubernetes.io/projected/a58e43f0-f0ee-424c-a9d5-197585bab353-kube-api-access-k7mfs\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.408999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-etc-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.409030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-bin\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-dbus\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-multus\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-k8s-cni-cncf-io\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409118    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-cni-bin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-var-lib-kubelet\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409296 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-sys-fs\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.409564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-conf-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njg92\" (UniqueName: \"kubernetes.io/projected/3e899174-6f8e-44ac-8f2f-bf0029031b95-kube-api-access-njg92\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.409564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-socket-dir-parent\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409564 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.409533    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409574    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-multus-cni-dir\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.409590    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:25.90957303 +0000 UTC m=+3.009155112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-netns\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysconfig\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-hostroot\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-registration-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-multus-daemon-config\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-dbus\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn666\" (UniqueName: \"kubernetes.io/projected/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-kube-api-access-cn666\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.409759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-socket-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-systemd-units\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-kubernetes\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-tmp\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-cnibin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.409974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-agent-certs\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-cnibin\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.410137    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:25.410155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-var-lib-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-system-cni-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovn-node-metrics-cert\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.410306    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:25.9102801 +0000 UTC m=+3.009862197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-konnectivity-ca\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e899174-6f8e-44ac-8f2f-bf0029031b95-iptables-alerter-script\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410384    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-etc-selinux\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-sys\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a58e43f0-f0ee-424c-a9d5-197585bab353-host\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/321ecfef-1611-45ce-8331-c0c50728b25c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a58e43f0-f0ee-424c-a9d5-197585bab353-serviceca\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-systemd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.410586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-config\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-cni-binary-copy\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410662    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-kubelet-config\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-multus-certs\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-etc-kubernetes\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03373111-12a7-456f-9f0a-a7fcaac828d7-kubelet-config\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-etc-kubernetes\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.410906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ac28577-b61f-4b9f-afb0-316141947106-host-run-multus-certs\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af313ef3-846e-42ac-a5d3-fa795ec2f160-tmp-dir\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e899174-6f8e-44ac-8f2f-bf0029031b95-iptables-alerter-script\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72ql\" (UniqueName: \"kubernetes.io/projected/af313ef3-846e-42ac-a5d3-fa795ec2f160-kube-api-access-j72ql\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-env-overrides\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ac28577-b61f-4b9f-afb0-316141947106-cni-binary-copy\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e899174-6f8e-44ac-8f2f-bf0029031b95-host-slash\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.411218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-konnectivity-ca\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.411984 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e899174-6f8e-44ac-8f2f-bf0029031b95-host-slash\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.411984 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-tuned\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.411984 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-slash\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.411984 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.411305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.417073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.416760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c37c471b-53ac-4eff-88ad-1a1b6863b3aa-agent-certs\") pod \"konnectivity-agent-7kx7t\" (UID: \"c37c471b-53ac-4eff-88ad-1a1b6863b3aa\") " pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.418358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.418284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2fr\" (UniqueName: \"kubernetes.io/projected/27274aa2-1585-40d5-8ff8-450894cde5d2-kube-api-access-mj2fr\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.419999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.419973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5q4\" (UniqueName: \"kubernetes.io/projected/321ecfef-1611-45ce-8331-c0c50728b25c-kube-api-access-qk5q4\") pod \"aws-ebs-csi-driver-node-klrm5\" (UID: \"321ecfef-1611-45ce-8331-c0c50728b25c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.420480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.420455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njg92\" (UniqueName: \"kubernetes.io/projected/3e899174-6f8e-44ac-8f2f-bf0029031b95-kube-api-access-njg92\") pod \"iptables-alerter-tdx5v\" (UID: \"3e899174-6f8e-44ac-8f2f-bf0029031b95\") " pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.422060 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.422004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqgt\" (UniqueName: \"kubernetes.io/projected/1ac28577-b61f-4b9f-afb0-316141947106-kube-api-access-2cqgt\") pod \"multus-hlnpc\" (UID: \"1ac28577-b61f-4b9f-afb0-316141947106\") " pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.447161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.447087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal" event={"ID":"bbfe5b4b33fd51fcd208722247de0d3f","Type":"ContainerStarted","Data":"c2837bf9998c79a4a7fcb49568d55c67713c015b234384cc85747722d92f4f33"}
Sep 10 23:36:25.449094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.449037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal" event={"ID":"3203e1487e60b01c3cea04380828f485","Type":"ContainerStarted","Data":"bbd3cdf66f47e8a33e011d085fe718c09ed51a0be2556e88e5228047d4c351c6"}
Sep 10 23:36:25.512406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysconfig\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn666\" (UniqueName: \"kubernetes.io/projected/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-kube-api-access-cn666\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-systemd-units\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysconfig\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-kubernetes\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-tmp\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-var-lib-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-system-cni-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovn-node-metrics-cert\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-sys\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a58e43f0-f0ee-424c-a9d5-197585bab353-host\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a58e43f0-f0ee-424c-a9d5-197585bab353-serviceca\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-systemd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-config\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af313ef3-846e-42ac-a5d3-fa795ec2f160-tmp-dir\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72ql\" (UniqueName: \"kubernetes.io/projected/af313ef3-846e-42ac-a5d3-fa795ec2f160-kube-api-access-j72ql\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-env-overrides\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-tuned\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.512972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-slash\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.512990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-ovn\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-log-socket\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-conf\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84m7\" (UniqueName: \"kubernetes.io/projected/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-kube-api-access-g84m7\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cnibin\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-systemd\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-node-log\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-netns\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-run\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-var-lib-kubelet\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-netd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.513529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-modprobe-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-script-lib\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af313ef3-846e-42ac-a5d3-fa795ec2f160-hosts-file\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-kubelet\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztmvm\" (UniqueName: \"kubernetes.io/projected/55f86f66-b73f-4efb-95e2-bebee778f6fc-kube-api-access-ztmvm\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-lib-modules\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-host\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mfs\" (UniqueName: \"kubernetes.io/projected/a58e43f0-f0ee-424c-a9d5-197585bab353-kube-api-access-k7mfs\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-etc-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-bin\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-kubernetes\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.513786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-systemd-units\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a58e43f0-f0ee-424c-a9d5-197585bab353-host\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-env-overrides\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-var-lib-kubelet\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.514326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-run\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-slash\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-lib-modules\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-host\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-ovn\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-log-socket\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-netd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-conf\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-modprobe-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-kubelet\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-etc-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-var-lib-openvswitch\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-system-cni-dir\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-cni-bin\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.515099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.514943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cnibin\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-script-lib\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-sysctl-d\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515466    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-node-log\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-systemd\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-netns\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-sys\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af313ef3-846e-42ac-a5d3-fa795ec2f160-hosts-file\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.515801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f86f66-b73f-4efb-95e2-bebee778f6fc-run-systemd\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.516131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.516019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af313ef3-846e-42ac-a5d3-fa795ec2f160-tmp-dir\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.516766 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.516149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a58e43f0-f0ee-424c-a9d5-197585bab353-serviceca\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.516766 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.516222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovnkube-config\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.517210 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.517186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-tmp\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.517545 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.517525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f86f66-b73f-4efb-95e2-bebee778f6fc-ovn-node-metrics-cert\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.518484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.518459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-etc-tuned\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.521624 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.521581    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:25.521624 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.521610    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:25.521624 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.521626    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:25.521843 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.521696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:26.021675794 +0000 UTC m=+3.121257895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:25.522418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.522395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn666\" (UniqueName: \"kubernetes.io/projected/c5015ed2-cebb-4e80-ba94-61b9eec7ffe0-kube-api-access-cn666\") pod \"multus-additional-cni-plugins-x5pkt\" (UID: \"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0\") " pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.523376 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.523345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztmvm\" (UniqueName: \"kubernetes.io/projected/55f86f66-b73f-4efb-95e2-bebee778f6fc-kube-api-access-ztmvm\") pod \"ovnkube-node-dhnp9\" (UID: \"55f86f66-b73f-4efb-95e2-bebee778f6fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.523498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.523476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72ql\" (UniqueName: \"kubernetes.io/projected/af313ef3-846e-42ac-a5d3-fa795ec2f160-kube-api-access-j72ql\") pod \"node-resolver-qbgn5\" (UID: \"af313ef3-846e-42ac-a5d3-fa795ec2f160\") " pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.524255 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.524238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mfs\" (UniqueName: \"kubernetes.io/projected/a58e43f0-f0ee-424c-a9d5-197585bab353-kube-api-access-k7mfs\") pod \"node-ca-852dd\" (UID: \"a58e43f0-f0ee-424c-a9d5-197585bab353\") " pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.524619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.524597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84m7\" (UniqueName: \"kubernetes.io/projected/673206a3-9cea-4d0a-9716-45fd2b3d5bcf-kube-api-access-g84m7\") pod \"tuned-p55tr\" (UID: \"673206a3-9cea-4d0a-9716-45fd2b3d5bcf\") " pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.543267 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.543238    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 23:36:25.597543 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.597457    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:25.605428 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.605405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5"
Sep 10 23:36:25.614306 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.614280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlnpc"
Sep 10 23:36:25.624322 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.624280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdx5v"
Sep 10 23:36:25.640502 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.640456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p55tr"
Sep 10 23:36:25.647891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.647868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbgn5"
Sep 10 23:36:25.654782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.654758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-852dd"
Sep 10 23:36:25.664721 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.664699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5pkt"
Sep 10 23:36:25.670758 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.670735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:25.917467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.917387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:25.917467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:25.917438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:25.917696 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.917551    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:25.917696 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.917560    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:25.917696 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.917614    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:26.917597531 +0000 UTC m=+4.017179627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:25.917696 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:25.917631    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:26.917623336 +0000 UTC m=+4.017205421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:26.119524 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:26.119485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:26.119702 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.119657    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:26.119702 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.119680    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:26.119702 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.119691    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:26.119832 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.119758    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:27.119741929 +0000 UTC m=+4.219324030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:26.351797 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:26.351709    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:31:25 +0000 UTC" deadline="2028-03-12 10:31:49.192605713 +0000 UTC"
Sep 10 23:36:26.351797 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:26.351754    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13162h55m22.840856811s"
Sep 10 23:36:26.609159 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.609126    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf313ef3_846e_42ac_a5d3_fa795ec2f160.slice/crio-4013d32fe311329dae3e2ea13c1a7e6d492a2a73b007a5862108169e760475f6 WatchSource:0}: Error finding container 4013d32fe311329dae3e2ea13c1a7e6d492a2a73b007a5862108169e760475f6: Status 404 returned error can't find the container with id 4013d32fe311329dae3e2ea13c1a7e6d492a2a73b007a5862108169e760475f6
Sep 10 23:36:26.617060 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.616870    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37c471b_53ac_4eff_88ad_1a1b6863b3aa.slice/crio-c96111464ea487ae1d1349d57decc653b1938dc52e6459b46913303221964564 WatchSource:0}: Error finding container c96111464ea487ae1d1349d57decc653b1938dc52e6459b46913303221964564: Status 404 returned error can't find the container with id c96111464ea487ae1d1349d57decc653b1938dc52e6459b46913303221964564
Sep 10 23:36:26.618142 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.617979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac28577_b61f_4b9f_afb0_316141947106.slice/crio-8702fe89b07ea2c5478faf259f6f6d31efac3b9166381d5473b38f5bb8b26127 WatchSource:0}: Error finding container 8702fe89b07ea2c5478faf259f6f6d31efac3b9166381d5473b38f5bb8b26127: Status 404 returned error can't find the container with id 8702fe89b07ea2c5478faf259f6f6d31efac3b9166381d5473b38f5bb8b26127
Sep 10 23:36:26.618707 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.618686    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e899174_6f8e_44ac_8f2f_bf0029031b95.slice/crio-908322af314bda753c71006fbf1d6cab3789710ccc151d9c9fa58e2c9bd938ce WatchSource:0}: Error finding container 908322af314bda753c71006fbf1d6cab3789710ccc151d9c9fa58e2c9bd938ce: Status 404 returned error can't find the container with id 908322af314bda753c71006fbf1d6cab3789710ccc151d9c9fa58e2c9bd938ce
Sep 10 23:36:26.620482 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.620220    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5015ed2_cebb_4e80_ba94_61b9eec7ffe0.slice/crio-9a131e2b93f402ff2b41d1749304ebe545d657752bd8a4015265dd69863329f3 WatchSource:0}: Error finding container 9a131e2b93f402ff2b41d1749304ebe545d657752bd8a4015265dd69863329f3: Status 404 returned error can't find the container with id 9a131e2b93f402ff2b41d1749304ebe545d657752bd8a4015265dd69863329f3
Sep 10 23:36:26.622384 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:26.621583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f86f66_b73f_4efb_95e2_bebee778f6fc.slice/crio-da3ad79c46b6099a4714cab3650101d176d43f038a9e1d12c5990d723cc99d47 WatchSource:0}: Error finding container da3ad79c46b6099a4714cab3650101d176d43f038a9e1d12c5990d723cc99d47: Status 404 returned error can't find the container with id da3ad79c46b6099a4714cab3650101d176d43f038a9e1d12c5990d723cc99d47
Sep 10 23:36:26.926045 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:26.926020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:26.926154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:26.926062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:26.926192 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.926172    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:26.926227 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.926196    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:26.926264 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.926230    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:28.926213112 +0000 UTC m=+6.025795216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:26.926319 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:26.926266    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:28.926245608 +0000 UTC m=+6.025827712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:27.127500 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.127404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:27.127654 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.127576    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:27.127654 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.127600    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:27.127654 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.127615    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:27.127813 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.127678    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:29.127658182 +0000 UTC m=+6.227240282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:27.352192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.352128    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 23:31:25 +0000 UTC" deadline="2028-05-20 09:43:05.83750139 +0000 UTC"
Sep 10 23:36:27.352192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.352190    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14818h6m38.485316786s"
Sep 10 23:36:27.443608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.443522    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:27.443608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.443576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:27.443872 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.443685    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:27.444460 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.444133    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:27.444460 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.444254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:27.444460 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:27.444355    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:27.476081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.475992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p55tr" event={"ID":"673206a3-9cea-4d0a-9716-45fd2b3d5bcf","Type":"ContainerStarted","Data":"ed5bff2ff2d5c7f3ace352e97de0c5e2dfa64850989b1146784175e69349fc16"}
Sep 10 23:36:27.495632 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.495591    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5" event={"ID":"321ecfef-1611-45ce-8331-c0c50728b25c","Type":"ContainerStarted","Data":"a5d8eab72972d88be12b279e186c7e6855e2e26d0aa3788ea566890412ab8a1c"}
Sep 10 23:36:27.504221 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.503615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal" event={"ID":"3203e1487e60b01c3cea04380828f485","Type":"ContainerStarted","Data":"92ca755f1fccde7446a922747079c804b4707169e036af03bd199dd2ab876421"}
Sep 10 23:36:27.510497 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.510465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerStarted","Data":"9a131e2b93f402ff2b41d1749304ebe545d657752bd8a4015265dd69863329f3"}
Sep 10 23:36:27.515821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.515789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"da3ad79c46b6099a4714cab3650101d176d43f038a9e1d12c5990d723cc99d47"}
Sep 10 23:36:27.522000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.521959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdx5v" event={"ID":"3e899174-6f8e-44ac-8f2f-bf0029031b95","Type":"ContainerStarted","Data":"908322af314bda753c71006fbf1d6cab3789710ccc151d9c9fa58e2c9bd938ce"}
Sep 10 23:36:27.530829 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.530750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlnpc" event={"ID":"1ac28577-b61f-4b9f-afb0-316141947106","Type":"ContainerStarted","Data":"8702fe89b07ea2c5478faf259f6f6d31efac3b9166381d5473b38f5bb8b26127"}
Sep 10 23:36:27.539337 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.539306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbgn5" event={"ID":"af313ef3-846e-42ac-a5d3-fa795ec2f160","Type":"ContainerStarted","Data":"4013d32fe311329dae3e2ea13c1a7e6d492a2a73b007a5862108169e760475f6"}
Sep 10 23:36:27.547914 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.547886    2581 generic.go:356] "Generic (PLEG): container finished" podID="bbfe5b4b33fd51fcd208722247de0d3f" containerID="de4c1493a733642e76f43fa980f5fa278ec12048101f389e63a1f8d3274ce560" exitCode=0
Sep 10 23:36:27.548037 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.547970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal" event={"ID":"bbfe5b4b33fd51fcd208722247de0d3f","Type":"ContainerDied","Data":"de4c1493a733642e76f43fa980f5fa278ec12048101f389e63a1f8d3274ce560"}
Sep 10 23:36:27.558334 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.558292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kx7t" event={"ID":"c37c471b-53ac-4eff-88ad-1a1b6863b3aa","Type":"ContainerStarted","Data":"c96111464ea487ae1d1349d57decc653b1938dc52e6459b46913303221964564"}
Sep 10 23:36:27.563628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.563568    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-151.ec2.internal" podStartSLOduration=3.563547602 podStartE2EDuration="3.563547602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:27.519933877 +0000 UTC m=+4.619515985" watchObservedRunningTime="2026-09-10 23:36:27.563547602 +0000 UTC m=+4.663129711"
Sep 10 23:36:27.563819 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:27.563794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-852dd" event={"ID":"a58e43f0-f0ee-424c-a9d5-197585bab353","Type":"ContainerStarted","Data":"05eb8afe4f594f04aa377111ca0309f99eb408328bbab0d15718ef280b6bdfd1"}
Sep 10 23:36:28.590344 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:28.589891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal" event={"ID":"bbfe5b4b33fd51fcd208722247de0d3f","Type":"ContainerStarted","Data":"23728213a50418659b2b0e13cab8a04a6a8e939300f0ac0334686b730e0bd1ec"}
Sep 10 23:36:28.942715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:28.942627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:28.942715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:28.942695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:28.942937 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:28.942793    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:28.942937 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:28.942818    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:28.942937 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:28.942879    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:32.942859343 +0000 UTC m=+10.042441440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:28.942937 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:28.942899    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:32.942888432 +0000 UTC m=+10.042470521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:29.144178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:29.144138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:29.144369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.144339    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:29.144369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.144360    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:29.144489 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.144372    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:29.144489 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.144435    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:33.144414937 +0000 UTC m=+10.243997064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:29.444913 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:29.444875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:29.445081 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.445006    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:29.445405 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:29.445385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:29.445518 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.445487    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:29.445580 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:29.445558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:29.445674 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:29.445644    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:31.442681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:31.443051    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:31.442716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:31.442681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:31.443170    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:31.443325 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:31.443321    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:32.978000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:32.977963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:32.978509 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:32.978011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:32.978509 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:32.978110    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:32.978509 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:32.978154    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:40.978141078 +0000 UTC m=+18.077723158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:32.978509 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:32.978419    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:32.978509 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:32.978473    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:40.978460161 +0000 UTC m=+18.078042257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:33.179681 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:33.179643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:33.179862 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.179839    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:33.179862 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.179867    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:33.180011 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.179880    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:33.180011 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.179938    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:41.1799194 +0000 UTC m=+18.279501483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:33.443335 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:33.443235    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:33.443472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:33.443355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:33.443472 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.443373    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:33.443472 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.443462    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:33.443570 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:33.443497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:33.443570 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:33.443538    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:35.445022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:35.445149    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:35.445595    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:35.445697    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:35.445753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:35.445867 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:35.445818    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:37.442718 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:37.442685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:37.443163 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:37.442685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:37.443163 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:37.442788    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:37.443163 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:37.442696    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:37.443163 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:37.442866    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:37.443163 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:37.442927    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:39.442837 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:39.442791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:39.443363 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:39.442792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:39.443363 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:39.442927    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:39.443363 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:39.442797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:39.443363 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:39.443005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:39.443363 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:39.443095    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:41.041374 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.041340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:41.041880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.041401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:41.041880 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.041513    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:41.041880 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.041514    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:41.041880 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.041570    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:57.041556602 +0000 UTC m=+34.141138683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:41.041880 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.041585    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:57.041577999 +0000 UTC m=+34.141160080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:41.243114 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.243076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:41.243369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.243230    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:41.243369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.243246    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:41.243369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.243256    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:41.243369 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.243346    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:36:57.243331312 +0000 UTC m=+34.342913392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:41.445131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.445046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:41.445312 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.445189    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:41.445891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.445596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:41.445891 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.445698    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:41.445891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:41.445744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:41.445891 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:41.445826    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:43.442995 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:43.442955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:43.443480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:43.443044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:43.443480 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:43.443065    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:43.443480 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:43.443163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:43.443480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:43.443201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:43.443480 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:43.443264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:45.442444 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.442267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:45.443072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.442267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:45.443072 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:45.442545    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:45.443072 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:45.442645    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:45.443072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.442368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:45.443072 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:45.442810    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:45.626023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.625960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-852dd" event={"ID":"a58e43f0-f0ee-424c-a9d5-197585bab353","Type":"ContainerStarted","Data":"19e62401e1e866976dee43f4c289925a0c64b4f0e51ec2916917f7e81ef9c51d"}
Sep 10 23:36:45.627957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.627927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p55tr" event={"ID":"673206a3-9cea-4d0a-9716-45fd2b3d5bcf","Type":"ContainerStarted","Data":"a81a93b1b3cda803d4d0afd678772da300b2c91813744dfe59a1085ed04afacc"}
Sep 10 23:36:45.629920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.629892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5" event={"ID":"321ecfef-1611-45ce-8331-c0c50728b25c","Type":"ContainerStarted","Data":"814eb5807a8c3203437ec6649589261e63b524e0ddcaa1f1732e6e430ea71ac4"}
Sep 10 23:36:45.631577 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.631551    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="36bdbafa8940335de03232a249466f078d6aa77a05763e72111a19ab73ef8e5f" exitCode=0
Sep 10 23:36:45.631696 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.631636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"36bdbafa8940335de03232a249466f078d6aa77a05763e72111a19ab73ef8e5f"}
Sep 10 23:36:45.635347 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"2ba93aa887d96f332245f75e2f2ee9ff44307ef1d03f3853ba3461eaca7a41f9"}
Sep 10 23:36:45.635453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"76b600aaa9d85f53934306f7fbe32c154489b06903b755aff8ba5a011c68c811"}
Sep 10 23:36:45.635503 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"5377d3c3b1f6917527c21e87123a6741a12449d699ceafdb9012c39d1896abf3"}
Sep 10 23:36:45.635599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"6a09b3c5fbad3b031f68d6c125920e41df9b9fd71634ce1190d07938c271987a"}
Sep 10 23:36:45.635599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"81179444a0db0bc9284047ea57a56493c04a62253caa1b8057b18e6797e4f26b"}
Sep 10 23:36:45.635599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.635571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"8c21a77528375add45e80cbfc246a30969e6953d37942320581facae0db6e07f"}
Sep 10 23:36:45.637191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.637171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlnpc" event={"ID":"1ac28577-b61f-4b9f-afb0-316141947106","Type":"ContainerStarted","Data":"475cb7f946d190f37c02acda3dee9e119860658a3e960421ad910fcac784a983"}
Sep 10 23:36:45.638867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.638840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbgn5" event={"ID":"af313ef3-846e-42ac-a5d3-fa795ec2f160","Type":"ContainerStarted","Data":"7018b7c37d310e51de4712dc4beaed904a8870b48bfdec57ce2bbb254ae3d689"}
Sep 10 23:36:45.639328 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.639236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-151.ec2.internal" podStartSLOduration=21.639198892 podStartE2EDuration="21.639198892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:28.604771321 +0000 UTC m=+5.704353424" watchObservedRunningTime="2026-09-10 23:36:45.639198892 +0000 UTC m=+22.738780972"
Sep 10 23:36:45.640051 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.640020    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-852dd" podStartSLOduration=4.50100697 podStartE2EDuration="22.640007978s" totalImagesPullingTime="18.139001008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.639401328 +0000 UTC m=+22.738983408" watchObservedRunningTime="2026-09-10 23:36:45.640007978 +0000 UTC m=+22.739590079"
Sep 10 23:36:45.642490 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.642454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7kx7t" event={"ID":"c37c471b-53ac-4eff-88ad-1a1b6863b3aa","Type":"ContainerStarted","Data":"6055b256f2e729eada073fe41122c90a4541aa37d3eedae47d7d75b16b4a97de"}
Sep 10 23:36:45.654613 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.654568    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hlnpc" podStartSLOduration=4.462709673 podStartE2EDuration="22.654551374s" totalImagesPullingTime="18.191841701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.654098674 +0000 UTC m=+22.753680776" watchObservedRunningTime="2026-09-10 23:36:45.654551374 +0000 UTC m=+22.754133527"
Sep 10 23:36:45.685139 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.685093    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbgn5" podStartSLOduration=4.542293406 podStartE2EDuration="22.68507777s" totalImagesPullingTime="18.142784364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.684837611 +0000 UTC m=+22.784419712" watchObservedRunningTime="2026-09-10 23:36:45.68507777 +0000 UTC m=+22.784659872"
Sep 10 23:36:45.685499 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.685472    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p55tr" podStartSLOduration=4.5299326650000005 podStartE2EDuration="22.685462204s" totalImagesPullingTime="18.155529539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.672092716 +0000 UTC m=+22.771674817" watchObservedRunningTime="2026-09-10 23:36:45.685462204 +0000 UTC m=+22.785044306"
Sep 10 23:36:45.717228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:45.717179    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7kx7t" podStartSLOduration=11.746218125 podStartE2EDuration="22.717159973s" totalImagesPullingTime="10.970941848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:45.716635042 +0000 UTC m=+22.816217145" watchObservedRunningTime="2026-09-10 23:36:45.717159973 +0000 UTC m=+22.816742076"
Sep 10 23:36:46.239665 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.239399    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 23:36:46.367601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.367394    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T23:36:46.239665983Z","UUID":"5eb65443-8623-4695-a68d-a8652b44cf12","Handler":null,"Name":"","Endpoint":""}
Sep 10 23:36:46.371972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.371945    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 23:36:46.371972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.371981    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 23:36:46.647106 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.647025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdx5v" event={"ID":"3e899174-6f8e-44ac-8f2f-bf0029031b95","Type":"ContainerStarted","Data":"be94d60f3430de113bcc6cd5b718112cfe040ac3bfad3e2a1fd8910a8f4355dc"}
Sep 10 23:36:46.649531 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.649451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5" event={"ID":"321ecfef-1611-45ce-8331-c0c50728b25c","Type":"ContainerStarted","Data":"67e884077cedd43c22b2d9cfd5f1b81d426619e974eb743b40c310a6056881a3"}
Sep 10 23:36:46.660945 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:46.660901    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tdx5v" podStartSLOduration=5.528405538 podStartE2EDuration="23.660884218s" totalImagesPullingTime="18.13247868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:46.66061918 +0000 UTC m=+23.760201276" watchObservedRunningTime="2026-09-10 23:36:46.660884218 +0000 UTC m=+23.760466323"
Sep 10 23:36:47.442882 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:47.442853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:47.443033 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:47.442854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:47.443033 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:47.442988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:47.443033 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:47.442854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:47.443211 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:47.443067    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:47.443211 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:47.443117    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:47.653971 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:47.653933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5" event={"ID":"321ecfef-1611-45ce-8331-c0c50728b25c","Type":"ContainerStarted","Data":"a4c4458594b1e542014822157f053f2ef75a123e802e025327d9ff48a1f0f56a"}
Sep 10 23:36:47.670957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:47.670896    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-klrm5" podStartSLOduration=4.236209851 podStartE2EDuration="24.670877596s" totalImagesPullingTime="20.434667745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:47.670406794 +0000 UTC m=+24.769988896" watchObservedRunningTime="2026-09-10 23:36:47.670877596 +0000 UTC m=+24.770459697"
Sep 10 23:36:48.661034 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:48.660998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"4e77634a7cb8696c87e7b3345bc9ce0ac7d40b22c174c8d1e1e2126d7ad992c1"}
Sep 10 23:36:48.737303 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:48.737251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:48.737933 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:48.737899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:49.442618 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:49.442570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:49.442618 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:49.442596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:49.442886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:49.442590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:49.442886 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:49.442708    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:49.442886 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:49.442779    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:49.442886 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:49.442862    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:49.663701 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:49.663665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:49.664221 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:49.664204    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7kx7t"
Sep 10 23:36:50.668181 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:50.667952    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="ff3f80ff25e18510152ff23642177dec05184f7299f23d7ff2bed1fca0d568fd" exitCode=0
Sep 10 23:36:50.668623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:50.668040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"ff3f80ff25e18510152ff23642177dec05184f7299f23d7ff2bed1fca0d568fd"}
Sep 10 23:36:50.672368 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:50.672341    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" event={"ID":"55f86f66-b73f-4efb-95e2-bebee778f6fc","Type":"ContainerStarted","Data":"6cdd433b82d5a0f41076faaaf779b804d89fc073ac8572c5d84ace1beed1762c"}
Sep 10 23:36:50.717969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:50.717912    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9" podStartSLOduration=9.506973887000001 podStartE2EDuration="27.717895474s" totalImagesPullingTime="18.210921587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:50.717431623 +0000 UTC m=+27.817013724" watchObservedRunningTime="2026-09-10 23:36:50.717895474 +0000 UTC m=+27.817477576"
Sep 10 23:36:51.444299 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.444248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:51.444562 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:51.444407    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:51.445062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.444799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:51.445062 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:51.444906    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:51.445062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.444953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:51.445062 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:51.445014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:51.675628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.675593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:51.676164 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.675692    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:51.676164 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.675738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:51.691867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.691840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:51.692024 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:51.691988    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:36:52.360316 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.360221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g465n"]
Sep 10 23:36:52.360470 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.360385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:52.360546 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:52.360515    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:52.361053 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.361032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkcxq"]
Sep 10 23:36:52.361186 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.361151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:52.361256 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:52.361237    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:52.361693 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.361669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gdztg"]
Sep 10 23:36:52.361782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.361773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:52.361900 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:52.361878    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:52.679693 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.679604    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="71dcfa70bb63db8a59f42d19812bfa21fa82caa58aa8f51de00edec41317be7b" exitCode=0
Sep 10 23:36:52.680393 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:52.679693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"71dcfa70bb63db8a59f42d19812bfa21fa82caa58aa8f51de00edec41317be7b"}
Sep 10 23:36:54.442368 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:54.442175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:54.442691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:54.442255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:54.442691 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:54.442456    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:54.442691 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:54.442560    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:54.442691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:54.442269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:54.442962 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:54.442721    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:54.686963 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:54.686886    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="73e7093421f4b9c000e0430288d5c4bce57c0025a752a01109a4df6b59dd5292" exitCode=0
Sep 10 23:36:54.686963 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:54.686936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"73e7093421f4b9c000e0430288d5c4bce57c0025a752a01109a4df6b59dd5292"}
Sep 10 23:36:56.442644 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:56.442603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:56.443073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:56.442656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:56.443073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:56.442656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:56.443073 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:56.442742    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkcxq" podUID="71c594f4-181f-4820-a5ff-33386bb2abbc"
Sep 10 23:36:56.443073 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:56.442862    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g465n" podUID="27274aa2-1585-40d5-8ff8-450894cde5d2"
Sep 10 23:36:56.443073 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:56.442944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gdztg" podUID="03373111-12a7-456f-9f0a-a7fcaac828d7"
Sep 10 23:36:57.067298 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.067237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:57.067514 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.067332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:57.067514 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.067414    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:57.067514 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.067441    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:57.067514 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.067481    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret podName:03373111-12a7-456f-9f0a-a7fcaac828d7 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.067459771 +0000 UTC m=+66.167041855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret") pod "global-pull-secret-syncer-gdztg" (UID: "03373111-12a7-456f-9f0a-a7fcaac828d7") : object "kube-system"/"original-pull-secret" not registered
Sep 10 23:36:57.067514 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.067497    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs podName:27274aa2-1585-40d5-8ff8-450894cde5d2 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.0674899 +0000 UTC m=+66.167071980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs") pod "network-metrics-daemon-g465n" (UID: "27274aa2-1585-40d5-8ff8-450894cde5d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 23:36:57.268763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.268726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:57.268947 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.268885    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 23:36:57.268947 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.268903    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 23:36:57.268947 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.268912    2581 projected.go:196] Error preparing data for projected volume kube-api-access-hs25n for pod openshift-network-diagnostics/network-check-target-wkcxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:57.269091 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.268970    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n podName:71c594f4-181f-4820-a5ff-33386bb2abbc nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.268957247 +0000 UTC m=+66.368539346 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hs25n" (UniqueName: "kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n") pod "network-check-target-wkcxq" (UID: "71c594f4-181f-4820-a5ff-33386bb2abbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 23:36:57.700078 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.700047    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-151.ec2.internal" event="NodeReady"
Sep 10 23:36:57.700544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.700187    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 23:36:57.756281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.756230    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j8scc"]
Sep 10 23:36:57.762305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.762262    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.762539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.762511    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mcbx9"]
Sep 10 23:36:57.766379 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.766359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.766678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.766518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9kf9v\""
Sep 10 23:36:57.766678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.766668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 23:36:57.767174 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.767161    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 23:36:57.771745 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.771466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 23:36:57.771745 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.771537    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 23:36:57.771880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.771772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-njwmd\""
Sep 10 23:36:57.772393 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.772208    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 23:36:57.781053 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.781032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8scc"]
Sep 10 23:36:57.799655 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.799615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcbx9"]
Sep 10 23:36:57.873010 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.872982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45321afd-03f6-46f3-95b2-fa5f7eb26b79-config-volume\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.873160 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.873026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nkj\" (UniqueName: \"kubernetes.io/projected/f031016d-8254-488c-8211-fd3fa9bd76b2-kube-api-access-w2nkj\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.873214 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.873168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpn7h\" (UniqueName: \"kubernetes.io/projected/45321afd-03f6-46f3-95b2-fa5f7eb26b79-kube-api-access-rpn7h\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.873214 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.873207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.873315 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.873232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f031016d-8254-488c-8211-fd3fa9bd76b2-cert\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.873315 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.873279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45321afd-03f6-46f3-95b2-fa5f7eb26b79-tmp-dir\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.974384 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45321afd-03f6-46f3-95b2-fa5f7eb26b79-config-volume\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.974384 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nkj\" (UniqueName: \"kubernetes.io/projected/f031016d-8254-488c-8211-fd3fa9bd76b2-kube-api-access-w2nkj\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.974597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpn7h\" (UniqueName: \"kubernetes.io/projected/45321afd-03f6-46f3-95b2-fa5f7eb26b79-kube-api-access-rpn7h\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.974597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.974597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f031016d-8254-488c-8211-fd3fa9bd76b2-cert\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.974597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45321afd-03f6-46f3-95b2-fa5f7eb26b79-tmp-dir\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.974864 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.974831    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:36:57.974864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/45321afd-03f6-46f3-95b2-fa5f7eb26b79-config-volume\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.975076 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.974844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45321afd-03f6-46f3-95b2-fa5f7eb26b79-tmp-dir\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.975076 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:57.974901    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:58.474882866 +0000 UTC m=+35.574464961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:36:57.979397 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.979368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f031016d-8254-488c-8211-fd3fa9bd76b2-cert\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:57.983973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.983946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpn7h\" (UniqueName: \"kubernetes.io/projected/45321afd-03f6-46f3-95b2-fa5f7eb26b79-kube-api-access-rpn7h\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:57.985378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:57.985354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nkj\" (UniqueName: \"kubernetes.io/projected/f031016d-8254-488c-8211-fd3fa9bd76b2-kube-api-access-w2nkj\") pod \"ingress-canary-mcbx9\" (UID: \"f031016d-8254-488c-8211-fd3fa9bd76b2\") " pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:58.082519 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.082484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcbx9"
Sep 10 23:36:58.442668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.442397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:36:58.442668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.442526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:36:58.442668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.442523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:36:58.445877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.445743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t4h6l\""
Sep 10 23:36:58.445877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.445772    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 23:36:58.445877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.445747    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:36:58.445877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.445753    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:36:58.445877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.445803    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 23:36:58.446316 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.446280    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5xmh4\""
Sep 10 23:36:58.479459 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.479416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:58.479621 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:58.479581    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:36:58.479677 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:58.479664    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:36:59.479640458 +0000 UTC m=+36.579222569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:36:58.883855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:58.883698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcbx9"]
Sep 10 23:36:58.907146 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:36:58.907109    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf031016d_8254_488c_8211_fd3fa9bd76b2.slice/crio-164fcc04f7faa6a7a41244cfdcbe2a1609f2bd0dc46c0f9b04de260986c34c83 WatchSource:0}: Error finding container 164fcc04f7faa6a7a41244cfdcbe2a1609f2bd0dc46c0f9b04de260986c34c83: Status 404 returned error can't find the container with id 164fcc04f7faa6a7a41244cfdcbe2a1609f2bd0dc46c0f9b04de260986c34c83
Sep 10 23:36:59.486085 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:59.486047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:36:59.486258 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:59.486236    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:36:59.486356 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:36:59.486343    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:01.486319691 +0000 UTC m=+38.585901777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:36:59.702784 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:59.702746    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="fd262d1a2ee1f0c0c6ea19b9dbf52e4cc1e23a0bea34ce8964a2496ccfba37b9" exitCode=0
Sep 10 23:36:59.702952 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:59.702860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"fd262d1a2ee1f0c0c6ea19b9dbf52e4cc1e23a0bea34ce8964a2496ccfba37b9"}
Sep 10 23:36:59.704362 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:36:59.704332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcbx9" event={"ID":"f031016d-8254-488c-8211-fd3fa9bd76b2","Type":"ContainerStarted","Data":"164fcc04f7faa6a7a41244cfdcbe2a1609f2bd0dc46c0f9b04de260986c34c83"}
Sep 10 23:37:00.711578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:00.711537    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5015ed2-cebb-4e80-ba94-61b9eec7ffe0" containerID="5eca1f5dcfdbf6b2a8dcab2f2c7f197849b91799353a384eff7d90ea76481f1b" exitCode=0
Sep 10 23:37:00.712255 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:00.711584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerDied","Data":"5eca1f5dcfdbf6b2a8dcab2f2c7f197849b91799353a384eff7d90ea76481f1b"}
Sep 10 23:37:01.500066 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:01.500027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:01.500236 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:01.500194    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:01.500306 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:01.500259    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:05.500243778 +0000 UTC m=+42.599825857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:01.719533 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:01.719505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" event={"ID":"c5015ed2-cebb-4e80-ba94-61b9eec7ffe0","Type":"ContainerStarted","Data":"044f3de54b23542a24794838640f945ff432625d021e56b7e2ea3ff96a9fca52"}
Sep 10 23:37:01.742850 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:01.742796    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x5pkt" podStartSLOduration=9.69419484 podStartE2EDuration="38.742773517s" totalImagesPullingTime="29.048578677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:01.741181639 +0000 UTC m=+38.840763765" watchObservedRunningTime="2026-09-10 23:37:01.742773517 +0000 UTC m=+38.842355622"
Sep 10 23:37:02.723948 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:02.723764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcbx9" event={"ID":"f031016d-8254-488c-8211-fd3fa9bd76b2","Type":"ContainerStarted","Data":"0268daaaadaf22c76b1ec7853499b5b4c0332a6191fb3f68f4fff87dd701c1ff"}
Sep 10 23:37:02.738598 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:02.738548    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mcbx9" podStartSLOduration=2.981334829 podStartE2EDuration="5.738530948s" totalImagesPullingTime="2.757196119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:02.737268452 +0000 UTC m=+39.836850553" watchObservedRunningTime="2026-09-10 23:37:02.738530948 +0000 UTC m=+39.838113047"
Sep 10 23:37:03.197259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.197219    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"]
Sep 10 23:37:03.232954 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.232921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"]
Sep 10 23:37:03.233103 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.233044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"
Sep 10 23:37:03.235476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.235456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 23:37:03.235590 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.235456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:37:03.236093 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.236078    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jpkbv\""
Sep 10 23:37:03.246586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.246566    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"]
Sep 10 23:37:03.246689 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.246674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"
Sep 10 23:37:03.249040 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.249023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d8cmf\""
Sep 10 23:37:03.266729 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.266708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"]
Sep 10 23:37:03.266822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.266739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"]
Sep 10 23:37:03.266822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.266754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"]
Sep 10 23:37:03.266822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.266810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.269070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.269050    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 23:37:03.269070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.269061    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 23:37:03.269070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.269057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 23:37:03.269263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.269066    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:37:03.269381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.269368    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4g5ft\""
Sep 10 23:37:03.299780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.299753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:03.322794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.322768    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:03.322933 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.322862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.325146 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.325127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 23:37:03.325307 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.325188    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 23:37:03.325307 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.325126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 23:37:03.325307 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.325135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhrn5\""
Sep 10 23:37:03.329710 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.329683    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 23:37:03.397501 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.397466    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"]
Sep 10 23:37:03.414204 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbzj\" (UniqueName: \"kubernetes.io/projected/7c995bce-eae7-4ec9-b492-4cffcf2fb493-kube-api-access-fnbzj\") pod \"network-check-source-6f8b768455-gxgl2\" (UID: \"7c995bce-eae7-4ec9-b492-4cffcf2fb493\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"
Sep 10 23:37:03.414373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1811caf3-5ec5-4618-b17f-8296b488f231-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.414373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97fk\" (UniqueName: \"kubernetes.io/projected/aa91771d-a2a4-4be5-85df-717dcdff4929-kube-api-access-x97fk\") pod \"volume-data-source-validator-86695b7cc7-q497z\" (UID: \"aa91771d-a2a4-4be5-85df-717dcdff4929\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"
Sep 10 23:37:03.414553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kskpk\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6klp\" (UniqueName: \"kubernetes.io/projected/1811caf3-5ec5-4618-b17f-8296b488f231-kube-api-access-h6klp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.414743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.414743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.414700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1811caf3-5ec5-4618-b17f-8296b488f231-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.418790 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.418767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-g2hbd"]
Sep 10 23:37:03.418960 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.418944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.421688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.421458    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9qq72\""
Sep 10 23:37:03.421688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.421490    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 23:37:03.421688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.421462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 23:37:03.438919 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.438895    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"]
Sep 10 23:37:03.439023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.439003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.442254 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.442232    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 23:37:03.442457 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.442440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 23:37:03.442504 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.442456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 23:37:03.442504 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.442440    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-csshw\""
Sep 10 23:37:03.442904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.442887    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 23:37:03.447945 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.447895    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 23:37:03.457956 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.457936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.459927 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.459911    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 23:37:03.460068 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.460050    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 23:37:03.460352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.460337    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rvrst\""
Sep 10 23:37:03.461182 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.461167    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 23:37:03.461269 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.461174    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 23:37:03.461482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.461465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"]
Sep 10 23:37:03.461578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.461510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-g2hbd"]
Sep 10 23:37:03.461578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.461533    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"]
Sep 10 23:37:03.515500 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.515500 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.515737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.515737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6klp\" (UniqueName: \"kubernetes.io/projected/1811caf3-5ec5-4618-b17f-8296b488f231-kube-api-access-h6klp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.515737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.515737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1811caf3-5ec5-4618-b17f-8296b488f231-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.515737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbzj\" (UniqueName: \"kubernetes.io/projected/7c995bce-eae7-4ec9-b492-4cffcf2fb493-kube-api-access-fnbzj\") pod \"network-check-source-6f8b768455-gxgl2\" (UID: \"7c995bce-eae7-4ec9-b492-4cffcf2fb493\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f59fd2f6-afa2-4527-b311-db2040bd5f84-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1811caf3-5ec5-4618-b17f-8296b488f231-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.515989    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.516004    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7858574b7-9t9fk: secret "image-registry-tls" not found
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.516054    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls podName:cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d nodeName:}" failed. No retries permitted until 2026-09-10 23:37:04.016036881 +0000 UTC m=+41.115618976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls") pod "image-registry-7858574b7-9t9fk" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d") : secret "image-registry-tls" not found
Sep 10 23:37:03.516265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.515988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97fk\" (UniqueName: \"kubernetes.io/projected/aa91771d-a2a4-4be5-85df-717dcdff4929-kube-api-access-x97fk\") pod \"volume-data-source-validator-86695b7cc7-q497z\" (UID: \"aa91771d-a2a4-4be5-85df-717dcdff4929\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"
Sep 10 23:37:03.516791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.516317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.516349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1811caf3-5ec5-4618-b17f-8296b488f231-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.516791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.516245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kskpk\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.516791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.516555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.519478 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.519451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1811caf3-5ec5-4618-b17f-8296b488f231-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.519565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.519496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.519565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.519552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.529029 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.529002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6klp\" (UniqueName: \"kubernetes.io/projected/1811caf3-5ec5-4618-b17f-8296b488f231-kube-api-access-h6klp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-7sfhn\" (UID: \"1811caf3-5ec5-4618-b17f-8296b488f231\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.529442 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.529420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.529442 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.529433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbzj\" (UniqueName: \"kubernetes.io/projected/7c995bce-eae7-4ec9-b492-4cffcf2fb493-kube-api-access-fnbzj\") pod \"network-check-source-6f8b768455-gxgl2\" (UID: \"7c995bce-eae7-4ec9-b492-4cffcf2fb493\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"
Sep 10 23:37:03.529855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.529840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kskpk\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:03.532898 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.532875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97fk\" (UniqueName: \"kubernetes.io/projected/aa91771d-a2a4-4be5-85df-717dcdff4929-kube-api-access-x97fk\") pod \"volume-data-source-validator-86695b7cc7-q497z\" (UID: \"aa91771d-a2a4-4be5-85df-717dcdff4929\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"
Sep 10 23:37:03.541826 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.541809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"
Sep 10 23:37:03.555047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.555029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"
Sep 10 23:37:03.575143 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.575128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38313397-1470-43c1-a36c-58b21ac2d189-serving-cert\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f59fd2f6-afa2-4527-b311-db2040bd5f84-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-tmp\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-snapshots\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-service-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5j5z\" (UniqueName: \"kubernetes.io/projected/38313397-1470-43c1-a36c-58b21ac2d189-kube-api-access-s5j5z\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwsqq\" (UniqueName: \"kubernetes.io/projected/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-kube-api-access-gwsqq\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.617979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.617451    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.618140    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:04.118119796 +0000 UTC m=+41.217701876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:03.619842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.619277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f59fd2f6-afa2-4527-b311-db2040bd5f84-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:03.718880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.718797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.718880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.718832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-tmp\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.718880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.718848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-snapshots\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.719072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.718968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-service-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.719597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5j5z\" (UniqueName: \"kubernetes.io/projected/38313397-1470-43c1-a36c-58b21ac2d189-kube-api-access-s5j5z\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.719597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-tmp\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.719741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwsqq\" (UniqueName: \"kubernetes.io/projected/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-kube-api-access-gwsqq\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.719741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.719934 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38313397-1470-43c1-a36c-58b21ac2d189-snapshots\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.719998 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.719946    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:03.720050 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.719990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-service-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.720217 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:03.720200    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:04.220176832 +0000 UTC m=+41.319758919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:03.720496 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.720252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38313397-1470-43c1-a36c-58b21ac2d189-serving-cert\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.720496 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.720367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.720630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.720438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38313397-1470-43c1-a36c-58b21ac2d189-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.723370 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.723346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.724982 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.724959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38313397-1470-43c1-a36c-58b21ac2d189-serving-cert\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.730595 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.730574    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwsqq\" (UniqueName: \"kubernetes.io/projected/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-kube-api-access-gwsqq\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:03.730679 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.730626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5j5z\" (UniqueName: \"kubernetes.io/projected/38313397-1470-43c1-a36c-58b21ac2d189-kube-api-access-s5j5z\") pod \"insights-operator-5844b856db-g2hbd\" (UID: \"38313397-1470-43c1-a36c-58b21ac2d189\") " pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.748950 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.748934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-g2hbd"
Sep 10 23:37:03.861072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.861050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z"]
Sep 10 23:37:03.863198 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:03.863153    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa91771d_a2a4_4be5_85df_717dcdff4929.slice/crio-cb7d4eaa50e0eb6251805755764c4ca37ff6bf5c88905a75ec8f390a051aef7b WatchSource:0}: Error finding container cb7d4eaa50e0eb6251805755764c4ca37ff6bf5c88905a75ec8f390a051aef7b: Status 404 returned error can't find the container with id cb7d4eaa50e0eb6251805755764c4ca37ff6bf5c88905a75ec8f390a051aef7b
Sep 10 23:37:03.885003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.884977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2"]
Sep 10 23:37:03.887823 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:03.887790    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c995bce_eae7_4ec9_b492_4cffcf2fb493.slice/crio-84d4683a85d15b47ddce0a632253cd3d90df2c47d23a3f92ae5f7339e5532f8c WatchSource:0}: Error finding container 84d4683a85d15b47ddce0a632253cd3d90df2c47d23a3f92ae5f7339e5532f8c: Status 404 returned error can't find the container with id 84d4683a85d15b47ddce0a632253cd3d90df2c47d23a3f92ae5f7339e5532f8c
Sep 10 23:37:03.900318 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:03.900253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn"]
Sep 10 23:37:03.903937 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:03.903912    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1811caf3_5ec5_4618_b17f_8296b488f231.slice/crio-550d39840dedae992a9bfb0eaffe3dd3654656f51826f5785926dd51e2c62eec WatchSource:0}: Error finding container 550d39840dedae992a9bfb0eaffe3dd3654656f51826f5785926dd51e2c62eec: Status 404 returned error can't find the container with id 550d39840dedae992a9bfb0eaffe3dd3654656f51826f5785926dd51e2c62eec
Sep 10 23:37:04.023063 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.022969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:04.023222 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.023118    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:04.023222 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.023138    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7858574b7-9t9fk: secret "image-registry-tls" not found
Sep 10 23:37:04.023222 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.023213    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls podName:cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d nodeName:}" failed. No retries permitted until 2026-09-10 23:37:05.023197559 +0000 UTC m=+42.122779653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls") pod "image-registry-7858574b7-9t9fk" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d") : secret "image-registry-tls" not found
Sep 10 23:37:04.046403 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.046377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-g2hbd"]
Sep 10 23:37:04.062789 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:04.062760    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38313397_1470_43c1_a36c_58b21ac2d189.slice/crio-1d5d0a4bccb164d384dca8c22f86819b929ca2ab63df9ec60f2766336eb65355 WatchSource:0}: Error finding container 1d5d0a4bccb164d384dca8c22f86819b929ca2ab63df9ec60f2766336eb65355: Status 404 returned error can't find the container with id 1d5d0a4bccb164d384dca8c22f86819b929ca2ab63df9ec60f2766336eb65355
Sep 10 23:37:04.124159 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.124111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:04.124381 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.124260    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:04.124381 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.124349    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:05.124332249 +0000 UTC m=+42.223914342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:04.224589 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.224555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:04.224755 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.224702    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:04.224801 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:04.224766    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:05.2247507 +0000 UTC m=+42.324332798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:04.732963 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.732923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2" event={"ID":"7c995bce-eae7-4ec9-b492-4cffcf2fb493","Type":"ContainerStarted","Data":"84d4683a85d15b47ddce0a632253cd3d90df2c47d23a3f92ae5f7339e5532f8c"}
Sep 10 23:37:04.734786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.734754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn" event={"ID":"1811caf3-5ec5-4618-b17f-8296b488f231","Type":"ContainerStarted","Data":"550d39840dedae992a9bfb0eaffe3dd3654656f51826f5785926dd51e2c62eec"}
Sep 10 23:37:04.736716 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.736681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g2hbd" event={"ID":"38313397-1470-43c1-a36c-58b21ac2d189","Type":"ContainerStarted","Data":"1d5d0a4bccb164d384dca8c22f86819b929ca2ab63df9ec60f2766336eb65355"}
Sep 10 23:37:04.738495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:04.738467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z" event={"ID":"aa91771d-a2a4-4be5-85df-717dcdff4929","Type":"ContainerStarted","Data":"cb7d4eaa50e0eb6251805755764c4ca37ff6bf5c88905a75ec8f390a051aef7b"}
Sep 10 23:37:05.034359 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:05.034261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:05.034557 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.034418    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:05.034641 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.034561    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7858574b7-9t9fk: secret "image-registry-tls" not found
Sep 10 23:37:05.034641 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.034626    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls podName:cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d nodeName:}" failed. No retries permitted until 2026-09-10 23:37:07.034607179 +0000 UTC m=+44.134189279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls") pod "image-registry-7858574b7-9t9fk" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d") : secret "image-registry-tls" not found
Sep 10 23:37:05.136175 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:05.136134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:05.136434 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.136415    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:05.136533 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.136521    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:07.13649972 +0000 UTC m=+44.236081817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:05.237624 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:05.237577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:05.237774 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.237750    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:05.237846 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.237830    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:07.237808585 +0000 UTC m=+44.337390686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:05.539956 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:05.539919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:05.540166 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.540148    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:05.540237 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:05.540218    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:13.540198483 +0000 UTC m=+50.639780581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:07.052500 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:07.052462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:07.052966 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.052608    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:07.052966 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.052626    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7858574b7-9t9fk: secret "image-registry-tls" not found
Sep 10 23:37:07.052966 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.052699    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls podName:cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d nodeName:}" failed. No retries permitted until 2026-09-10 23:37:11.052678926 +0000 UTC m=+48.152261029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls") pod "image-registry-7858574b7-9t9fk" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d") : secret "image-registry-tls" not found
Sep 10 23:37:07.153043 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:07.153007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:07.153241 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.153167    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:07.153241 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.153240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:11.15321822 +0000 UTC m=+48.252800320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:07.254544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:07.254500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:07.254747 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.254679    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:07.254816 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:07.254765    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:11.254739286 +0000 UTC m=+48.354321384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:08.753042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:08.753003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z" event={"ID":"aa91771d-a2a4-4be5-85df-717dcdff4929","Type":"ContainerStarted","Data":"dcd440819c96564aeb88cdc4a77e171b67b3174b6a7fb4f2e2a16fecad27ada4"}
Sep 10 23:37:08.754653 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:08.754626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn" event={"ID":"1811caf3-5ec5-4618-b17f-8296b488f231","Type":"ContainerStarted","Data":"1a86ca546a81545112d8a1405a7734577930b1ba4c63da6f8e2cf5f82265534e"}
Sep 10 23:37:08.756436 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:08.756408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g2hbd" event={"ID":"38313397-1470-43c1-a36c-58b21ac2d189","Type":"ContainerStarted","Data":"59e327adac6d963b576b7c1913cd66f58dd97a03c6ae41bf63b8401f4a084374"}
Sep 10 23:37:08.769808 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:08.769743    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q497z" podStartSLOduration=1.061927669 podStartE2EDuration="5.769720867s" totalImagesPullingTime="4.707793198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:08.767708124 +0000 UTC m=+45.867290227" watchObservedRunningTime="2026-09-10 23:37:08.769720867 +0000 UTC m=+45.869302970"
Sep 10 23:37:08.786382 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:08.786268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-g2hbd" podStartSLOduration=1.2766398780000001 podStartE2EDuration="5.786222094s" totalImagesPullingTime="4.509582216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:08.785103251 +0000 UTC m=+45.884685354" watchObservedRunningTime="2026-09-10 23:37:08.786222094 +0000 UTC m=+45.885804197"
Sep 10 23:37:09.760879 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:09.760816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2" event={"ID":"7c995bce-eae7-4ec9-b492-4cffcf2fb493","Type":"ContainerStarted","Data":"3645d159c0e32ce13cd45f62515f6a9195a748d619d05d472bb735b4c4c68867"}
Sep 10 23:37:09.774659 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:09.774604    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-gxgl2" podStartSLOduration=2.080710916 podStartE2EDuration="6.774587224s" totalImagesPullingTime="4.693876308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:09.774050626 +0000 UTC m=+46.873632746" watchObservedRunningTime="2026-09-10 23:37:09.774587224 +0000 UTC m=+46.874169326"
Sep 10 23:37:09.792012 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:09.791961    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn" podStartSLOduration=2.123579 podStartE2EDuration="6.791944257s" totalImagesPullingTime="4.668365257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:09.790853648 +0000 UTC m=+46.890435751" watchObservedRunningTime="2026-09-10 23:37:09.791944257 +0000 UTC m=+46.891526358"
Sep 10 23:37:10.870266 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.870229    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lz4wj"]
Sep 10 23:37:10.894185 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.894155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lz4wj"]
Sep 10 23:37:10.894355 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.894261    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:10.896514 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.896492    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 23:37:10.896634 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.896533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 23:37:10.897153 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.897128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-424q2\""
Sep 10 23:37:10.985157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.985120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-crio-socket\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:10.985157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.985157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-data-volume\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:10.985390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.985238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdhf5\" (UniqueName: \"kubernetes.io/projected/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-api-access-jdhf5\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:10.985390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.985331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:10.985390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:10.985359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085678 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdhf5\" (UniqueName: \"kubernetes.io/projected/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-api-access-jdhf5\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-crio-socket\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-data-volume\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085805    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 23:37:11.085852 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085827    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7858574b7-9t9fk: secret "image-registry-tls" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085858    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls podName:cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d nodeName:}" failed. No retries permitted until 2026-09-10 23:37:19.085865974 +0000 UTC m=+56.185448067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls") pod "image-registry-7858574b7-9t9fk" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d") : secret "image-registry-tls" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085907    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085919    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:11.585902641 +0000 UTC m=+48.685484735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.085966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-crio-socket\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.085969    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:11.585951787 +0000 UTC m=+48.685533871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:11.086187 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.086176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-data-volume\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.094341 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.094321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdhf5\" (UniqueName: \"kubernetes.io/projected/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-api-access-jdhf5\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.186209 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.186175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:11.186388 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.186339    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:11.186430 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.186423    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:19.186406187 +0000 UTC m=+56.285988284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:11.287011 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.286973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:11.287180 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.287118    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:11.287233 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.287182    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:19.287168024 +0000 UTC m=+56.386750103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:11.589937 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.589843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.589937 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:11.589890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:11.590177 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.589982    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:11.590177 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.590001    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:11.590177 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.590048    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:12.590028783 +0000 UTC m=+49.689610863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:11.590177 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:11.590068    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:12.590055346 +0000 UTC m=+49.689637430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:12.598349 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:12.598313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:12.598349 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:12.598355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:12.598812 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:12.598469    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:12.598812 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:12.598478    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:12.598812 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:12.598521    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:14.598508288 +0000 UTC m=+51.698090368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:12.598812 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:12.598546    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:14.59852836 +0000 UTC m=+51.698110462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:13.607424 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:13.607390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:13.607873 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:13.607544    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 23:37:13.607873 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:13.607611    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls podName:45321afd-03f6-46f3-95b2-fa5f7eb26b79 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:29.607594854 +0000 UTC m=+66.707176972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls") pod "dns-default-j8scc" (UID: "45321afd-03f6-46f3-95b2-fa5f7eb26b79") : secret "dns-default-metrics-tls" not found
Sep 10 23:37:13.622825 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:13.622798    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbgn5_af313ef3-846e-42ac-a5d3-fa795ec2f160/dns-node-resolver/0.log"
Sep 10 23:37:14.420842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:14.420815    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-852dd_a58e43f0-f0ee-424c-a9d5-197585bab353/node-ca/0.log"
Sep 10 23:37:14.616157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:14.616127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:14.616595 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:14.616166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:14.616595 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:14.616264    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:14.616595 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:14.616276    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:14.616595 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:14.616351    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:18.61633565 +0000 UTC m=+55.715917746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:14.616595 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:14.616404    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:18.616392489 +0000 UTC m=+55.715974583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:15.221162 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:15.221135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcbx9_f031016d-8254-488c-8211-fd3fa9bd76b2/serve-healthcheck-canary/0.log"
Sep 10 23:37:16.225255 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:16.225229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7sfhn_1811caf3-5ec5-4618-b17f-8296b488f231/kube-storage-version-migrator-operator/0.log"
Sep 10 23:37:18.651590 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:18.651546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:18.651977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:18.651600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:18.651977 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:18.651704    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:18.651977 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:18.651741    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 23:37:18.651977 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:18.651775    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:26.651759113 +0000 UTC m=+63.751341194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : secret "insights-runtime-extractor-tls" not found
Sep 10 23:37:18.651977 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:18.651796    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm podName:e2d3c9fc-4dfc-4004-875b-db4ef15d936f nodeName:}" failed. No retries permitted until 2026-09-10 23:37:26.651783358 +0000 UTC m=+63.751365438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lz4wj" (UID: "e2d3c9fc-4dfc-4004-875b-db4ef15d936f") : configmap "kube-rbac-proxy" not found
Sep 10 23:37:19.155572 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.155534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:19.158084 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.158051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"image-registry-7858574b7-9t9fk\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") " pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:19.231749 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.231712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:19.256836 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.256805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:19.256975 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:19.256959    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 23:37:19.257036 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:19.257031    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert podName:f59fd2f6-afa2-4527-b311-db2040bd5f84 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.257014141 +0000 UTC m=+72.356596221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-w2sf2" (UID: "f59fd2f6-afa2-4527-b311-db2040bd5f84") : secret "networking-console-plugin-cert" not found
Sep 10 23:37:19.358166 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.358124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:19.358359 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:19.358276    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:19.358406 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:19.358373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls podName:57dd2cd8-e733-4dbe-9fe3-299ad5317bf9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:35.358355774 +0000 UTC m=+72.457937853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-srx7w" (UID: "57dd2cd8-e733-4dbe-9fe3-299ad5317bf9") : secret "cluster-monitoring-operator-tls" not found
Sep 10 23:37:19.503168 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.503135    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:19.506592 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:19.506567    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfcb7a05_e3c5_4d1e_9188_ae4bd6526d9d.slice/crio-acfbf74cc402eb64c6895267857534e6a586871bf0874972c17fb472194f808e WatchSource:0}: Error finding container acfbf74cc402eb64c6895267857534e6a586871bf0874972c17fb472194f808e: Status 404 returned error can't find the container with id acfbf74cc402eb64c6895267857534e6a586871bf0874972c17fb472194f808e
Sep 10 23:37:19.790994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.790908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" event={"ID":"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d","Type":"ContainerStarted","Data":"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"}
Sep 10 23:37:19.790994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.790956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" event={"ID":"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d","Type":"ContainerStarted","Data":"acfbf74cc402eb64c6895267857534e6a586871bf0874972c17fb472194f808e"}
Sep 10 23:37:19.791485 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.791055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:19.811556 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:19.811511    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" podStartSLOduration=16.811495196 podStartE2EDuration="16.811495196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:19.810558686 +0000 UTC m=+56.910140824" watchObservedRunningTime="2026-09-10 23:37:19.811495196 +0000 UTC m=+56.911077289"
Sep 10 23:37:23.698571 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:23.698539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhnp9"
Sep 10 23:37:26.720959 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.720907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:26.720959 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.720968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:26.721557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.721540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:26.723511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.723489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e2d3c9fc-4dfc-4004-875b-db4ef15d936f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lz4wj\" (UID: \"e2d3c9fc-4dfc-4004-875b-db4ef15d936f\") " pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:26.806040 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.806006    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-424q2\""
Sep 10 23:37:26.814386 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:26.814360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lz4wj"
Sep 10 23:37:27.086162 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:27.086083    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lz4wj"]
Sep 10 23:37:27.088963 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:27.088931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d3c9fc_4dfc_4004_875b_db4ef15d936f.slice/crio-c31569892fee5a62d5835c5ee1c5894e0167adb9b4fe237d0a2347d077499d94 WatchSource:0}: Error finding container c31569892fee5a62d5835c5ee1c5894e0167adb9b4fe237d0a2347d077499d94: Status 404 returned error can't find the container with id c31569892fee5a62d5835c5ee1c5894e0167adb9b4fe237d0a2347d077499d94
Sep 10 23:37:27.825498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:27.825468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lz4wj" event={"ID":"e2d3c9fc-4dfc-4004-875b-db4ef15d936f","Type":"ContainerStarted","Data":"6c1a3177134c6a19bc4f766d7088c0c1a6957ee8132dddb35f1c1c9cf8c01196"}
Sep 10 23:37:27.825845 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:27.825543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lz4wj" event={"ID":"e2d3c9fc-4dfc-4004-875b-db4ef15d936f","Type":"ContainerStarted","Data":"c31569892fee5a62d5835c5ee1c5894e0167adb9b4fe237d0a2347d077499d94"}
Sep 10 23:37:28.830337 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:28.830282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lz4wj" event={"ID":"e2d3c9fc-4dfc-4004-875b-db4ef15d936f","Type":"ContainerStarted","Data":"9409acbe3682dc4c8046f6ed6266370fc65c20708b5f0860fad57cfc1005d638"}
Sep 10 23:37:29.141689 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.141598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:37:29.141853 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.141689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:37:29.144110 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.144084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 23:37:29.144240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.144182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 23:37:29.154474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.154446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03373111-12a7-456f-9f0a-a7fcaac828d7-original-pull-secret\") pod \"global-pull-secret-syncer-gdztg\" (UID: \"03373111-12a7-456f-9f0a-a7fcaac828d7\") " pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:37:29.154773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.154753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27274aa2-1585-40d5-8ff8-450894cde5d2-metrics-certs\") pod \"network-metrics-daemon-g465n\" (UID: \"27274aa2-1585-40d5-8ff8-450894cde5d2\") " pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:37:29.240025 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.239997    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:29.262966 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.262936    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"]
Sep 10 23:37:29.265954 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.265939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.269641 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.269421    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 23:37:29.269782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.269763    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 23:37:29.269858 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.269842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 23:37:29.269993 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.269974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 23:37:29.277986 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.277966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"]
Sep 10 23:37:29.343925 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.343900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:37:29.344042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.343940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09045235-f6a9-4cd6-aef1-071abe9f2e5d-tmp\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.344042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.343968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09045235-f6a9-4cd6-aef1-071abe9f2e5d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.344042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.344020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ctd\" (UniqueName: \"kubernetes.io/projected/09045235-f6a9-4cd6-aef1-071abe9f2e5d-kube-api-access-z5ctd\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.346456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.346432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs25n\" (UniqueName: \"kubernetes.io/projected/71c594f4-181f-4820-a5ff-33386bb2abbc-kube-api-access-hs25n\") pod \"network-check-target-wkcxq\" (UID: \"71c594f4-181f-4820-a5ff-33386bb2abbc\") " pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:37:29.356463 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.356435    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t4h6l\""
Sep 10 23:37:29.363882 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.363860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:37:29.364856 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.364839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5xmh4\""
Sep 10 23:37:29.365907 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.365892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gdztg"
Sep 10 23:37:29.368638 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.368615    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c59dfcd75-jxl6v"]
Sep 10 23:37:29.371641 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.371624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g465n"
Sep 10 23:37:29.395111 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.395086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c59dfcd75-jxl6v"]
Sep 10 23:37:29.395231 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.395190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09045235-f6a9-4cd6-aef1-071abe9f2e5d-tmp\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.445424 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09045235-f6a9-4cd6-aef1-071abe9f2e5d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.445424 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ctd\" (UniqueName: \"kubernetes.io/projected/09045235-f6a9-4cd6-aef1-071abe9f2e5d-kube-api-access-z5ctd\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.445492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-bound-sa-token\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8547a827-386c-4da9-9a14-72e1ff25cfad-ca-trust-extracted\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-certificates\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjv9\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-kube-api-access-vmjv9\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-tls\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09045235-f6a9-4cd6-aef1-071abe9f2e5d-tmp\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.445786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-image-registry-private-configuration\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.446112 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-installation-pull-secrets\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.446112 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.445840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-trusted-ca\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.449097 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.449069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09045235-f6a9-4cd6-aef1-071abe9f2e5d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.455576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.455534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ctd\" (UniqueName: \"kubernetes.io/projected/09045235-f6a9-4cd6-aef1-071abe9f2e5d-kube-api-access-z5ctd\") pod \"klusterlet-addon-workmgr-7777747897-mqw27\" (UID: \"09045235-f6a9-4cd6-aef1-071abe9f2e5d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.546961 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.546932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-image-registry-private-configuration\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.546961 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.546965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-installation-pull-secrets\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.546985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-trusted-ca\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-bound-sa-token\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8547a827-386c-4da9-9a14-72e1ff25cfad-ca-trust-extracted\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-certificates\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjv9\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-kube-api-access-vmjv9\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547562 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-tls\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.547983 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.547719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8547a827-386c-4da9-9a14-72e1ff25cfad-ca-trust-extracted\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.548357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.548331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-certificates\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.548677 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.548653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8547a827-386c-4da9-9a14-72e1ff25cfad-trusted-ca\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.549640 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.549619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-image-registry-private-configuration\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.549823 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.549801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8547a827-386c-4da9-9a14-72e1ff25cfad-installation-pull-secrets\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.549899 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.549884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-registry-tls\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.554769 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.554748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-bound-sa-token\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.555102 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.555082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjv9\" (UniqueName: \"kubernetes.io/projected/8547a827-386c-4da9-9a14-72e1ff25cfad-kube-api-access-vmjv9\") pod \"image-registry-c59dfcd75-jxl6v\" (UID: \"8547a827-386c-4da9-9a14-72e1ff25cfad\") " pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.593416 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.593381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:29.648376 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.648314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:29.650673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.650647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/45321afd-03f6-46f3-95b2-fa5f7eb26b79-metrics-tls\") pod \"dns-default-j8scc\" (UID: \"45321afd-03f6-46f3-95b2-fa5f7eb26b79\") " pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:29.653608 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.653588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkcxq"]
Sep 10 23:37:29.655621 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:29.655600    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c594f4_181f_4820_a5ff_33386bb2abbc.slice/crio-7b10c1e9d7703fc78dce48950e17d27b72f73fcc01f53c80d0b8db3b2e47326a WatchSource:0}: Error finding container 7b10c1e9d7703fc78dce48950e17d27b72f73fcc01f53c80d0b8db3b2e47326a: Status 404 returned error can't find the container with id 7b10c1e9d7703fc78dce48950e17d27b72f73fcc01f53c80d0b8db3b2e47326a
Sep 10 23:37:29.683239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.683154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gdztg"]
Sep 10 23:37:29.708511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.707885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:29.727086 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.727060    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g465n"]
Sep 10 23:37:29.731344 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:29.731312    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27274aa2_1585_40d5_8ff8_450894cde5d2.slice/crio-e04ca9cebfa04323075518de5968a34ad3ec83b954b51b88c29cbc7a0ea59fa4 WatchSource:0}: Error finding container e04ca9cebfa04323075518de5968a34ad3ec83b954b51b88c29cbc7a0ea59fa4: Status 404 returned error can't find the container with id e04ca9cebfa04323075518de5968a34ad3ec83b954b51b88c29cbc7a0ea59fa4
Sep 10 23:37:29.834609 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.834572    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gdztg" event={"ID":"03373111-12a7-456f-9f0a-a7fcaac828d7","Type":"ContainerStarted","Data":"b8b2a3e3565d1ab2be66d6da0a2984ffe541a3bfb84a672beb479097fbdaba75"}
Sep 10 23:37:29.836787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.836755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lz4wj" event={"ID":"e2d3c9fc-4dfc-4004-875b-db4ef15d936f","Type":"ContainerStarted","Data":"6eae630abbd03951882aeed5e52d65908f6d635e3badabae9c44506155c7ce6b"}
Sep 10 23:37:29.838034 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.838006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g465n" event={"ID":"27274aa2-1585-40d5-8ff8-450894cde5d2","Type":"ContainerStarted","Data":"e04ca9cebfa04323075518de5968a34ad3ec83b954b51b88c29cbc7a0ea59fa4"}
Sep 10 23:37:29.839411 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.839389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkcxq" event={"ID":"71c594f4-181f-4820-a5ff-33386bb2abbc","Type":"ContainerStarted","Data":"bf3434eeca36edad6eac147b4a65c2a574a8bc5fb7ea55ca2ef911fddc626607"}
Sep 10 23:37:29.839503 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.839429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkcxq" event={"ID":"71c594f4-181f-4820-a5ff-33386bb2abbc","Type":"ContainerStarted","Data":"7b10c1e9d7703fc78dce48950e17d27b72f73fcc01f53c80d0b8db3b2e47326a"}
Sep 10 23:37:29.839557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.839504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:37:29.858692 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.858648    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lz4wj" podStartSLOduration=17.821343831 podStartE2EDuration="19.858633072s" totalImagesPullingTime="2.037289241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:37:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:29.857828801 +0000 UTC m=+66.957410902" watchObservedRunningTime="2026-09-10 23:37:29.858633072 +0000 UTC m=+66.958215174"
Sep 10 23:37:29.875438 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.875392    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wkcxq" podStartSLOduration=66.875376592 podStartE2EDuration="1m6.875376592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:29.874123149 +0000 UTC m=+66.973705251" watchObservedRunningTime="2026-09-10 23:37:29.875376592 +0000 UTC m=+66.974958694"
Sep 10 23:37:29.880316 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.877731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9kf9v\""
Sep 10 23:37:29.885749 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.885715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:29.913875 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:29.913842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"]
Sep 10 23:37:29.917702 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:29.917671    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09045235_f6a9_4cd6_aef1_071abe9f2e5d.slice/crio-8d8de0c144d0825e3c36ee9dfbaa5014e9423c830f4ea1fc5468b0f3756272cf WatchSource:0}: Error finding container 8d8de0c144d0825e3c36ee9dfbaa5014e9423c830f4ea1fc5468b0f3756272cf: Status 404 returned error can't find the container with id 8d8de0c144d0825e3c36ee9dfbaa5014e9423c830f4ea1fc5468b0f3756272cf
Sep 10 23:37:30.004864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.004834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c59dfcd75-jxl6v"]
Sep 10 23:37:30.008479 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:30.008456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8547a827_386c_4da9_9a14_72e1ff25cfad.slice/crio-b1c7b0fd0f8e549375973c5eec4295ce8e407fc7973a83441b62ab7249e5c18b WatchSource:0}: Error finding container b1c7b0fd0f8e549375973c5eec4295ce8e407fc7973a83441b62ab7249e5c18b: Status 404 returned error can't find the container with id b1c7b0fd0f8e549375973c5eec4295ce8e407fc7973a83441b62ab7249e5c18b
Sep 10 23:37:30.178578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.178453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8scc"]
Sep 10 23:37:30.182592 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:30.182560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45321afd_03f6_46f3_95b2_fa5f7eb26b79.slice/crio-cdd52e2e4a7e4df293623d5273a5baef503ac3168ac35983da2cde2c427baed7 WatchSource:0}: Error finding container cdd52e2e4a7e4df293623d5273a5baef503ac3168ac35983da2cde2c427baed7: Status 404 returned error can't find the container with id cdd52e2e4a7e4df293623d5273a5baef503ac3168ac35983da2cde2c427baed7
Sep 10 23:37:30.847016 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.846968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27" event={"ID":"09045235-f6a9-4cd6-aef1-071abe9f2e5d","Type":"ContainerStarted","Data":"8d8de0c144d0825e3c36ee9dfbaa5014e9423c830f4ea1fc5468b0f3756272cf"}
Sep 10 23:37:30.848795 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.848727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8scc" event={"ID":"45321afd-03f6-46f3-95b2-fa5f7eb26b79","Type":"ContainerStarted","Data":"cdd52e2e4a7e4df293623d5273a5baef503ac3168ac35983da2cde2c427baed7"}
Sep 10 23:37:30.853075 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.852267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v" event={"ID":"8547a827-386c-4da9-9a14-72e1ff25cfad","Type":"ContainerStarted","Data":"375ed8da5e6c5b5a44e595c178456bd9ade17170cdb179e618b2070139c700ec"}
Sep 10 23:37:30.853075 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.852336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v" event={"ID":"8547a827-386c-4da9-9a14-72e1ff25cfad","Type":"ContainerStarted","Data":"b1c7b0fd0f8e549375973c5eec4295ce8e407fc7973a83441b62ab7249e5c18b"}
Sep 10 23:37:30.853075 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.853017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:30.872972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:30.871665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v" podStartSLOduration=1.8716431569999998 podStartE2EDuration="1.871643157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:30.870344734 +0000 UTC m=+67.969926837" watchObservedRunningTime="2026-09-10 23:37:30.871643157 +0000 UTC m=+67.971225267"
Sep 10 23:37:31.857643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:31.857557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g465n" event={"ID":"27274aa2-1585-40d5-8ff8-450894cde5d2","Type":"ContainerStarted","Data":"c5edbc2fb5e687ca3a19bbd53082bb06bdc4ecf74ae2e2a7d88189739b858dfa"}
Sep 10 23:37:35.302523 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.302474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:35.305530 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.305500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f59fd2f6-afa2-4527-b311-db2040bd5f84-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-w2sf2\" (UID: \"f59fd2f6-afa2-4527-b311-db2040bd5f84\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:35.403009 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.402954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:35.405886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.405858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57dd2cd8-e733-4dbe-9fe3-299ad5317bf9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-srx7w\" (UID: \"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:35.531580 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.531543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9qq72\""
Sep 10 23:37:35.539532 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.539505    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"
Sep 10 23:37:35.569326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.569226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rvrst\""
Sep 10 23:37:35.577457 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:35.577427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"
Sep 10 23:37:36.304479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.304371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w"]
Sep 10 23:37:36.309252 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:36.309219    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dd2cd8_e733_4dbe_9fe3_299ad5317bf9.slice/crio-1f2aca29a9b497d163ca55d8cb2e718dc5eacdb50159a63bbabdacdfa4c113dd WatchSource:0}: Error finding container 1f2aca29a9b497d163ca55d8cb2e718dc5eacdb50159a63bbabdacdfa4c113dd: Status 404 returned error can't find the container with id 1f2aca29a9b497d163ca55d8cb2e718dc5eacdb50159a63bbabdacdfa4c113dd
Sep 10 23:37:36.318239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.318190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2"]
Sep 10 23:37:36.321160 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:36.321130    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59fd2f6_afa2_4527_b311_db2040bd5f84.slice/crio-633000edc7824c363ef91621ed83c2d3b11410ad2d94ac9c4beb99675388cd11 WatchSource:0}: Error finding container 633000edc7824c363ef91621ed83c2d3b11410ad2d94ac9c4beb99675388cd11: Status 404 returned error can't find the container with id 633000edc7824c363ef91621ed83c2d3b11410ad2d94ac9c4beb99675388cd11
Sep 10 23:37:36.879443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.879321    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2" event={"ID":"f59fd2f6-afa2-4527-b311-db2040bd5f84","Type":"ContainerStarted","Data":"633000edc7824c363ef91621ed83c2d3b11410ad2d94ac9c4beb99675388cd11"}
Sep 10 23:37:36.881544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.881512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g465n" event={"ID":"27274aa2-1585-40d5-8ff8-450894cde5d2","Type":"ContainerStarted","Data":"d98ffca24d80a26f1bfba72694a5e82b07f9c608d9f665f2e6958990e9bed9df"}
Sep 10 23:37:36.884544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.884478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27" event={"ID":"09045235-f6a9-4cd6-aef1-071abe9f2e5d","Type":"ContainerStarted","Data":"b55edb7465b9901ed7e52cf8df78c7fb6a618cbe0ba66b7e60c710d0e027d0e9"}
Sep 10 23:37:36.884902 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.884874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:36.886201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.886173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w" event={"ID":"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9","Type":"ContainerStarted","Data":"1f2aca29a9b497d163ca55d8cb2e718dc5eacdb50159a63bbabdacdfa4c113dd"}
Sep 10 23:37:36.886746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.886724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27"
Sep 10 23:37:36.888857 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.888717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8scc" event={"ID":"45321afd-03f6-46f3-95b2-fa5f7eb26b79","Type":"ContainerStarted","Data":"a5fc25510c5ed1dc6470e6a1f293709e4eeea5407311a941f2dc41d5894f1750"}
Sep 10 23:37:36.888857 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.888765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8scc" event={"ID":"45321afd-03f6-46f3-95b2-fa5f7eb26b79","Type":"ContainerStarted","Data":"c8c484ef63e7c4da5b349d0798ab06f80b841bd2fa0262252117c4a3cfeef755"}
Sep 10 23:37:36.889007 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.888910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:36.890318 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.890279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gdztg" event={"ID":"03373111-12a7-456f-9f0a-a7fcaac828d7","Type":"ContainerStarted","Data":"27432d5a998bb3dd6a875a7bc2fd7c09c419c5ce4c31914d65f6542505bea626"}
Sep 10 23:37:36.929748 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.929657    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g465n" podStartSLOduration=72.269855152 podStartE2EDuration="1m13.929640787s" totalImagesPullingTime="1.659785635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:36.902450186 +0000 UTC m=+74.002032293" watchObservedRunningTime="2026-09-10 23:37:36.929640787 +0000 UTC m=+74.029222946"
Sep 10 23:37:36.929925 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.929872    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gdztg" podStartSLOduration=67.635653887 podStartE2EDuration="1m13.929864853s" totalImagesPullingTime="6.294210966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:36.928463432 +0000 UTC m=+74.028045546" watchObservedRunningTime="2026-09-10 23:37:36.929864853 +0000 UTC m=+74.029446957"
Sep 10 23:37:36.975861 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:36.975810    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j8scc" podStartSLOduration=34.176097527 podStartE2EDuration="39.975791159s" totalImagesPullingTime="5.799693632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:36.973470157 +0000 UTC m=+74.073052261" watchObservedRunningTime="2026-09-10 23:37:36.975791159 +0000 UTC m=+74.075373261"
Sep 10 23:37:37.010410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:37.010347    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7777747897-mqw27" podStartSLOduration=1.911877289 podStartE2EDuration="8.010323721s" totalImagesPullingTime="6.098446432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:37.008843459 +0000 UTC m=+74.108425562" watchObservedRunningTime="2026-09-10 23:37:37.010323721 +0000 UTC m=+74.109905826"
Sep 10 23:37:37.897147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:37.897077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2" event={"ID":"f59fd2f6-afa2-4527-b311-db2040bd5f84","Type":"ContainerStarted","Data":"78f53edfe6ba1ac98e6a7ad54f8db8ce5bb0fe82c3f2a925ad79f04a897c1950"}
Sep 10 23:37:37.924860 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:37.924764    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-w2sf2" podStartSLOduration=33.903135061 podStartE2EDuration="34.924739608s" totalImagesPullingTime="1.021604547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:37.923776151 +0000 UTC m=+75.023358256" watchObservedRunningTime="2026-09-10 23:37:37.924739608 +0000 UTC m=+75.024321711"
Sep 10 23:37:38.902920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:38.902882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w" event={"ID":"57dd2cd8-e733-4dbe-9fe3-299ad5317bf9","Type":"ContainerStarted","Data":"f67711b6917e1fe7b1924f0cc074014396b9139a8f77cb46d03b88ba24fe1105"}
Sep 10 23:37:38.920434 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:38.920384    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-srx7w" podStartSLOduration=34.172509561 podStartE2EDuration="35.920366536s" totalImagesPullingTime="1.747856975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:38.91995309 +0000 UTC m=+76.019535206" watchObservedRunningTime="2026-09-10 23:37:38.920366536 +0000 UTC m=+76.019948637"
Sep 10 23:37:39.245428 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:39.245381    2581 patch_prober.go:28] interesting pod/image-registry-7858574b7-9t9fk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 23:37:39.245590 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:39.245438    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:37:46.900116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:46.900002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j8scc"
Sep 10 23:37:47.042244 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.042213    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ss46t"]
Sep 10 23:37:47.046906 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.046885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.052321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.052279    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gv69c\""
Sep 10 23:37:47.052321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.052311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 23:37:47.052321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.052318    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 23:37:47.052540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.052308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 23:37:47.052540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.052374    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 23:37:47.195052 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.194983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195052 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-root\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-metrics-client-ca\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h54z\" (UniqueName: \"kubernetes.io/projected/ab60083e-4528-46c4-a0ed-595cc315c457-kube-api-access-4h54z\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-tls\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-sys\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-textfile\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.195310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.195252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-wtmp\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.296817 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-root\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.296817 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-metrics-client-ca\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h54z\" (UniqueName: \"kubernetes.io/projected/ab60083e-4528-46c4-a0ed-595cc315c457-kube-api-access-4h54z\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-root\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-tls\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-sys\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.296962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-textfile\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-sys\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-wtmp\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-wtmp\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-textfile\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297667 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-metrics-client-ca\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.297667 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.297616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.299566 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.299535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-tls\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.299685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.299600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab60083e-4528-46c4-a0ed-595cc315c457-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.305451 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.305412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h54z\" (UniqueName: \"kubernetes.io/projected/ab60083e-4528-46c4-a0ed-595cc315c457-kube-api-access-4h54z\") pod \"node-exporter-ss46t\" (UID: \"ab60083e-4528-46c4-a0ed-595cc315c457\") " pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.356241 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.356204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss46t"
Sep 10 23:37:47.367059 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:47.367024    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab60083e_4528_46c4_a0ed_595cc315c457.slice/crio-992cdfce3fe36858b377e9c6e1e0c19b90485d0b74c53192bb6607fd68dd985e WatchSource:0}: Error finding container 992cdfce3fe36858b377e9c6e1e0c19b90485d0b74c53192bb6607fd68dd985e: Status 404 returned error can't find the container with id 992cdfce3fe36858b377e9c6e1e0c19b90485d0b74c53192bb6607fd68dd985e
Sep 10 23:37:47.934970 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:47.934925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss46t" event={"ID":"ab60083e-4528-46c4-a0ed-595cc315c457","Type":"ContainerStarted","Data":"992cdfce3fe36858b377e9c6e1e0c19b90485d0b74c53192bb6607fd68dd985e"}
Sep 10 23:37:48.168957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.168922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:37:48.173408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.173339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.177804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.177778    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 23:37:48.177804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.177794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 23:37:48.178029 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.177779    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 23:37:48.178091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 23:37:48.178142 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 23:37:48.178267 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmn87\""
Sep 10 23:37:48.178523 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178363    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 23:37:48.178523 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178376    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 23:37:48.178523 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 23:37:48.178776 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.178577    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 23:37:48.198394 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.198323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:37:48.304725 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.304928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.304928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.304928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.304928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.304980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.305044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.305097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.305130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.305150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.305442 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.305168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwvtv\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406470 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406470 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406691 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.406691 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:48.406602    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 10 23:37:48.406951 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:48.406770    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls podName:6a5fe6ea-0324-4889-96e1-66002a5adec9 nodeName:}" failed. No retries permitted until 2026-09-10 23:37:48.906746396 +0000 UTC m=+86.006328495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9") : secret "alertmanager-main-tls" not found
Sep 10 23:37:48.406951 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.406988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvtv\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.407261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.407230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.408211 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.408148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.408942 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.408788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.410800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.410737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.410800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.410784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.410979 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.410923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.412198 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.412178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.412356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.412311    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.412596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.412567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.412972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.412950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.413044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.412955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.421569 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.421548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwvtv\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.911366 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.911336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.913859 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.913834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:48.945258 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.945226    2581 generic.go:356] "Generic (PLEG): container finished" podID="ab60083e-4528-46c4-a0ed-595cc315c457" containerID="c4c57359cda58e2b6b791fa8c73ce5596425c3c60a180a93845a50a41ec620dc" exitCode=0
Sep 10 23:37:48.945621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:48.945320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss46t" event={"ID":"ab60083e-4528-46c4-a0ed-595cc315c457","Type":"ContainerDied","Data":"c4c57359cda58e2b6b791fa8c73ce5596425c3c60a180a93845a50a41ec620dc"}
Sep 10 23:37:49.085854 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.085823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:37:49.244788 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.244706    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:49.246186 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.246163    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8c6b8d577-dmscz"]
Sep 10 23:37:49.250819 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.250803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.255924 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.255905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 23:37:49.255924 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.255915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 23:37:49.256154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.256138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 23:37:49.256229 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.256211    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 23:37:49.256329 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.256310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 23:37:49.256414 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.256354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-134jp8dj3eil1\""
Sep 10 23:37:49.256493 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.256462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hcrj9\""
Sep 10 23:37:49.271908 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.271882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8c6b8d577-dmscz"]
Sep 10 23:37:49.388677 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.388649    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:37:49.390050 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:49.390025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5fe6ea_0324_4889_96e1_66002a5adec9.slice/crio-87b2d7a79901591b7a7aee907fb4408b0b7a10b3b2dade68715a932f33a9d753 WatchSource:0}: Error finding container 87b2d7a79901591b7a7aee907fb4408b0b7a10b3b2dade68715a932f33a9d753: Status 404 returned error can't find the container with id 87b2d7a79901591b7a7aee907fb4408b0b7a10b3b2dade68715a932f33a9d753
Sep 10 23:37:49.415057 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415197 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415197 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415197 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-grpc-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415197 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxcq\" (UniqueName: \"kubernetes.io/projected/054f93eb-820d-4dbe-ab16-0899eacc33ca-kube-api-access-lkxcq\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.415435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.415262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054f93eb-820d-4dbe-ab16-0899eacc33ca-metrics-client-ca\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-grpc-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxcq\" (UniqueName: \"kubernetes.io/projected/054f93eb-820d-4dbe-ab16-0899eacc33ca-kube-api-access-lkxcq\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.516717 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.516520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054f93eb-820d-4dbe-ab16-0899eacc33ca-metrics-client-ca\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.517578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.517551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/054f93eb-820d-4dbe-ab16-0899eacc33ca-metrics-client-ca\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519216 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-grpc-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519662 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519719 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519840 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.519880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.519839    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/054f93eb-820d-4dbe-ab16-0899eacc33ca-secret-thanos-querier-tls\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.526673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.526650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxcq\" (UniqueName: \"kubernetes.io/projected/054f93eb-820d-4dbe-ab16-0899eacc33ca-kube-api-access-lkxcq\") pod \"thanos-querier-8c6b8d577-dmscz\" (UID: \"054f93eb-820d-4dbe-ab16-0899eacc33ca\") " pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.560700 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.560664    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:49.836560 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.836481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8c6b8d577-dmscz"]
Sep 10 23:37:49.840323 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:49.840281    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054f93eb_820d_4dbe_ab16_0899eacc33ca.slice/crio-6fe18963409de08dd7661746216fbd597c768ad81b27ca37f1f641e3557a01b4 WatchSource:0}: Error finding container 6fe18963409de08dd7661746216fbd597c768ad81b27ca37f1f641e3557a01b4: Status 404 returned error can't find the container with id 6fe18963409de08dd7661746216fbd597c768ad81b27ca37f1f641e3557a01b4
Sep 10 23:37:49.951191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.951160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss46t" event={"ID":"ab60083e-4528-46c4-a0ed-595cc315c457","Type":"ContainerStarted","Data":"8e8199b365df700c859c580b0f7cc9d28b734bf582cd4b0b4dedb3ae331af5de"}
Sep 10 23:37:49.951657 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.951210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss46t" event={"ID":"ab60083e-4528-46c4-a0ed-595cc315c457","Type":"ContainerStarted","Data":"de2e9cbff5ec83b00b215248b750654af5f5cb548e46db05ef38be063e0408e2"}
Sep 10 23:37:49.952574 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.952545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"6fe18963409de08dd7661746216fbd597c768ad81b27ca37f1f641e3557a01b4"}
Sep 10 23:37:49.953708 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.953686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"87b2d7a79901591b7a7aee907fb4408b0b7a10b3b2dade68715a932f33a9d753"}
Sep 10 23:37:49.969114 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:49.969068    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ss46t" podStartSLOduration=1.831784752 podStartE2EDuration="2.969051503s" totalImagesPullingTime="1.065992188s" totalInitContainerRuntime="71.274563ms" isStatefulPod=true podCreationTimestamp="2026-09-10 23:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:49.967926468 +0000 UTC m=+87.067508572" watchObservedRunningTime="2026-09-10 23:37:49.969051503 +0000 UTC m=+87.068633614"
Sep 10 23:37:50.959560 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:50.959523    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd" exitCode=0
Sep 10 23:37:50.960024 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:50.959612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"}
Sep 10 23:37:51.966805 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:51.966761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"2ec8d7a3970784de8b23547e2afba219c5f7648b3231b29b8d14d9ec2504d2c9"}
Sep 10 23:37:51.967314 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:51.966854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"a637f6edb3156da659fa81e25f11a0518ec0d51a6ce5a195e6bd4678af05a5d4"}
Sep 10 23:37:51.967314 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:51.966897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"95a4346ca9f28caaa56975856f48c02a39e61e8cddb8e9544d07333a64417bd1"}
Sep 10 23:37:52.866556 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:52.866532    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c59dfcd75-jxl6v"
Sep 10 23:37:52.977823 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:52.977788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"}
Sep 10 23:37:52.978129 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:52.977886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"}
Sep 10 23:37:52.981083 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:52.980994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"7e9b19a91603966ab53c0f54fe89885ff6dba24ba1c647602976fd3039d55dc8"}
Sep 10 23:37:52.981083 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:52.981052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"07281311e15e12a66da9f604572625e3e977c05c5fde868833a38e76420039a4"}
Sep 10 23:37:53.284227 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.284145    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:37:53.287433 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.287412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.289679 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.289656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:37:53.289877 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.289863    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:37:53.290006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.289912    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:37:53.290120 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.290107    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-249zt\""
Sep 10 23:37:53.290176 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.290143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 23:37:53.290239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.290206    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 23:37:53.290333 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.290312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:37:53.290407 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.290329    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:37:53.298381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.298359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:37:53.454312 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.454480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.454480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.454480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrkf\" (UniqueName: \"kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.454576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.454576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.454517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555017 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.554906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrkf\" (UniqueName: \"kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555017 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.554968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555017 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.554991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.555025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.555062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.555116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555879 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.555855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.555983 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.555888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.556122 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.556098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.557922 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.557897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.558153 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.558138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.568512 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.568484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrkf\" (UniqueName: \"kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf\") pod \"console-6cbb94f7c7-ghlz8\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") " pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.597250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.597207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:37:53.879727 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.879640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:37:53.882849 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:37:53.882816    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f420b35_3379_4ce8_9ca4_0c62bc08059d.slice/crio-6c636e65d62083cb9249c67ba41e30978a00ec94b127c5bd5c2e8f25373e98f6 WatchSource:0}: Error finding container 6c636e65d62083cb9249c67ba41e30978a00ec94b127c5bd5c2e8f25373e98f6: Status 404 returned error can't find the container with id 6c636e65d62083cb9249c67ba41e30978a00ec94b127c5bd5c2e8f25373e98f6
Sep 10 23:37:53.988995 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.988955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"}
Sep 10 23:37:53.989454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.989047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"}
Sep 10 23:37:53.989454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.989090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"}
Sep 10 23:37:53.989454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.989116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerStarted","Data":"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"}
Sep 10 23:37:53.992158 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.992115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" event={"ID":"054f93eb-820d-4dbe-ab16-0899eacc33ca","Type":"ContainerStarted","Data":"65babe2673a7a76a4a1910ff08f0f2528d33069476b67c394f4eb5a7e4fea036"}
Sep 10 23:37:53.992376 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.992256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:37:53.993517 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:53.993496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbb94f7c7-ghlz8" event={"ID":"6f420b35-3379-4ce8-9ca4-0c62bc08059d","Type":"ContainerStarted","Data":"6c636e65d62083cb9249c67ba41e30978a00ec94b127c5bd5c2e8f25373e98f6"}
Sep 10 23:37:54.020331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.020264    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.961840865 podStartE2EDuration="6.020248175s" totalImagesPullingTime="3.038178665s" totalInitContainerRuntime="20.228645ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:54.018934918 +0000 UTC m=+91.118517049" watchObservedRunningTime="2026-09-10 23:37:54.020248175 +0000 UTC m=+91.119830277"
Sep 10 23:37:54.045369 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.045318    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz" podStartSLOduration=2.285271345 podStartE2EDuration="5.045278366s" totalImagesPullingTime="2.760007021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:54.042741863 +0000 UTC m=+91.142323966" watchObservedRunningTime="2026-09-10 23:37:54.045278366 +0000 UTC m=+91.144860469"
Sep 10 23:37:54.259996 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.259927    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerName="registry" containerID="cri-o://c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d" gracePeriod=30
Sep 10 23:37:54.517796 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.517733    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:54.664810 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.664774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665009 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.664869    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665009 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.664936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665009 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.664978    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665009 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665045    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kskpk\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665123    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca\") pod \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\" (UID: \"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d\") "
Sep 10 23:37:54.665733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:37:54.665996 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.665738    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:37:54.668022 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.667993    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:37:54.668212 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.668181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:37:54.668212 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.668193    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:37:54.668371 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.668238    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk" (OuterVolumeSpecName: "kube-api-access-kskpk") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "kube-api-access-kskpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:37:54.668424 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.668361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:37:54.675457 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.675424    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" (UID: "cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:37:54.766358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766316    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-trusted-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766354    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-bound-sa-token\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766358 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766367    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-installation-pull-secrets\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766384    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-certificates\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766399    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-registry-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766416    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-image-registry-private-configuration\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766438    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kskpk\" (UniqueName: \"kubernetes.io/projected/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-kube-api-access-kskpk\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:54.766604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:54.766451    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d-ca-trust-extracted\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:37:55.001988 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.001953    2581 generic.go:356] "Generic (PLEG): container finished" podID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerID="c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d" exitCode=0
Sep 10 23:37:55.002480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.001986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" event={"ID":"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d","Type":"ContainerDied","Data":"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"}
Sep 10 23:37:55.002480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.002017    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7858574b7-9t9fk"
Sep 10 23:37:55.002480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.002039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7858574b7-9t9fk" event={"ID":"cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d","Type":"ContainerDied","Data":"acfbf74cc402eb64c6895267857534e6a586871bf0874972c17fb472194f808e"}
Sep 10 23:37:55.002480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.002065    2581 scope.go:117] "RemoveContainer" containerID="c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"
Sep 10 23:37:55.012763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.012739    2581 scope.go:117] "RemoveContainer" containerID="c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"
Sep 10 23:37:55.013163 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:37:55.013130    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d\": container with ID starting with c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d not found: ID does not exist" containerID="c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"
Sep 10 23:37:55.013260 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.013166    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d"} err="failed to get container status \"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d\": rpc error: code = NotFound desc = could not find container \"c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d\": container with ID starting with c706c34dd0fb3e5d41b0b298f8b3366e287af26f6050d9eb8d12f347cf552c2d not found: ID does not exist"
Sep 10 23:37:55.023837 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.023763    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:55.031062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.031036    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7858574b7-9t9fk"]
Sep 10 23:37:55.447915 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:55.447876    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" path="/var/lib/kubelet/pods/cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d/volumes"
Sep 10 23:37:57.013743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:57.013709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbb94f7c7-ghlz8" event={"ID":"6f420b35-3379-4ce8-9ca4-0c62bc08059d","Type":"ContainerStarted","Data":"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"}
Sep 10 23:37:57.043526 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:37:57.043474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cbb94f7c7-ghlz8" podStartSLOduration=1.385956358 podStartE2EDuration="4.043457523s" totalImagesPullingTime="2.657501165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:37:57.042245273 +0000 UTC m=+94.141827376" watchObservedRunningTime="2026-09-10 23:37:57.043457523 +0000 UTC m=+94.143039686"
Sep 10 23:38:00.009484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:00.009458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8c6b8d577-dmscz"
Sep 10 23:38:00.854502 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:00.854469    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wkcxq"
Sep 10 23:38:01.727004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.726968    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:38:01.727390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.727361    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerName="registry"
Sep 10 23:38:01.727390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.727375    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerName="registry"
Sep 10 23:38:01.727463 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.727437    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfcb7a05-e3c5-4d1e-9188-ae4bd6526d9d" containerName="registry"
Sep 10 23:38:01.733728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.733702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.741301 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.741255    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:38:01.741630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.741608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:38:01.828564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828732 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828732 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828732 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828732 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828732 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg4jx\" (UniqueName: \"kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.828931 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.828753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.929760 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.929722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.929760 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.929772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.929993 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.929794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.929993 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.929824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.929993 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.929958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.930130 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.930045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg4jx\" (UniqueName: \"kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.930130 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.930088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.930656 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.930626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.930656 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.930653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.930824 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.930699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.931038 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.931017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.932448 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.932422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.932537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.932519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:01.939090 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:01.939032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg4jx\" (UniqueName: \"kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx\") pod \"console-59487c99b8-qpswh\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") " pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:02.044194 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:02.044162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:02.315647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:02.315547    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:38:02.318419 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:38:02.318391    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1270128c_e4c5_4581_8ce2_a66ffd169c99.slice/crio-a4d89ac07e0abcc582f7ddcf685d6388e756a3fbf20ebeafce2f3f9bc9a0636b WatchSource:0}: Error finding container a4d89ac07e0abcc582f7ddcf685d6388e756a3fbf20ebeafce2f3f9bc9a0636b: Status 404 returned error can't find the container with id a4d89ac07e0abcc582f7ddcf685d6388e756a3fbf20ebeafce2f3f9bc9a0636b
Sep 10 23:38:03.040886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.040850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59487c99b8-qpswh" event={"ID":"1270128c-e4c5-4581-8ce2-a66ffd169c99","Type":"ContainerStarted","Data":"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"}
Sep 10 23:38:03.041264 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.040907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59487c99b8-qpswh" event={"ID":"1270128c-e4c5-4581-8ce2-a66ffd169c99","Type":"ContainerStarted","Data":"a4d89ac07e0abcc582f7ddcf685d6388e756a3fbf20ebeafce2f3f9bc9a0636b"}
Sep 10 23:38:03.060670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.060622    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59487c99b8-qpswh" podStartSLOduration=2.060606466 podStartE2EDuration="2.060606466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:38:03.059243738 +0000 UTC m=+100.158825865" watchObservedRunningTime="2026-09-10 23:38:03.060606466 +0000 UTC m=+100.160188569"
Sep 10 23:38:03.597436 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.597398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:03.597639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.597469    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:03.602677 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:03.602652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:04.049334 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:04.049309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:12.044331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:12.044270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:12.044331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:12.044341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:12.049241 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:12.049216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:12.080962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:12.080936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:38:12.138078 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:12.138047    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:38:20.112261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:20.112220    2581 generic.go:356] "Generic (PLEG): container finished" podID="1811caf3-5ec5-4618-b17f-8296b488f231" containerID="1a86ca546a81545112d8a1405a7734577930b1ba4c63da6f8e2cf5f82265534e" exitCode=0
Sep 10 23:38:20.112261 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:20.112260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn" event={"ID":"1811caf3-5ec5-4618-b17f-8296b488f231","Type":"ContainerDied","Data":"1a86ca546a81545112d8a1405a7734577930b1ba4c63da6f8e2cf5f82265534e"}
Sep 10 23:38:20.112752 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:20.112567    2581 scope.go:117] "RemoveContainer" containerID="1a86ca546a81545112d8a1405a7734577930b1ba4c63da6f8e2cf5f82265534e"
Sep 10 23:38:21.118994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:21.118959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-7sfhn" event={"ID":"1811caf3-5ec5-4618-b17f-8296b488f231","Type":"ContainerStarted","Data":"c3e807059019c098d716eeb05ab2b5f996b2b69c60f9f894b626ce27e6e4cc77"}
Sep 10 23:38:37.158469 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.158428    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cbb94f7c7-ghlz8" podUID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" containerName="console" containerID="cri-o://a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3" gracePeriod=15
Sep 10 23:38:37.404328 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.404301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:37.545258 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545226    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxrkf\" (UniqueName: \"kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545275    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545362    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545378    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config\") pod \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\" (UID: \"6f420b35-3379-4ce8-9ca4-0c62bc08059d\") "
Sep 10 23:38:37.545884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545851    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:37.546054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.545860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config" (OuterVolumeSpecName: "console-config") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:37.546550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.546526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:38:37.547940 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.547921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf" (OuterVolumeSpecName: "kube-api-access-vxrkf") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "kube-api-access-vxrkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:38:37.548105 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.548083    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:37.548165 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.548100    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f420b35-3379-4ce8-9ca4-0c62bc08059d" (UID: "6f420b35-3379-4ce8-9ca4-0c62bc08059d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:38:37.646685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646642    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrkf\" (UniqueName: \"kubernetes.io/projected/6f420b35-3379-4ce8-9ca4-0c62bc08059d-kube-api-access-vxrkf\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:37.646685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646675    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:37.646685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646685    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-oauth-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:37.646685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646695    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:37.646950 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646704    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-oauth-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:37.646950 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:37.646711    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f420b35-3379-4ce8-9ca4-0c62bc08059d-console-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:38:38.185044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.185008    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" containerID="a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3" exitCode=0
Sep 10 23:38:38.185475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.185058    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cbb94f7c7-ghlz8"
Sep 10 23:38:38.185475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.185091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbb94f7c7-ghlz8" event={"ID":"6f420b35-3379-4ce8-9ca4-0c62bc08059d","Type":"ContainerDied","Data":"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"}
Sep 10 23:38:38.185475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.185143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cbb94f7c7-ghlz8" event={"ID":"6f420b35-3379-4ce8-9ca4-0c62bc08059d","Type":"ContainerDied","Data":"6c636e65d62083cb9249c67ba41e30978a00ec94b127c5bd5c2e8f25373e98f6"}
Sep 10 23:38:38.185475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.185162    2581 scope.go:117] "RemoveContainer" containerID="a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"
Sep 10 23:38:38.194340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.194324    2581 scope.go:117] "RemoveContainer" containerID="a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"
Sep 10 23:38:38.194609 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:38:38.194589    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3\": container with ID starting with a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3 not found: ID does not exist" containerID="a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"
Sep 10 23:38:38.194656 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.194617    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3"} err="failed to get container status \"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3\": rpc error: code = NotFound desc = could not find container \"a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3\": container with ID starting with a0082b6679fd6b6134c0722ca3696440e6b4384684407da77de424771ac062a3 not found: ID does not exist"
Sep 10 23:38:38.205022 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.204996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:38:38.208093 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:38.208070    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cbb94f7c7-ghlz8"]
Sep 10 23:38:39.447449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:39.447416    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" path="/var/lib/kubelet/pods/6f420b35-3379-4ce8-9ca4-0c62bc08059d/volumes"
Sep 10 23:38:40.194423 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:40.194385    2581 generic.go:356] "Generic (PLEG): container finished" podID="38313397-1470-43c1-a36c-58b21ac2d189" containerID="59e327adac6d963b576b7c1913cd66f58dd97a03c6ae41bf63b8401f4a084374" exitCode=0
Sep 10 23:38:40.194586 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:40.194457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g2hbd" event={"ID":"38313397-1470-43c1-a36c-58b21ac2d189","Type":"ContainerDied","Data":"59e327adac6d963b576b7c1913cd66f58dd97a03c6ae41bf63b8401f4a084374"}
Sep 10 23:38:40.194797 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:40.194783    2581 scope.go:117] "RemoveContainer" containerID="59e327adac6d963b576b7c1913cd66f58dd97a03c6ae41bf63b8401f4a084374"
Sep 10 23:38:41.200012 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:38:41.199975    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g2hbd" event={"ID":"38313397-1470-43c1-a36c-58b21ac2d189","Type":"ContainerStarted","Data":"771a0b7171b41f81ec4c26b65fa712dc12c45ae7f213b6b75861552120b9dd4c"}
Sep 10 23:39:07.485212 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485178    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:07.485627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485447    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="alertmanager" containerID="cri-o://6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c" gracePeriod=120
Sep 10 23:39:07.485627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485537    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-web" containerID="cri-o://e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60" gracePeriod=120
Sep 10 23:39:07.485627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485537    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-metric" containerID="cri-o://51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980" gracePeriod=120
Sep 10 23:39:07.485627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485563    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="config-reloader" containerID="cri-o://a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d" gracePeriod=120
Sep 10 23:39:07.485627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485603    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy" containerID="cri-o://b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467" gracePeriod=120
Sep 10 23:39:07.485861 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:07.485624    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="prom-label-proxy" containerID="cri-o://6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0" gracePeriod=120
Sep 10 23:39:08.313094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313063    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0" exitCode=0
Sep 10 23:39:08.313094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313087    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467" exitCode=0
Sep 10 23:39:08.313094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313096    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d" exitCode=0
Sep 10 23:39:08.313094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313103    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c" exitCode=0
Sep 10 23:39:08.313487 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"}
Sep 10 23:39:08.313487 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"}
Sep 10 23:39:08.313487 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"}
Sep 10 23:39:08.313487 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.313275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"}
Sep 10 23:39:08.725625 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.725597    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:08.802923 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.802895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803113 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.802930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803113 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.802951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803113 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.802975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803113 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.802989    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803120    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwvtv\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803275    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803665 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803665 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:08.803665 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803439    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets\") pod \"6a5fe6ea-0324-4889-96e1-66002a5adec9\" (UID: \"6a5fe6ea-0324-4889-96e1-66002a5adec9\") "
Sep 10 23:39:08.803978 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.803721    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.805240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.805189    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:39:08.805240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.805193    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:08.806077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.806037    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume" (OuterVolumeSpecName: "config-volume") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.806553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.806514    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.806767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.806716    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:08.806852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.806780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.807204 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.807170    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out" (OuterVolumeSpecName: "config-out") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:39:08.807426 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.807398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.807583 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.807559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv" (OuterVolumeSpecName: "kube-api-access-rwvtv") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "kube-api-access-rwvtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:08.808639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.808617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.812151 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.812131    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.818689 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.818668    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config" (OuterVolumeSpecName: "web-config") pod "6a5fe6ea-0324-4889-96e1-66002a5adec9" (UID: "6a5fe6ea-0324-4889-96e1-66002a5adec9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904907    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-tls-assets\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904943    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904958    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904970    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904981    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-cluster-tls-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.904994    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwvtv\" (UniqueName: \"kubernetes.io/projected/6a5fe6ea-0324-4889-96e1-66002a5adec9-kube-api-access-rwvtv\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905007    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-alertmanager-main-db\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905019    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-main-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905032    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905045    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5fe6ea-0324-4889-96e1-66002a5adec9-web-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905055    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5fe6ea-0324-4889-96e1-66002a5adec9-config-out\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:08.905364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:08.905065    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5fe6ea-0324-4889-96e1-66002a5adec9-metrics-client-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:09.320274 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320237    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980" exitCode=0
Sep 10 23:39:09.320274 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320264    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerID="e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60" exitCode=0
Sep 10 23:39:09.320495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"}
Sep 10 23:39:09.320495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320357    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.320495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"}
Sep 10 23:39:09.320495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a5fe6ea-0324-4889-96e1-66002a5adec9","Type":"ContainerDied","Data":"87b2d7a79901591b7a7aee907fb4408b0b7a10b3b2dade68715a932f33a9d753"}
Sep 10 23:39:09.320495 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.320486    2581 scope.go:117] "RemoveContainer" containerID="6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"
Sep 10 23:39:09.329141 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.329121    2581 scope.go:117] "RemoveContainer" containerID="51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"
Sep 10 23:39:09.336636 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.336617    2581 scope.go:117] "RemoveContainer" containerID="b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"
Sep 10 23:39:09.344013 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.343995    2581 scope.go:117] "RemoveContainer" containerID="e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"
Sep 10 23:39:09.344190 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.344170    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:09.350304 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.350269    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:09.351381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.351361    2581 scope.go:117] "RemoveContainer" containerID="a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"
Sep 10 23:39:09.358607 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.358588    2581 scope.go:117] "RemoveContainer" containerID="6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"
Sep 10 23:39:09.365685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.365660    2581 scope.go:117] "RemoveContainer" containerID="f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"
Sep 10 23:39:09.372567 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.372543    2581 scope.go:117] "RemoveContainer" containerID="6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"
Sep 10 23:39:09.372836 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.372815    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0\": container with ID starting with 6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0 not found: ID does not exist" containerID="6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"
Sep 10 23:39:09.372886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.372847    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"} err="failed to get container status \"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0\": rpc error: code = NotFound desc = could not find container \"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0\": container with ID starting with 6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0 not found: ID does not exist"
Sep 10 23:39:09.372886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.372866    2581 scope.go:117] "RemoveContainer" containerID="51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"
Sep 10 23:39:09.373128 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.373111    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980\": container with ID starting with 51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980 not found: ID does not exist" containerID="51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"
Sep 10 23:39:09.373178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373134    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"} err="failed to get container status \"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980\": rpc error: code = NotFound desc = could not find container \"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980\": container with ID starting with 51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980 not found: ID does not exist"
Sep 10 23:39:09.373178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373150    2581 scope.go:117] "RemoveContainer" containerID="b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"
Sep 10 23:39:09.373432 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.373417    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467\": container with ID starting with b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467 not found: ID does not exist" containerID="b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"
Sep 10 23:39:09.373474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373436    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"} err="failed to get container status \"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467\": rpc error: code = NotFound desc = could not find container \"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467\": container with ID starting with b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467 not found: ID does not exist"
Sep 10 23:39:09.373474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373450    2581 scope.go:117] "RemoveContainer" containerID="e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"
Sep 10 23:39:09.373683 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.373669    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60\": container with ID starting with e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60 not found: ID does not exist" containerID="e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"
Sep 10 23:39:09.373721 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373686    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"} err="failed to get container status \"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60\": rpc error: code = NotFound desc = could not find container \"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60\": container with ID starting with e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60 not found: ID does not exist"
Sep 10 23:39:09.373721 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373699    2581 scope.go:117] "RemoveContainer" containerID="a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"
Sep 10 23:39:09.373948 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.373932    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d\": container with ID starting with a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d not found: ID does not exist" containerID="a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"
Sep 10 23:39:09.373989 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373953    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"} err="failed to get container status \"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d\": rpc error: code = NotFound desc = could not find container \"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d\": container with ID starting with a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d not found: ID does not exist"
Sep 10 23:39:09.373989 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.373967    2581 scope.go:117] "RemoveContainer" containerID="6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"
Sep 10 23:39:09.374213 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.374197    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c\": container with ID starting with 6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c not found: ID does not exist" containerID="6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"
Sep 10 23:39:09.374253 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374217    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"} err="failed to get container status \"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c\": rpc error: code = NotFound desc = could not find container \"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c\": container with ID starting with 6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c not found: ID does not exist"
Sep 10 23:39:09.374253 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374231    2581 scope.go:117] "RemoveContainer" containerID="f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"
Sep 10 23:39:09.374490 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:09.374474    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd\": container with ID starting with f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd not found: ID does not exist" containerID="f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"
Sep 10 23:39:09.374544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374494    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"} err="failed to get container status \"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd\": rpc error: code = NotFound desc = could not find container \"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd\": container with ID starting with f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd not found: ID does not exist"
Sep 10 23:39:09.374544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374507    2581 scope.go:117] "RemoveContainer" containerID="6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"
Sep 10 23:39:09.374744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374724    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0"} err="failed to get container status \"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0\": rpc error: code = NotFound desc = could not find container \"6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0\": container with ID starting with 6d40f1a599a26122ec28aec676ceb168e2a14c32f915d21d27c9b23c3c45f4e0 not found: ID does not exist"
Sep 10 23:39:09.374787 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374746    2581 scope.go:117] "RemoveContainer" containerID="51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"
Sep 10 23:39:09.375011 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.374983    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980"} err="failed to get container status \"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980\": rpc error: code = NotFound desc = could not find container \"51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980\": container with ID starting with 51a1d232e0892ee5c28770d3766790ea60088cd326785685d80e2469f97fb980 not found: ID does not exist"
Sep 10 23:39:09.375011 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375006    2581 scope.go:117] "RemoveContainer" containerID="b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"
Sep 10 23:39:09.375427 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375332    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467"} err="failed to get container status \"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467\": rpc error: code = NotFound desc = could not find container \"b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467\": container with ID starting with b2dcbf1da82f126067fa695bc2c9f12429715a413f8b5f0227b92765d3f4e467 not found: ID does not exist"
Sep 10 23:39:09.375427 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375364    2581 scope.go:117] "RemoveContainer" containerID="e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"
Sep 10 23:39:09.375735 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375705    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60"} err="failed to get container status \"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60\": rpc error: code = NotFound desc = could not find container \"e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60\": container with ID starting with e3277bea3bc57217ef120e06af1b8d0da78dd75dfa12335e213885c4e6dbeb60 not found: ID does not exist"
Sep 10 23:39:09.375735 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375734    2581 scope.go:117] "RemoveContainer" containerID="a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"
Sep 10 23:39:09.376014 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.375992    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d"} err="failed to get container status \"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d\": rpc error: code = NotFound desc = could not find container \"a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d\": container with ID starting with a7fa5da41848dde710f09f6aac62b02b4197a644153c0533d4d0785bbe9e038d not found: ID does not exist"
Sep 10 23:39:09.376072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.376016    2581 scope.go:117] "RemoveContainer" containerID="6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"
Sep 10 23:39:09.376313 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.376265    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c"} err="failed to get container status \"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c\": rpc error: code = NotFound desc = could not find container \"6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c\": container with ID starting with 6bcf19827becac4db542cda47f472559a52069e7aede9911af7a23cb67632e8c not found: ID does not exist"
Sep 10 23:39:09.376313 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.376305    2581 scope.go:117] "RemoveContainer" containerID="f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"
Sep 10 23:39:09.376565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.376543    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd"} err="failed to get container status \"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd\": rpc error: code = NotFound desc = could not find container \"f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd\": container with ID starting with f8c19b67f99bd4286547fb038f9f93de0be4c1a8b858b9eb1ff8c78bde7f3bcd not found: ID does not exist"
Sep 10 23:39:09.377072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377058    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:09.377346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377335    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="init-config-reloader"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377349    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="init-config-reloader"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377360    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="alertmanager"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377365    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="alertmanager"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377371    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-metric"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377378    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-metric"
Sep 10 23:39:09.377385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377383    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="prom-label-proxy"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="prom-label-proxy"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377398    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377403    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" containerName="console"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377416    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" containerName="console"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377422    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-web"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-web"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377434    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="config-reloader"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377439    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="config-reloader"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377485    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="config-reloader"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377493    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f420b35-3379-4ce8-9ca4-0c62bc08059d" containerName="console"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377499    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="alertmanager"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377505    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-web"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377510    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy-metric"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377516    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="kube-rbac-proxy"
Sep 10 23:39:09.377555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.377521    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" containerName="prom-label-proxy"
Sep 10 23:39:09.382273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.382258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.384759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.384736    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 23:39:09.384926 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.384777    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmn87\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385158    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 23:39:09.385263 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.385151    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 23:39:09.390408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.390385    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 23:39:09.393824 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.393802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:09.447820 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.447791    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5fe6ea-0324-4889-96e1-66002a5adec9" path="/var/lib/kubelet/pods/6a5fe6ea-0324-4889-96e1-66002a5adec9/volumes"
Sep 10 23:39:09.510688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsxhx\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-kube-api-access-gsxhx\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-out\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.510886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.511062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.511062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.510974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.511062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.511020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.511062 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.511053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-web-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.511173 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.511075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxhx\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-kube-api-access-gsxhx\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-out\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.611972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.611975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.612007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.612052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.612091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-web-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.612115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.612540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.612282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.613557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.613408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.613557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.613494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ae6deff-4514-425f-b5fb-d79ae120ad71-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.614893 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.614864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-out\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615208 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-config-volume\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615441 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615532 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615739 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.615865 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.615849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.616688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.616672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.617476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.617459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ae6deff-4514-425f-b5fb-d79ae120ad71-web-config\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.619538 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.619514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxhx\" (UniqueName: \"kubernetes.io/projected/7ae6deff-4514-425f-b5fb-d79ae120ad71-kube-api-access-gsxhx\") pod \"alertmanager-main-0\" (UID: \"7ae6deff-4514-425f-b5fb-d79ae120ad71\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.691693 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.691658    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 23:39:09.969187 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:09.969154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 23:39:09.972525 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:39:09.972485    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae6deff_4514_425f_b5fb_d79ae120ad71.slice/crio-0f13bbe48f63e4c69562f39539937c54b76fc06bfea503f16f1843497d4ed260 WatchSource:0}: Error finding container 0f13bbe48f63e4c69562f39539937c54b76fc06bfea503f16f1843497d4ed260: Status 404 returned error can't find the container with id 0f13bbe48f63e4c69562f39539937c54b76fc06bfea503f16f1843497d4ed260
Sep 10 23:39:10.326557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:10.326467    2581 generic.go:356] "Generic (PLEG): container finished" podID="7ae6deff-4514-425f-b5fb-d79ae120ad71" containerID="0359599d3f4d5c06f9b9c515a9fc1e7e44f2552226d7764117cdce0658bedc3a" exitCode=0
Sep 10 23:39:10.326557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:10.326534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerDied","Data":"0359599d3f4d5c06f9b9c515a9fc1e7e44f2552226d7764117cdce0658bedc3a"}
Sep 10 23:39:10.326712 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:10.326584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"0f13bbe48f63e4c69562f39539937c54b76fc06bfea503f16f1843497d4ed260"}
Sep 10 23:39:11.334155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"0336f1a23d20379a40354de27a4aec1b51268e3ed7c03a7982b31b7a60f04457"}
Sep 10 23:39:11.334631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"0a8d2ce0d8ff1c24353e6d01a024376f7f1ae72265f81e40777230d1e691c78e"}
Sep 10 23:39:11.334631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"0a15dc2731e3e6fe014295d355498159d075ba7b218f393a6c77082aa32aee0a"}
Sep 10 23:39:11.334631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334271    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"164480ad0b0be2b6f4f21dc7dda1e959d2a3adb999dcd1ca565fb724548af9a6"}
Sep 10 23:39:11.334631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"72f091c3ac3a51ce5eb108035060c3548561b0a5690b9ad854fc88587eace5a2"}
Sep 10 23:39:11.334631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.334340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7ae6deff-4514-425f-b5fb-d79ae120ad71","Type":"ContainerStarted","Data":"0398c779247a5b46d5cd9bb9502dc23e4d698ad48a331562a7836d536ad95307"}
Sep 10 23:39:11.360497 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.360445    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.34433689 podStartE2EDuration="2.360429363s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.092473ms" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:11.359279826 +0000 UTC m=+168.458861927" watchObservedRunningTime="2026-09-10 23:39:11.360429363 +0000 UTC m=+168.460011461"
Sep 10 23:39:11.524374 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.524342    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67cf55599b-9kr7w"]
Sep 10 23:39:11.527761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.527745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.530473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.530441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 23:39:11.530593 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.530565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 23:39:11.530593 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.530581    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 23:39:11.530696 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.530567    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dh6v8\""
Sep 10 23:39:11.530933 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.530918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 23:39:11.531191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.531172    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 23:39:11.536650 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.536626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 23:39:11.542155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.542132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cf55599b-9kr7w"]
Sep 10 23:39:11.631437 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631437 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-metrics-client-ca\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631437 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631642 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631642 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-federate-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631642 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-serving-certs-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631642 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxv9\" (UniqueName: \"kubernetes.io/projected/c77f151b-c865-49e8-8113-938b2e488d22-kube-api-access-ddxv9\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.631757 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.631647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.732763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.732725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.732763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.732770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.732975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.732887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-federate-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.732975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.732938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-serving-certs-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.732975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.732965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxv9\" (UniqueName: \"kubernetes.io/projected/c77f151b-c865-49e8-8113-938b2e488d22-kube-api-access-ddxv9\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733124 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733124 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733124 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-metrics-client-ca\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-metrics-client-ca\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733925 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-serving-certs-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.733992 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.733949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.735473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.735446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.735473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.735462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-federate-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.735637 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.735615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-secret-telemeter-client\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.735869 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.735853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c77f151b-c865-49e8-8113-938b2e488d22-telemeter-client-tls\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.740872 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.740850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxv9\" (UniqueName: \"kubernetes.io/projected/c77f151b-c865-49e8-8113-938b2e488d22-kube-api-access-ddxv9\") pod \"telemeter-client-67cf55599b-9kr7w\" (UID: \"c77f151b-c865-49e8-8113-938b2e488d22\") " pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:11.837268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:11.837234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w"
Sep 10 23:39:12.114767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:12.114696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67cf55599b-9kr7w"]
Sep 10 23:39:12.116949 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:39:12.116921    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77f151b_c865_49e8_8113_938b2e488d22.slice/crio-a3c37b461c5999cca9d396eb6c18bdd29a6d775dbd4c29ad01869a2f88abd014 WatchSource:0}: Error finding container a3c37b461c5999cca9d396eb6c18bdd29a6d775dbd4c29ad01869a2f88abd014: Status 404 returned error can't find the container with id a3c37b461c5999cca9d396eb6c18bdd29a6d775dbd4c29ad01869a2f88abd014
Sep 10 23:39:12.339540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:12.339509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w" event={"ID":"c77f151b-c865-49e8-8113-938b2e488d22","Type":"ContainerStarted","Data":"a3c37b461c5999cca9d396eb6c18bdd29a6d775dbd4c29ad01869a2f88abd014"}
Sep 10 23:39:14.352465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.352429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w" event={"ID":"c77f151b-c865-49e8-8113-938b2e488d22","Type":"ContainerStarted","Data":"480e0701cac56e6596793fb38c0617288185eb706dd654c481c17f7b71e0c1c0"}
Sep 10 23:39:14.352886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.352487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w" event={"ID":"c77f151b-c865-49e8-8113-938b2e488d22","Type":"ContainerStarted","Data":"725c0af98a6115e2d9ab0bf37bbc024c4d84b06cbe1eba12ee70d80e517998cc"}
Sep 10 23:39:14.352886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.352505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w" event={"ID":"c77f151b-c865-49e8-8113-938b2e488d22","Type":"ContainerStarted","Data":"9bb00b57d46cc32b70e34689677681289b6bb58f0eb4acc90abcf0c8bf9d2c11"}
Sep 10 23:39:14.372611 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.372563    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67cf55599b-9kr7w" podStartSLOduration=1.843819654 podStartE2EDuration="3.372548659s" totalImagesPullingTime="1.528729005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:14.371502132 +0000 UTC m=+171.471084233" watchObservedRunningTime="2026-09-10 23:39:14.372548659 +0000 UTC m=+171.472130762"
Sep 10 23:39:14.454568 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.454539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:39:14.457804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.457783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.469281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.469260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:39:14.559465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf5d5\" (UniqueName: \"kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.559809 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.559628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.660696 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.660821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.660821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.660821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.660821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5d5\" (UniqueName: \"kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.660987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661644 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.661569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.661720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.661722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.661852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.661778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.663334 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.663316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.663432 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.663370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.667900 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.667873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5d5\" (UniqueName: \"kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5\") pod \"console-76786fccd8-6z8s2\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") " pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:14.766636 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:14.766607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:15.035383 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:15.035321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:39:15.037591 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:39:15.037565    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f5d927_9312_4fe9_8f18_4adb696f8d08.slice/crio-387d8634b878e4771b26a5b3e73ae2d179a947ae49020b05a4edf38e1f4dda42 WatchSource:0}: Error finding container 387d8634b878e4771b26a5b3e73ae2d179a947ae49020b05a4edf38e1f4dda42: Status 404 returned error can't find the container with id 387d8634b878e4771b26a5b3e73ae2d179a947ae49020b05a4edf38e1f4dda42
Sep 10 23:39:15.358657 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:15.358551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76786fccd8-6z8s2" event={"ID":"65f5d927-9312-4fe9-8f18-4adb696f8d08","Type":"ContainerStarted","Data":"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"}
Sep 10 23:39:15.358657 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:15.358611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76786fccd8-6z8s2" event={"ID":"65f5d927-9312-4fe9-8f18-4adb696f8d08","Type":"ContainerStarted","Data":"387d8634b878e4771b26a5b3e73ae2d179a947ae49020b05a4edf38e1f4dda42"}
Sep 10 23:39:15.374779 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:15.374724    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76786fccd8-6z8s2" podStartSLOduration=1.374706076 podStartE2EDuration="1.374706076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:39:15.37371362 +0000 UTC m=+172.473295722" watchObservedRunningTime="2026-09-10 23:39:15.374706076 +0000 UTC m=+172.474288178"
Sep 10 23:39:24.767589 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:24.767554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:24.768007 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:24.767619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:24.772564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:24.772538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:25.401986 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:25.401957    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:39:25.449407 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:25.449376    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:39:50.469511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.469475    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59487c99b8-qpswh" podUID="1270128c-e4c5-4581-8ce2-a66ffd169c99" containerName="console" containerID="cri-o://52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b" gracePeriod=15
Sep 10 23:39:50.707479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.707453    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:39:50.783357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg4jx\" (UniqueName: \"kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783439    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert\") pod \"1270128c-e4c5-4581-8ce2-a66ffd169c99\" (UID: \"1270128c-e4c5-4581-8ce2-a66ffd169c99\") "
Sep 10 23:39:50.783813 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config" (OuterVolumeSpecName: "console-config") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:50.783905 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca" (OuterVolumeSpecName: "service-ca") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:50.783965 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.783895    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:50.784029 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.784003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:39:50.785781 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.785752    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:50.785884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.785787    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:39:50.785884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.785794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx" (OuterVolumeSpecName: "kube-api-access-fg4jx") pod "1270128c-e4c5-4581-8ce2-a66ffd169c99" (UID: "1270128c-e4c5-4581-8ce2-a66ffd169c99"). InnerVolumeSpecName "kube-api-access-fg4jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:39:50.884250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884210    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884241    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884256    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-trusted-ca-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884268    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-oauth-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884280    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg4jx\" (UniqueName: \"kubernetes.io/projected/1270128c-e4c5-4581-8ce2-a66ffd169c99-kube-api-access-fg4jx\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884325    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1270128c-e4c5-4581-8ce2-a66ffd169c99-console-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:50.884522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:50.884335    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1270128c-e4c5-4581-8ce2-a66ffd169c99-oauth-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:39:51.498131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.498099    2581 generic.go:356] "Generic (PLEG): container finished" podID="1270128c-e4c5-4581-8ce2-a66ffd169c99" containerID="52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b" exitCode=0
Sep 10 23:39:51.498539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.498138    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59487c99b8-qpswh"
Sep 10 23:39:51.498539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.498179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59487c99b8-qpswh" event={"ID":"1270128c-e4c5-4581-8ce2-a66ffd169c99","Type":"ContainerDied","Data":"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"}
Sep 10 23:39:51.498539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.498234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59487c99b8-qpswh" event={"ID":"1270128c-e4c5-4581-8ce2-a66ffd169c99","Type":"ContainerDied","Data":"a4d89ac07e0abcc582f7ddcf685d6388e756a3fbf20ebeafce2f3f9bc9a0636b"}
Sep 10 23:39:51.498539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.498255    2581 scope.go:117] "RemoveContainer" containerID="52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"
Sep 10 23:39:51.506752 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.506736    2581 scope.go:117] "RemoveContainer" containerID="52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"
Sep 10 23:39:51.507017 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:39:51.506996    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b\": container with ID starting with 52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b not found: ID does not exist" containerID="52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"
Sep 10 23:39:51.507079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.507026    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b"} err="failed to get container status \"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b\": rpc error: code = NotFound desc = could not find container \"52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b\": container with ID starting with 52b6064acda5d340edcbec56645e4233bc80679c9751077e6c92bbc8644c163b not found: ID does not exist"
Sep 10 23:39:51.514799 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.514774    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:39:51.518214 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:51.518192    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59487c99b8-qpswh"]
Sep 10 23:39:53.452205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:39:53.452169    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1270128c-e4c5-4581-8ce2-a66ffd169c99" path="/var/lib/kubelet/pods/1270128c-e4c5-4581-8ce2-a66ffd169c99/volumes"
Sep 10 23:40:47.621733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.621659    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:40:47.622154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.621992    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1270128c-e4c5-4581-8ce2-a66ffd169c99" containerName="console"
Sep 10 23:40:47.622154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.622006    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1270128c-e4c5-4581-8ce2-a66ffd169c99" containerName="console"
Sep 10 23:40:47.622154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.622071    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1270128c-e4c5-4581-8ce2-a66ffd169c99" containerName="console"
Sep 10 23:40:47.625012 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.624995    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.634767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.634738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:40:47.666907 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.666876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.666913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.666940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.666969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.666985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.667004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.667081 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.667027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92khn\" (UniqueName: \"kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.767759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.767759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.767759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92khn\" (UniqueName: \"kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.767960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.768005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.768608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768738 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.768682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768849 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.768826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.768943 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.768923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.770447 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.770427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.770565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.770548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.775994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.775975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92khn\" (UniqueName: \"kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn\") pod \"console-684cbdf6fd-47kb9\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") " pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:47.933867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:47.933830    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:48.206427 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:48.206402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:40:48.208334 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:40:48.208309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ed237d_6628_4e86_b531_039bb096cd35.slice/crio-fd379c968b380050372d47e2320f83328910365e9e1293fea1fc4288166bdc6c WatchSource:0}: Error finding container fd379c968b380050372d47e2320f83328910365e9e1293fea1fc4288166bdc6c: Status 404 returned error can't find the container with id fd379c968b380050372d47e2320f83328910365e9e1293fea1fc4288166bdc6c
Sep 10 23:40:48.726440 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:48.726404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cbdf6fd-47kb9" event={"ID":"e6ed237d-6628-4e86-b531-039bb096cd35","Type":"ContainerStarted","Data":"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"}
Sep 10 23:40:48.726858 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:48.726450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cbdf6fd-47kb9" event={"ID":"e6ed237d-6628-4e86-b531-039bb096cd35","Type":"ContainerStarted","Data":"fd379c968b380050372d47e2320f83328910365e9e1293fea1fc4288166bdc6c"}
Sep 10 23:40:48.746490 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:48.746442    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684cbdf6fd-47kb9" podStartSLOduration=1.746425673 podStartE2EDuration="1.746425673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:40:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:40:48.744843042 +0000 UTC m=+265.844425155" watchObservedRunningTime="2026-09-10 23:40:48.746425673 +0000 UTC m=+265.846007774"
Sep 10 23:40:57.934224 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:57.934176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:57.934224 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:57.934243    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:57.939122 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:57.939102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:58.768122 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:58.768095    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:40:58.824800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:40:58.824768    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:41:23.312859 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:23.312822    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 23:41:23.850122 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:23.850063    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76786fccd8-6z8s2" podUID="65f5d927-9312-4fe9-8f18-4adb696f8d08" containerName="console" containerID="cri-o://29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc" gracePeriod=15
Sep 10 23:41:24.109479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.109396    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:41:24.179529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179541    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf5d5\" (UniqueName: \"kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179814 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179814 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.179920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.179855    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert\") pod \"65f5d927-9312-4fe9-8f18-4adb696f8d08\" (UID: \"65f5d927-9312-4fe9-8f18-4adb696f8d08\") "
Sep 10 23:41:24.180048 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.180016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca" (OuterVolumeSpecName: "service-ca") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:41:24.180180 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.180163    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.180240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.180161    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:41:24.180240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.180205    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:41:24.180427 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.180303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config" (OuterVolumeSpecName: "console-config") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:41:24.181953 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.181930    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5" (OuterVolumeSpecName: "kube-api-access-gf5d5") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "kube-api-access-gf5d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:24.182014 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.181974    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:41:24.182116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.182099    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "65f5d927-9312-4fe9-8f18-4adb696f8d08" (UID: "65f5d927-9312-4fe9-8f18-4adb696f8d08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:41:24.281038 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281000    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.281038 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281032    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.281038 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281043    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65f5d927-9312-4fe9-8f18-4adb696f8d08-console-oauth-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.281268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281052    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf5d5\" (UniqueName: \"kubernetes.io/projected/65f5d927-9312-4fe9-8f18-4adb696f8d08-kube-api-access-gf5d5\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.281268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281061    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-trusted-ca-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.281268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.281070    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65f5d927-9312-4fe9-8f18-4adb696f8d08-oauth-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:24.874741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.874709    2581 generic.go:356] "Generic (PLEG): container finished" podID="65f5d927-9312-4fe9-8f18-4adb696f8d08" containerID="29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc" exitCode=0
Sep 10 23:41:24.875142 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.874762    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76786fccd8-6z8s2"
Sep 10 23:41:24.875142 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.874806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76786fccd8-6z8s2" event={"ID":"65f5d927-9312-4fe9-8f18-4adb696f8d08","Type":"ContainerDied","Data":"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"}
Sep 10 23:41:24.875142 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.874858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76786fccd8-6z8s2" event={"ID":"65f5d927-9312-4fe9-8f18-4adb696f8d08","Type":"ContainerDied","Data":"387d8634b878e4771b26a5b3e73ae2d179a947ae49020b05a4edf38e1f4dda42"}
Sep 10 23:41:24.875142 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.874878    2581 scope.go:117] "RemoveContainer" containerID="29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"
Sep 10 23:41:24.883696 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.883677    2581 scope.go:117] "RemoveContainer" containerID="29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"
Sep 10 23:41:24.884021 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:41:24.884002    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc\": container with ID starting with 29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc not found: ID does not exist" containerID="29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"
Sep 10 23:41:24.884087 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.884032    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc"} err="failed to get container status \"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc\": rpc error: code = NotFound desc = could not find container \"29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc\": container with ID starting with 29ad651af5350d886b2fd3df51d407da27b7eeb79253753375efbe4e6f4391bc not found: ID does not exist"
Sep 10 23:41:24.894574 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.894544    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:41:24.898596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:24.898563    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76786fccd8-6z8s2"]
Sep 10 23:41:25.448329 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:25.448273    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65f5d927-9312-4fe9-8f18-4adb696f8d08" path="/var/lib/kubelet/pods/65f5d927-9312-4fe9-8f18-4adb696f8d08/volumes"
Sep 10 23:41:26.032605 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.032571    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"]
Sep 10 23:41:26.033106 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.033030    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f5d927-9312-4fe9-8f18-4adb696f8d08" containerName="console"
Sep 10 23:41:26.033106 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.033050    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f5d927-9312-4fe9-8f18-4adb696f8d08" containerName="console"
Sep 10 23:41:26.033223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.033132    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f5d927-9312-4fe9-8f18-4adb696f8d08" containerName="console"
Sep 10 23:41:26.037564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.037542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.039727 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.039709    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:41:26.040505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.040485    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:41:26.040610 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.040510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n9p52\""
Sep 10 23:41:26.046934 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.046905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"]
Sep 10 23:41:26.096673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.096612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.096673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.096674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxsm8\" (UniqueName: \"kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.096885 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.096776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.197725 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.197682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.197725 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.197725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsm8\" (UniqueName: \"kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.197938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.197789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.198095 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.198076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.198137 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.198124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.206431 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.206408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxsm8\" (UniqueName: \"kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.347591 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.347503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:26.615696 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.615628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"]
Sep 10 23:41:26.618235 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:41:26.618208    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0714d3f0_edd2_421d_9940_91fb7b1c541d.slice/crio-fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c WatchSource:0}: Error finding container fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c: Status 404 returned error can't find the container with id fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c
Sep 10 23:41:26.620240 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.620224    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:41:26.885100 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:26.885013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd" event={"ID":"0714d3f0-edd2-421d-9940-91fb7b1c541d","Type":"ContainerStarted","Data":"fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c"}
Sep 10 23:41:32.913438 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:32.913401    2581 generic.go:356] "Generic (PLEG): container finished" podID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerID="c981199da30492b0d0138c59ced1135fbffe44812b9a10aca85c1cefb0c17599" exitCode=0
Sep 10 23:41:32.913916 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:32.913463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd" event={"ID":"0714d3f0-edd2-421d-9940-91fb7b1c541d","Type":"ContainerDied","Data":"c981199da30492b0d0138c59ced1135fbffe44812b9a10aca85c1cefb0c17599"}
Sep 10 23:41:34.924041 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:34.924010    2581 generic.go:356] "Generic (PLEG): container finished" podID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerID="a0954945905bf05e80f428c5ddac559dd26635bf78944ee8b25f2a3b840a9165" exitCode=0
Sep 10 23:41:34.924459 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:34.924059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd" event={"ID":"0714d3f0-edd2-421d-9940-91fb7b1c541d","Type":"ContainerDied","Data":"a0954945905bf05e80f428c5ddac559dd26635bf78944ee8b25f2a3b840a9165"}
Sep 10 23:41:41.959991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:41.959950    2581 generic.go:356] "Generic (PLEG): container finished" podID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerID="cee41b625e6cf90c5592a63906ecc33e29893cdd60341fc58a0b40e47f9443f0" exitCode=0
Sep 10 23:41:41.960380 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:41.959998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd" event={"ID":"0714d3f0-edd2-421d-9940-91fb7b1c541d","Type":"ContainerDied","Data":"cee41b625e6cf90c5592a63906ecc33e29893cdd60341fc58a0b40e47f9443f0"}
Sep 10 23:41:43.087427 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.087397    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:43.152082 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.152047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxsm8\" (UniqueName: \"kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8\") pod \"0714d3f0-edd2-421d-9940-91fb7b1c541d\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") "
Sep 10 23:41:43.152082 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.152088    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util\") pod \"0714d3f0-edd2-421d-9940-91fb7b1c541d\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") "
Sep 10 23:41:43.152365 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.152124    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle\") pod \"0714d3f0-edd2-421d-9940-91fb7b1c541d\" (UID: \"0714d3f0-edd2-421d-9940-91fb7b1c541d\") "
Sep 10 23:41:43.152799 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.152772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle" (OuterVolumeSpecName: "bundle") pod "0714d3f0-edd2-421d-9940-91fb7b1c541d" (UID: "0714d3f0-edd2-421d-9940-91fb7b1c541d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:43.154430 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.154406    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8" (OuterVolumeSpecName: "kube-api-access-jxsm8") pod "0714d3f0-edd2-421d-9940-91fb7b1c541d" (UID: "0714d3f0-edd2-421d-9940-91fb7b1c541d"). InnerVolumeSpecName "kube-api-access-jxsm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:41:43.157099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.157071    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util" (OuterVolumeSpecName: "util") pod "0714d3f0-edd2-421d-9940-91fb7b1c541d" (UID: "0714d3f0-edd2-421d-9940-91fb7b1c541d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:41:43.253564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.253476    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxsm8\" (UniqueName: \"kubernetes.io/projected/0714d3f0-edd2-421d-9940-91fb7b1c541d-kube-api-access-jxsm8\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:43.253564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.253505    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:43.253564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.253514    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0714d3f0-edd2-421d-9940-91fb7b1c541d-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:41:43.970534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.970500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd" event={"ID":"0714d3f0-edd2-421d-9940-91fb7b1c541d","Type":"ContainerDied","Data":"fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c"}
Sep 10 23:41:43.970534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.970519    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405vxzd"
Sep 10 23:41:43.970731 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:43.970545    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdc0585e958cd6ba0daf6136c63757fcbcf17f42b0d87c7af6e59099a84e0c2c"
Sep 10 23:41:49.080058 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080023    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"]
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080400    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="util"
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080413    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="util"
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080438    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="pull"
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080444    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="pull"
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080449    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="extract"
Sep 10 23:41:49.080482 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080455    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="extract"
Sep 10 23:41:49.080693 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.080506    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0714d3f0-edd2-421d-9940-91fb7b1c541d" containerName="extract"
Sep 10 23:41:49.105160 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.105129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"]
Sep 10 23:41:49.105327 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.105244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.107754 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.107727    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:41:49.107872 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.107731    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 23:41:49.107872 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.107793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ph7bd\""
Sep 10 23:41:49.203675 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.203634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4l2v\" (UniqueName: \"kubernetes.io/projected/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-kube-api-access-t4l2v\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.203864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.203697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.304189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.304150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4l2v\" (UniqueName: \"kubernetes.io/projected/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-kube-api-access-t4l2v\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.304189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.304195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.304588 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.304570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.313461 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.313441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4l2v\" (UniqueName: \"kubernetes.io/projected/5e31c1b3-189b-42ab-85fc-3690cd57f4fe-kube-api-access-t4l2v\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzllr\" (UID: \"5e31c1b3-189b-42ab-85fc-3690cd57f4fe\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.415560 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.415525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"
Sep 10 23:41:49.702116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.702090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr"]
Sep 10 23:41:49.705116 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:41:49.705088    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e31c1b3_189b_42ab_85fc_3690cd57f4fe.slice/crio-cd2e766b57a2266656f74d7ffe9ab8481278208515289b3185b9c1794c38523b WatchSource:0}: Error finding container cd2e766b57a2266656f74d7ffe9ab8481278208515289b3185b9c1794c38523b: Status 404 returned error can't find the container with id cd2e766b57a2266656f74d7ffe9ab8481278208515289b3185b9c1794c38523b
Sep 10 23:41:49.997973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:49.997884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr" event={"ID":"5e31c1b3-189b-42ab-85fc-3690cd57f4fe","Type":"ContainerStarted","Data":"cd2e766b57a2266656f74d7ffe9ab8481278208515289b3185b9c1794c38523b"}
Sep 10 23:41:52.009404 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:52.009368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr" event={"ID":"5e31c1b3-189b-42ab-85fc-3690cd57f4fe","Type":"ContainerStarted","Data":"e52c4b1508e11717f359b1e47a8978a1e0feee2621c3d7dc16625168cebfcda6"}
Sep 10 23:41:53.009018 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.008971    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzllr" podStartSLOduration=2.599358403 podStartE2EDuration="4.008953681s" totalImagesPullingTime="1.409595278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:52.071330164 +0000 UTC m=+329.170912267" watchObservedRunningTime="2026-09-10 23:41:53.008953681 +0000 UTC m=+330.108535783"
Sep 10 23:41:53.009178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.009097    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x5qr"]
Sep 10 23:41:53.012758 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.012734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.031225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.031200    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 23:41:53.031373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.031282    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 23:41:53.032216 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.032199    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2df87\""
Sep 10 23:41:53.051091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.051050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x5qr"]
Sep 10 23:41:53.137435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.137395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.137629 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.137498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k7kx\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-kube-api-access-9k7kx\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.238632 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.238599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k7kx\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-kube-api-access-9k7kx\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.238791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.238663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.282401 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.282334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k7kx\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-kube-api-access-9k7kx\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.282687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.282670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010c3221-7c2d-4162-8999-3fa1505fc3ee-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x5qr\" (UID: \"010c3221-7c2d-4162-8999-3fa1505fc3ee\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.330694 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.330661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:53.640372 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:53.640206    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x5qr"]
Sep 10 23:41:53.642993 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:41:53.642952    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod010c3221_7c2d_4162_8999_3fa1505fc3ee.slice/crio-cf15005ea08287fcfa68115786aa155a7c24b3f4ef275bc764720b44d511cedb WatchSource:0}: Error finding container cf15005ea08287fcfa68115786aa155a7c24b3f4ef275bc764720b44d511cedb: Status 404 returned error can't find the container with id cf15005ea08287fcfa68115786aa155a7c24b3f4ef275bc764720b44d511cedb
Sep 10 23:41:54.021560 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:54.021515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr" event={"ID":"010c3221-7c2d-4162-8999-3fa1505fc3ee","Type":"ContainerStarted","Data":"cf15005ea08287fcfa68115786aa155a7c24b3f4ef275bc764720b44d511cedb"}
Sep 10 23:41:57.037390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:57.037350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr" event={"ID":"010c3221-7c2d-4162-8999-3fa1505fc3ee","Type":"ContainerStarted","Data":"0f56b525d5842523a2696f28b617b17df8701460c6b7579258b0068f3c2dd73d"}
Sep 10 23:41:57.037888 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:57.037441    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:41:57.053814 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:41:57.053767    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr" podStartSLOduration=2.405452344 podStartE2EDuration="5.05375198s" totalImagesPullingTime="2.648299636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:41:57.052780202 +0000 UTC m=+334.152362303" watchObservedRunningTime="2026-09-10 23:41:57.05375198 +0000 UTC m=+334.153334081"
Sep 10 23:42:02.458304 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.458236    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67vln"]
Sep 10 23:42:02.461878 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.461854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.464217 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.464193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-chtvq\""
Sep 10 23:42:02.471537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.471515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67vln"]
Sep 10 23:42:02.623256 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.623224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbcms\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-kube-api-access-hbcms\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.623256 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.623259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-bound-sa-token\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.724256 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.724145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbcms\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-kube-api-access-hbcms\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.724256 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.724197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-bound-sa-token\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.735413 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.735386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbcms\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-kube-api-access-hbcms\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.735902 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.735879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48846cfd-0d47-45a3-bf9a-3a48a35dd9b9-bound-sa-token\") pod \"cert-manager-55b4d954d5-67vln\" (UID: \"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9\") " pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:02.770974 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:02.770941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-67vln"
Sep 10 23:42:03.043829 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:03.043750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9x5qr"
Sep 10 23:42:03.046535 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:03.046510    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67vln"]
Sep 10 23:42:03.049232 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:42:03.049202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48846cfd_0d47_45a3_bf9a_3a48a35dd9b9.slice/crio-b319b775b2d75e3d702a475d9953fb09f24746d44d78539b4ff4a7822609b89d WatchSource:0}: Error finding container b319b775b2d75e3d702a475d9953fb09f24746d44d78539b4ff4a7822609b89d: Status 404 returned error can't find the container with id b319b775b2d75e3d702a475d9953fb09f24746d44d78539b4ff4a7822609b89d
Sep 10 23:42:03.069125 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:03.069088    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-67vln" event={"ID":"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9","Type":"ContainerStarted","Data":"b319b775b2d75e3d702a475d9953fb09f24746d44d78539b4ff4a7822609b89d"}
Sep 10 23:42:04.075486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:04.075441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-67vln" event={"ID":"48846cfd-0d47-45a3-bf9a-3a48a35dd9b9","Type":"ContainerStarted","Data":"7e327be9f2ae9064fd58be35c1e07b2dabcf2057af7bd11de057483cefa43c63"}
Sep 10 23:42:04.092272 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:04.092219    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-67vln" podStartSLOduration=2.092203163 podStartE2EDuration="2.092203163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:04.091389205 +0000 UTC m=+341.190971296" watchObservedRunningTime="2026-09-10 23:42:04.092203163 +0000 UTC m=+341.191785264"
Sep 10 23:42:22.804063 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.803982    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"]
Sep 10 23:42:22.808486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.808469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.810761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.810736    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n9p52\""
Sep 10 23:42:22.810891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.810862    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:42:22.811522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.811504    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:42:22.815188 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.815155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"]
Sep 10 23:42:22.891641 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.891586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.891822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.891701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwx4k\" (UniqueName: \"kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.891822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.891741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.992195 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.992157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.992387 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.992241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwx4k\" (UniqueName: \"kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.992387 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.992302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.992625 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.992607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:22.992709 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:22.992648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:23.001978 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:23.001947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwx4k\" (UniqueName: \"kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:23.119400 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:23.119281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:23.414615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:23.414582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"]
Sep 10 23:42:23.418642 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:42:23.418604    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddbf59d_51a1_412a_98d3_bfae965a6af9.slice/crio-ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922 WatchSource:0}: Error finding container ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922: Status 404 returned error can't find the container with id ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922
Sep 10 23:42:24.163030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:24.162997    2581 generic.go:356] "Generic (PLEG): container finished" podID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerID="cf1b5faf3c1365267b41898182d7f4810ef918e4af349318651684e71209c531" exitCode=0
Sep 10 23:42:24.163419 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:24.163052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9" event={"ID":"0ddbf59d-51a1-412a-98d3-bfae965a6af9","Type":"ContainerDied","Data":"cf1b5faf3c1365267b41898182d7f4810ef918e4af349318651684e71209c531"}
Sep 10 23:42:24.163419 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:24.163085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9" event={"ID":"0ddbf59d-51a1-412a-98d3-bfae965a6af9","Type":"ContainerStarted","Data":"ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922"}
Sep 10 23:42:25.169563 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:25.169522    2581 generic.go:356] "Generic (PLEG): container finished" podID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerID="445c2e2e2e80a01f7ff3beb16401cc14179a0202290f6a02abeb67367a763e60" exitCode=0
Sep 10 23:42:25.169967 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:25.169641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9" event={"ID":"0ddbf59d-51a1-412a-98d3-bfae965a6af9","Type":"ContainerDied","Data":"445c2e2e2e80a01f7ff3beb16401cc14179a0202290f6a02abeb67367a763e60"}
Sep 10 23:42:26.176602 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:26.176561    2581 generic.go:356] "Generic (PLEG): container finished" podID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerID="f2f373891339e2e67df367aab620998e0297ef256124daeb2d0571ac61d0d6a0" exitCode=0
Sep 10 23:42:26.176973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:26.176627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9" event={"ID":"0ddbf59d-51a1-412a-98d3-bfae965a6af9","Type":"ContainerDied","Data":"f2f373891339e2e67df367aab620998e0297ef256124daeb2d0571ac61d0d6a0"}
Sep 10 23:42:27.311950 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.311922    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:27.431079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.430961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util\") pod \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") "
Sep 10 23:42:27.431079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.431017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwx4k\" (UniqueName: \"kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k\") pod \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") "
Sep 10 23:42:27.431079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.431063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle\") pod \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\" (UID: \"0ddbf59d-51a1-412a-98d3-bfae965a6af9\") "
Sep 10 23:42:27.431896 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.431852    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle" (OuterVolumeSpecName: "bundle") pod "0ddbf59d-51a1-412a-98d3-bfae965a6af9" (UID: "0ddbf59d-51a1-412a-98d3-bfae965a6af9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:42:27.433518 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.433489    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k" (OuterVolumeSpecName: "kube-api-access-pwx4k") pod "0ddbf59d-51a1-412a-98d3-bfae965a6af9" (UID: "0ddbf59d-51a1-412a-98d3-bfae965a6af9"). InnerVolumeSpecName "kube-api-access-pwx4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:27.436913 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.436878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util" (OuterVolumeSpecName: "util") pod "0ddbf59d-51a1-412a-98d3-bfae965a6af9" (UID: "0ddbf59d-51a1-412a-98d3-bfae965a6af9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:42:27.532378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.532339    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:27.532378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.532371    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ddbf59d-51a1-412a-98d3-bfae965a6af9-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:27.532378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:27.532382    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwx4k\" (UniqueName: \"kubernetes.io/projected/0ddbf59d-51a1-412a-98d3-bfae965a6af9-kube-api-access-pwx4k\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:28.187241 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:28.187205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9" event={"ID":"0ddbf59d-51a1-412a-98d3-bfae965a6af9","Type":"ContainerDied","Data":"ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922"}
Sep 10 23:42:28.187241 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:28.187222    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpcpl9"
Sep 10 23:42:28.187479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:28.187257    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae93d77b5181ea9c9f49fa8c900ab98b17d386c5248422dd8e80c22cb30ce922"
Sep 10 23:42:36.814746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.814704    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"]
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815017    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="util"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815028    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="util"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815042    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="pull"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815047    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="pull"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815059    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="extract"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815065    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="extract"
Sep 10 23:42:36.815171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.815116    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddbf59d-51a1-412a-98d3-bfae965a6af9" containerName="extract"
Sep 10 23:42:36.819248 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.819228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:36.821960 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.821933    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:42:36.822963 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.822947    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:42:36.823021 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.822966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n9p52\""
Sep 10 23:42:36.827014 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.826968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"]
Sep 10 23:42:36.923025 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.922983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkc6\" (UniqueName: \"kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:36.923205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.923034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:36.923205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:36.923121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.023719 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.023689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.023857 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.023738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkc6\" (UniqueName: \"kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.023857 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.023764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.024116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.024101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.024154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.024098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.033251 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.033224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkc6\" (UniqueName: \"kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.130467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.130378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:37.400996 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:37.400856    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"]
Sep 10 23:42:37.403399 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:42:37.403374    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42933c0d_f9ea_416a_8c0e_f011e14f3f91.slice/crio-4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137 WatchSource:0}: Error finding container 4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137: Status 404 returned error can't find the container with id 4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137
Sep 10 23:42:38.233039 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.233007    2581 generic.go:356] "Generic (PLEG): container finished" podID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerID="4d152666089c34bbd519a41c4fa44c3c6d3f330a06c13cf7d9024dd1af0bb8fb" exitCode=0
Sep 10 23:42:38.233430 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.233055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x" event={"ID":"42933c0d-f9ea-416a-8c0e-f011e14f3f91","Type":"ContainerDied","Data":"4d152666089c34bbd519a41c4fa44c3c6d3f330a06c13cf7d9024dd1af0bb8fb"}
Sep 10 23:42:38.233430 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.233089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x" event={"ID":"42933c0d-f9ea-416a-8c0e-f011e14f3f91","Type":"ContainerStarted","Data":"4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137"}
Sep 10 23:42:38.870396 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.870370    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"]
Sep 10 23:42:38.873673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.873656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:38.876419 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.876273    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 23:42:38.876419 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.876269    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zkqzc\""
Sep 10 23:42:38.876419 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.876357    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 23:42:38.876631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.876599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 23:42:38.876688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.876672    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 23:42:38.894928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:38.894895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"]
Sep 10 23:42:39.044406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.044365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.044406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.044407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpc6\" (UniqueName: \"kubernetes.io/projected/dd3e35f7-11d7-495d-8c75-90e084240173-kube-api-access-ljpc6\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.044631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.044434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.044631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.044498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-tmp\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.044631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.044574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-manifests\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.145685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.145601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.145685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.145639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpc6\" (UniqueName: \"kubernetes.io/projected/dd3e35f7-11d7-495d-8c75-90e084240173-kube-api-access-ljpc6\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.145685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.145676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.146031 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.145714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-tmp\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.146031 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.145765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-manifests\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.146310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.146261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-manifests\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.148309 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.148258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3e35f7-11d7-495d-8c75-90e084240173-tmp\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.148370 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.148266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.148418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.148402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd3e35f7-11d7-495d-8c75-90e084240173-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.158791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.158765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpc6\" (UniqueName: \"kubernetes.io/projected/dd3e35f7-11d7-495d-8c75-90e084240173-kube-api-access-ljpc6\") pod \"opendatahub-operator-controller-manager-5bb6f54779-q4nfr\" (UID: \"dd3e35f7-11d7-495d-8c75-90e084240173\") " pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.185824 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.185796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:39.242519 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.242484    2581 generic.go:356] "Generic (PLEG): container finished" podID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerID="5676c3215ad247aef7a8bbb02283dbc567932187ee9c44acc8816a00f4283a8a" exitCode=0
Sep 10 23:42:39.242890 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.242571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x" event={"ID":"42933c0d-f9ea-416a-8c0e-f011e14f3f91","Type":"ContainerDied","Data":"5676c3215ad247aef7a8bbb02283dbc567932187ee9c44acc8816a00f4283a8a"}
Sep 10 23:42:39.461168 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:39.461145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"]
Sep 10 23:42:39.463740 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:42:39.463702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3e35f7_11d7_495d_8c75_90e084240173.slice/crio-7fef565917fa4a5e3eab4dc8c70efd23b6638e770934f488cbb7d526e4a65753 WatchSource:0}: Error finding container 7fef565917fa4a5e3eab4dc8c70efd23b6638e770934f488cbb7d526e4a65753: Status 404 returned error can't find the container with id 7fef565917fa4a5e3eab4dc8c70efd23b6638e770934f488cbb7d526e4a65753
Sep 10 23:42:40.251096 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:40.251051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr" event={"ID":"dd3e35f7-11d7-495d-8c75-90e084240173","Type":"ContainerStarted","Data":"7fef565917fa4a5e3eab4dc8c70efd23b6638e770934f488cbb7d526e4a65753"}
Sep 10 23:42:40.254067 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:40.253917    2581 generic.go:356] "Generic (PLEG): container finished" podID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerID="a9963bb2bde328c5e66920ace808d5f147df124c42d8a13abcc9815c835fbdb1" exitCode=0
Sep 10 23:42:40.254067 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:40.254000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x" event={"ID":"42933c0d-f9ea-416a-8c0e-f011e14f3f91","Type":"ContainerDied","Data":"a9963bb2bde328c5e66920ace808d5f147df124c42d8a13abcc9815c835fbdb1"}
Sep 10 23:42:42.352432 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.352407    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:42.477023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.476996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle\") pod \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") "
Sep 10 23:42:42.477178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.477054    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wkc6\" (UniqueName: \"kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6\") pod \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") "
Sep 10 23:42:42.477178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.477134    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util\") pod \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\" (UID: \"42933c0d-f9ea-416a-8c0e-f011e14f3f91\") "
Sep 10 23:42:42.477812 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.477770    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle" (OuterVolumeSpecName: "bundle") pod "42933c0d-f9ea-416a-8c0e-f011e14f3f91" (UID: "42933c0d-f9ea-416a-8c0e-f011e14f3f91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:42:42.479305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.479268    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6" (OuterVolumeSpecName: "kube-api-access-4wkc6") pod "42933c0d-f9ea-416a-8c0e-f011e14f3f91" (UID: "42933c0d-f9ea-416a-8c0e-f011e14f3f91"). InnerVolumeSpecName "kube-api-access-4wkc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:42:42.482499 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.482478    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util" (OuterVolumeSpecName: "util") pod "42933c0d-f9ea-416a-8c0e-f011e14f3f91" (UID: "42933c0d-f9ea-416a-8c0e-f011e14f3f91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:42:42.577911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.577870    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:42.577911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.577902    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42933c0d-f9ea-416a-8c0e-f011e14f3f91-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:42.577911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:42.577914    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wkc6\" (UniqueName: \"kubernetes.io/projected/42933c0d-f9ea-416a-8c0e-f011e14f3f91-kube-api-access-4wkc6\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:42:43.270986 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:43.270958    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x"
Sep 10 23:42:43.271140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:43.270995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ltv7x" event={"ID":"42933c0d-f9ea-416a-8c0e-f011e14f3f91","Type":"ContainerDied","Data":"4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137"}
Sep 10 23:42:43.271140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:43.271040    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a1a6c6561b9701925a1445830d01fee09585c58b8fd3e2e1f88e37cb53ea137"
Sep 10 23:42:43.272826 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:43.272802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr" event={"ID":"dd3e35f7-11d7-495d-8c75-90e084240173","Type":"ContainerStarted","Data":"e4b0e0a60da8a5f99b7ee4d5afb1b8469651a68cbaf15edce6bd66f3a6cd4bd0"}
Sep 10 23:42:44.279420 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:44.279382    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd3e35f7-11d7-495d-8c75-90e084240173" containerID="e4b0e0a60da8a5f99b7ee4d5afb1b8469651a68cbaf15edce6bd66f3a6cd4bd0" exitCode=0
Sep 10 23:42:44.279814 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:44.279469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr" event={"ID":"dd3e35f7-11d7-495d-8c75-90e084240173","Type":"ContainerDied","Data":"e4b0e0a60da8a5f99b7ee4d5afb1b8469651a68cbaf15edce6bd66f3a6cd4bd0"}
Sep 10 23:42:45.286641 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:45.286610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr" event={"ID":"dd3e35f7-11d7-495d-8c75-90e084240173","Type":"ContainerStarted","Data":"29252efa26356a0a200cacc528162c8dcda766b6fb410c4c24edc636362e7bca"}
Sep 10 23:42:45.287023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:45.286732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:45.310139 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:45.310086    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr" podStartSLOduration=2.869680906 podStartE2EDuration="7.310067548s" totalImagesPullingTime="3.405210189s" totalInitContainerRuntime="1.035176453s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:42:45.307326072 +0000 UTC m=+382.406908175" watchObservedRunningTime="2026-09-10 23:42:45.310067548 +0000 UTC m=+382.409649651"
Sep 10 23:42:56.293759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:56.293725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bb6f54779-q4nfr"
Sep 10 23:42:58.412190 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412157    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"]
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="util"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412499    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="util"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412522    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="pull"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412527    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="pull"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412533    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="extract"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412539    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="extract"
Sep 10 23:42:58.412647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.412598    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="42933c0d-f9ea-416a-8c0e-f011e14f3f91" containerName="extract"
Sep 10 23:42:58.424508 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.424481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.426728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.426703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"]
Sep 10 23:42:58.427014 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.426998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 23:42:58.427087 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.427069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 23:42:58.428098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.428078    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 23:42:58.429170 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.429152    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 23:42:58.429479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.429460    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kcqzk\""
Sep 10 23:42:58.507244 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.507208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxrf\" (UniqueName: \"kubernetes.io/projected/6e7b66c6-28d9-427a-8984-de88d7ac71e6-kube-api-access-nzxrf\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.507480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.507260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tmp\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.507480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.507396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tls-certs\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.608589 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.608544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxrf\" (UniqueName: \"kubernetes.io/projected/6e7b66c6-28d9-427a-8984-de88d7ac71e6-kube-api-access-nzxrf\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.608789 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.608639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tmp\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.608789 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.608702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tls-certs\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.611799 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.611758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tmp\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.611987 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.611966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7b66c6-28d9-427a-8984-de88d7ac71e6-tls-certs\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.622004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.621963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxrf\" (UniqueName: \"kubernetes.io/projected/6e7b66c6-28d9-427a-8984-de88d7ac71e6-kube-api-access-nzxrf\") pod \"kube-auth-proxy-547c6fc866-zr62v\" (UID: \"6e7b66c6-28d9-427a-8984-de88d7ac71e6\") " pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:58.735819 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:58.735734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"
Sep 10 23:42:59.010259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.010228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547c6fc866-zr62v"]
Sep 10 23:42:59.012892 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:42:59.012858    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7b66c6_28d9_427a_8984_de88d7ac71e6.slice/crio-9d67fadc340e38a1afd1e0c4b8bd06175665d3c49fff7770583305b163335421 WatchSource:0}: Error finding container 9d67fadc340e38a1afd1e0c4b8bd06175665d3c49fff7770583305b163335421: Status 404 returned error can't find the container with id 9d67fadc340e38a1afd1e0c4b8bd06175665d3c49fff7770583305b163335421
Sep 10 23:42:59.359117 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.359030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v" event={"ID":"6e7b66c6-28d9-427a-8984-de88d7ac71e6","Type":"ContainerStarted","Data":"9d67fadc340e38a1afd1e0c4b8bd06175665d3c49fff7770583305b163335421"}
Sep 10 23:42:59.626721 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.626252    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:42:59.630648 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.630568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.633533 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.633473    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 23:42:59.633786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.633546    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:42:59.633786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.633631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4p88p\""
Sep 10 23:42:59.633786 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.633669    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 23:42:59.634346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.634320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 23:42:59.645506 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.645481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:42:59.719135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719357 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhg9z\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.719647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.719490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.820920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.820876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.820931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.820973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.821011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhg9z\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.821054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821119 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.821091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821403 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.821142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.821988 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.821939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.824330 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.824277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.825654 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.825628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.826116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.826052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.828431 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.828386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.830656 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.830613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.830656 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.830650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhg9z\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2254n\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:42:59.945597 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:42:59.945557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:43:00.243110 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:00.243018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:43:00.245916 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:00.245882    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc452af66_ef6e_42fd_8527_d091b92dc086.slice/crio-2f15e6ba366ca98b1e95c5e4851af2e7a928471f893f44bac3210d2d87ae25bb WatchSource:0}: Error finding container 2f15e6ba366ca98b1e95c5e4851af2e7a928471f893f44bac3210d2d87ae25bb: Status 404 returned error can't find the container with id 2f15e6ba366ca98b1e95c5e4851af2e7a928471f893f44bac3210d2d87ae25bb
Sep 10 23:43:00.367305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:00.367248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" event={"ID":"c452af66-ef6e-42fd-8527-d091b92dc086","Type":"ContainerStarted","Data":"2f15e6ba366ca98b1e95c5e4851af2e7a928471f893f44bac3210d2d87ae25bb"}
Sep 10 23:43:01.968337 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:01.968211    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d97c6c6d-rntrm"]
Sep 10 23:43:01.971897 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:01.971874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:01.981210 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:01.981184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d97c6c6d-rntrm"]
Sep 10 23:43:02.042021 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.041987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-service-ca\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042021 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-oauth-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-trusted-ca-bundle\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-console-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-oauth-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.042364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.042238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfm88\" (UniqueName: \"kubernetes.io/projected/3575d104-5ef9-461d-82d9-524970ad7cfc-kube-api-access-pfm88\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-console-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-oauth-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfm88\" (UniqueName: \"kubernetes.io/projected/3575d104-5ef9-461d-82d9-524970ad7cfc-kube-api-access-pfm88\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-service-ca\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-oauth-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.142991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.142856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-trusted-ca-bundle\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.143653 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.143628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-service-ca\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.143766 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.143741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-oauth-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.143813 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.143791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-trusted-ca-bundle\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.143847 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.143816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3575d104-5ef9-461d-82d9-524970ad7cfc-console-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.145391 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.145371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-oauth-config\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.145602 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.145582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3575d104-5ef9-461d-82d9-524970ad7cfc-console-serving-cert\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.151314 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.151274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfm88\" (UniqueName: \"kubernetes.io/projected/3575d104-5ef9-461d-82d9-524970ad7cfc-kube-api-access-pfm88\") pod \"console-57d97c6c6d-rntrm\" (UID: \"3575d104-5ef9-461d-82d9-524970ad7cfc\") " pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.281191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.281103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:02.378638 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.378605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v" event={"ID":"6e7b66c6-28d9-427a-8984-de88d7ac71e6","Type":"ContainerStarted","Data":"0a8d66bed70b8db94cad77eb32aff22ab8f3c780aa67b16c71ac00db4a74288a"}
Sep 10 23:43:02.395059 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.395011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-547c6fc866-zr62v" podStartSLOduration=1.720656553 podStartE2EDuration="4.394993525s" totalImagesPullingTime="2.674336972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:02.394107633 +0000 UTC m=+399.493689737" watchObservedRunningTime="2026-09-10 23:43:02.394993525 +0000 UTC m=+399.494575626"
Sep 10 23:43:02.557649 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:02.557536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d97c6c6d-rntrm"]
Sep 10 23:43:02.560307 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:02.560265    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3575d104_5ef9_461d_82d9_524970ad7cfc.slice/crio-852359a47e8dd69d205f2dc07074e88b4860c46f1eee9dbf232fb5b6e2b78488 WatchSource:0}: Error finding container 852359a47e8dd69d205f2dc07074e88b4860c46f1eee9dbf232fb5b6e2b78488: Status 404 returned error can't find the container with id 852359a47e8dd69d205f2dc07074e88b4860c46f1eee9dbf232fb5b6e2b78488
Sep 10 23:43:03.384532 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:03.384493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d97c6c6d-rntrm" event={"ID":"3575d104-5ef9-461d-82d9-524970ad7cfc","Type":"ContainerStarted","Data":"be49ee2fe397219d0b642f1d704fab0e98339bc21d3b6dd5f2dda24e584e440a"}
Sep 10 23:43:03.384908 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:03.384543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d97c6c6d-rntrm" event={"ID":"3575d104-5ef9-461d-82d9-524970ad7cfc","Type":"ContainerStarted","Data":"852359a47e8dd69d205f2dc07074e88b4860c46f1eee9dbf232fb5b6e2b78488"}
Sep 10 23:43:03.404948 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:03.404889    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57d97c6c6d-rntrm" podStartSLOduration=2.404866339 podStartE2EDuration="2.404866339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:03.404485489 +0000 UTC m=+400.504067596" watchObservedRunningTime="2026-09-10 23:43:03.404866339 +0000 UTC m=+400.504448442"
Sep 10 23:43:08.791868 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.791832    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-59cqn"]
Sep 10 23:43:08.795259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.795242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:08.797649 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.797626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 23:43:08.797765 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.797745    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rb46r\""
Sep 10 23:43:08.805202 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.805174    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-59cqn"]
Sep 10 23:43:08.906210 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.906175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-cert\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:08.906434 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:08.906252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5kw\" (UniqueName: \"kubernetes.io/projected/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-kube-api-access-gz5kw\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.007072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.007035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-cert\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.007246 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.007121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5kw\" (UniqueName: \"kubernetes.io/projected/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-kube-api-access-gz5kw\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.009773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.009749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-cert\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.016059 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.016024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5kw\" (UniqueName: \"kubernetes.io/projected/5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1-kube-api-access-gz5kw\") pod \"odh-model-controller-7998c67dc4-59cqn\" (UID: \"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.107408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.107276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:09.383155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.383129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-59cqn"]
Sep 10 23:43:09.385207 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:09.385182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5dc3b9_77e4_41f7_bc98_63bcfd7c45c1.slice/crio-205c6b42e46ed123495efec165c9b96ef7a594abefa679413266587a4d6c68f2 WatchSource:0}: Error finding container 205c6b42e46ed123495efec165c9b96ef7a594abefa679413266587a4d6c68f2: Status 404 returned error can't find the container with id 205c6b42e46ed123495efec165c9b96ef7a594abefa679413266587a4d6c68f2
Sep 10 23:43:09.414826 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:09.414794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn" event={"ID":"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1","Type":"ContainerStarted","Data":"205c6b42e46ed123495efec165c9b96ef7a594abefa679413266587a4d6c68f2"}
Sep 10 23:43:12.281703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:12.281665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:12.282077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:12.281731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:12.286712 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:12.286684    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:12.437078 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:12.437052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d97c6c6d-rntrm"
Sep 10 23:43:12.484434 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:12.484396    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:43:13.196524 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.196486    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:43:13.196651 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.196568    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:43:13.440228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.440193    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" event={"ID":"c452af66-ef6e-42fd-8527-d091b92dc086","Type":"ContainerStarted","Data":"51fefeb8c1986c96cdaef3e981ec4eaba2abd82846674fe0f310f2c8e7f1b344"}
Sep 10 23:43:13.440739 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.440331    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:43:13.442000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.441977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn" event={"ID":"5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1","Type":"ContainerStarted","Data":"5ecb7f6515d84c64ef467c8d40cbcff5b87c87591eb2caa6a67bcae092eceba2"}
Sep 10 23:43:13.464537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:13.464442    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" podStartSLOduration=1.516677686 podStartE2EDuration="14.464422739s" totalImagesPullingTime="12.947745053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:13.463424076 +0000 UTC m=+410.563006178" watchObservedRunningTime="2026-09-10 23:43:13.464422739 +0000 UTC m=+410.564004840"
Sep 10 23:43:14.437758 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.437704    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn" podStartSLOduration=2.6279535149999997 podStartE2EDuration="6.437683525s" totalImagesPullingTime="3.80973001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:13.478256908 +0000 UTC m=+410.577839011" watchObservedRunningTime="2026-09-10 23:43:14.437683525 +0000 UTC m=+411.537265628"
Sep 10 23:43:14.438403 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.438386    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:14.441927 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.441908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.444746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.444726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5mdzc\""
Sep 10 23:43:14.446614 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.446596    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:14.448324 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.448298    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2254n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:43:14.448421 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.448354    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:43:14.470981 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.470948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:14.563928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.563885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.563928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.563921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564148 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.563976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564148 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x668\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.564450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.564443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.667969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.667915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.667986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668370 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668370 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x668\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.668572 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.668965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.669315 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.669145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.670779 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.670756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.671048 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.671029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.675820 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.675797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x668\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.676255 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.676236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:14.752906 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:14.752799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:15.031203 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:15.031175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:15.032926 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:15.032901    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d7ba55_3c82_4fdf_8764_b88b33f70856.slice/crio-fb1d3135a22b53f44226b2549b1c1765919c6f5aa0b4276e7d152f454e6266b8 WatchSource:0}: Error finding container fb1d3135a22b53f44226b2549b1c1765919c6f5aa0b4276e7d152f454e6266b8: Status 404 returned error can't find the container with id fb1d3135a22b53f44226b2549b1c1765919c6f5aa0b4276e7d152f454e6266b8
Sep 10 23:43:15.452893 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:15.452858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" event={"ID":"42d7ba55-3c82-4fdf-8764-b88b33f70856","Type":"ContainerStarted","Data":"fb1d3135a22b53f44226b2549b1c1765919c6f5aa0b4276e7d152f454e6266b8"}
Sep 10 23:43:17.451761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:17.451732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:43:17.570671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:17.570624    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:43:17.570782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:17.570729    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:43:17.570782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:17.570771    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:43:18.471396 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:18.471363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" event={"ID":"42d7ba55-3c82-4fdf-8764-b88b33f70856","Type":"ContainerStarted","Data":"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"}
Sep 10 23:43:18.509727 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:18.509674    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" podStartSLOduration=1.974372026 podStartE2EDuration="4.509653705s" totalImagesPullingTime="2.535281679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:18.506690416 +0000 UTC m=+415.606272517" watchObservedRunningTime="2026-09-10 23:43:18.509653705 +0000 UTC m=+415.609235806"
Sep 10 23:43:18.754075 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:18.753979    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:18.755502 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:18.755477    2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 23:43:18.755627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:18.755524    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 23:43:19.153503 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:19.153404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:19.753794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:19.753753    2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 23:43:19.754187 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:19.753817    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 23:43:20.168191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.168157    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"]
Sep 10 23:43:20.171821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.171803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.176595 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.176572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 23:43:20.176745 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.176687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8zzdx\""
Sep 10 23:43:20.197661 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.197631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"]
Sep 10 23:43:20.212619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.212582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"]
Sep 10 23:43:20.216759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.216733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.219235 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.219208    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 23:43:20.230562 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.230528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j7sl5\""
Sep 10 23:43:20.235229 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.235191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"]
Sep 10 23:43:20.324022 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.323982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5sq\" (UniqueName: \"kubernetes.io/projected/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-kube-api-access-8f5sq\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.324022 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.324026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86283742-6da6-44c2-b75a-aeb2eca2b674-cert\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.324265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.324104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvwz6\" (UniqueName: \"kubernetes.io/projected/86283742-6da6-44c2-b75a-aeb2eca2b674-kube-api-access-vvwz6\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.324265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.324120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.425399 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.425265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5sq\" (UniqueName: \"kubernetes.io/projected/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-kube-api-access-8f5sq\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.425399 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.425356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86283742-6da6-44c2-b75a-aeb2eca2b674-cert\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.425644 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.425423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvwz6\" (UniqueName: \"kubernetes.io/projected/86283742-6da6-44c2-b75a-aeb2eca2b674-kube-api-access-vvwz6\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.425644 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.425444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.428206 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.428176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86283742-6da6-44c2-b75a-aeb2eca2b674-cert\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.428352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.428257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.444548 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.444520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvwz6\" (UniqueName: \"kubernetes.io/projected/86283742-6da6-44c2-b75a-aeb2eca2b674-kube-api-access-vvwz6\") pod \"kserve-controller-manager-d6f4b65b8-sztjt\" (UID: \"86283742-6da6-44c2-b75a-aeb2eca2b674\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.452154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.452122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5sq\" (UniqueName: \"kubernetes.io/projected/18fa3461-bf05-42ea-b5ae-25e19f7df4b9-kube-api-access-8f5sq\") pod \"llmisvc-controller-manager-777c6bd7d5-rnwhb\" (UID: \"18fa3461-bf05-42ea-b5ae-25e19f7df4b9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.481577 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.481530    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy" containerID="cri-o://8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13" gracePeriod=30
Sep 10 23:43:20.481792 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.481774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:20.526906 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.526876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:20.784932 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.784909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"]
Sep 10 23:43:20.787182 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:20.787153    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86283742_6da6_44c2_b75a_aeb2eca2b674.slice/crio-c79b0902c57a833fb7dc756ab6b1cb0a8456c86e82af7537646e98edbbed64b5 WatchSource:0}: Error finding container c79b0902c57a833fb7dc756ab6b1cb0a8456c86e82af7537646e98edbbed64b5: Status 404 returned error can't find the container with id c79b0902c57a833fb7dc756ab6b1cb0a8456c86e82af7537646e98edbbed64b5
Sep 10 23:43:20.827005 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:20.826974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"]
Sep 10 23:43:20.829712 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:43:20.829682    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18fa3461_bf05_42ea_b5ae_25e19f7df4b9.slice/crio-2e74325abbfc2639983b9314e09779971e1bdd94a943ae4d89f6adfb37508056 WatchSource:0}: Error finding container 2e74325abbfc2639983b9314e09779971e1bdd94a943ae4d89f6adfb37508056: Status 404 returned error can't find the container with id 2e74325abbfc2639983b9314e09779971e1bdd94a943ae4d89f6adfb37508056
Sep 10 23:43:21.489644 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:21.489600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt" event={"ID":"86283742-6da6-44c2-b75a-aeb2eca2b674","Type":"ContainerStarted","Data":"c79b0902c57a833fb7dc756ab6b1cb0a8456c86e82af7537646e98edbbed64b5"}
Sep 10 23:43:21.491147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:21.491116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb" event={"ID":"18fa3461-bf05-42ea-b5ae-25e19f7df4b9","Type":"ContainerStarted","Data":"2e74325abbfc2639983b9314e09779971e1bdd94a943ae4d89f6adfb37508056"}
Sep 10 23:43:22.151824 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:22.151781    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:43:22.152561 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:22.152054    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" containerName="discovery" containerID="cri-o://51fefeb8c1986c96cdaef3e981ec4eaba2abd82846674fe0f310f2c8e7f1b344" gracePeriod=30
Sep 10 23:43:22.500650 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:22.500514    2581 generic.go:356] "Generic (PLEG): container finished" podID="c452af66-ef6e-42fd-8527-d091b92dc086" containerID="51fefeb8c1986c96cdaef3e981ec4eaba2abd82846674fe0f310f2c8e7f1b344" exitCode=0
Sep 10 23:43:22.500650 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:22.500615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" event={"ID":"c452af66-ef6e-42fd-8527-d091b92dc086","Type":"ContainerDied","Data":"51fefeb8c1986c96cdaef3e981ec4eaba2abd82846674fe0f310f2c8e7f1b344"}
Sep 10 23:43:23.057033 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.057005    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:43:23.154848 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.154813    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.154873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.154911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.154941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhg9z\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.154972    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.155056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155338 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.155087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert\") pod \"c452af66-ef6e-42fd-8527-d091b92dc086\" (UID: \"c452af66-ef6e-42fd-8527-d091b92dc086\") "
Sep 10 23:43:23.155688 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.155425    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:23.158336 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158281    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:43:23.158465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs" (OuterVolumeSpecName: "local-certs") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:23.158465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z" (OuterVolumeSpecName: "kube-api-access-vhg9z") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "kube-api-access-vhg9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:23.158581 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:43:23.158581 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token" (OuterVolumeSpecName: "istio-token") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:23.158707 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.158677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts" (OuterVolumeSpecName: "cacerts") pod "c452af66-ef6e-42fd-8527-d091b92dc086" (UID: "c452af66-ef6e-42fd-8527-d091b92dc086"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:43:23.256619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256577    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-cacerts\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256613    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c452af66-ef6e-42fd-8527-d091b92dc086-local-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256630    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-dns-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256881 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256644    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-istio-token\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256881 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256658    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c452af66-ef6e-42fd-8527-d091b92dc086-istio-kubeconfig\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256881 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256670    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c452af66-ef6e-42fd-8527-d091b92dc086-istio-csr-ca-configmap\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.256881 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.256684    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhg9z\" (UniqueName: \"kubernetes.io/projected/c452af66-ef6e-42fd-8527-d091b92dc086-kube-api-access-vhg9z\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:23.508728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.508674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n" event={"ID":"c452af66-ef6e-42fd-8527-d091b92dc086","Type":"ContainerDied","Data":"2f15e6ba366ca98b1e95c5e4851af2e7a928471f893f44bac3210d2d87ae25bb"}
Sep 10 23:43:23.508728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.508727    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"
Sep 10 23:43:23.508957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.508756    2581 scope.go:117] "RemoveContainer" containerID="51fefeb8c1986c96cdaef3e981ec4eaba2abd82846674fe0f310f2c8e7f1b344"
Sep 10 23:43:23.530079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.530041    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:43:23.542145 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:23.542113    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2254n"]
Sep 10 23:43:24.516535 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.516493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt" event={"ID":"86283742-6da6-44c2-b75a-aeb2eca2b674","Type":"ContainerStarted","Data":"1faad5ff8688cee9ab7ccaadce3810d5b95b881c468b558c9d9d9e356cfb9c2b"}
Sep 10 23:43:24.517000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.516602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:43:24.518211 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.518186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb" event={"ID":"18fa3461-bf05-42ea-b5ae-25e19f7df4b9","Type":"ContainerStarted","Data":"9a136cccb17191850c34c45edc2a01cc25dcf914635ea62351fe20e2e878b4f7"}
Sep 10 23:43:24.518331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.518245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:24.540925 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.540860    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt" podStartSLOduration=1.7111792160000001 podStartE2EDuration="4.540839027s" totalImagesPullingTime="2.829659811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:24.539947434 +0000 UTC m=+421.639529536" watchObservedRunningTime="2026-09-10 23:43:24.540839027 +0000 UTC m=+421.640421135"
Sep 10 23:43:24.576222 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:24.576151    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb" podStartSLOduration=1.741968359 podStartE2EDuration="4.576131515s" totalImagesPullingTime="2.834163156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:43:24.57394214 +0000 UTC m=+421.673524246" watchObservedRunningTime="2026-09-10 23:43:24.576131515 +0000 UTC m=+421.675713616"
Sep 10 23:43:25.449326 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.449257    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" path="/var/lib/kubelet/pods/c452af66-ef6e-42fd-8527-d091b92dc086/volumes"
Sep 10 23:43:25.455433 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.455406    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-59cqn"
Sep 10 23:43:25.744807 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.744781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:25.884978 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.884940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.884978 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.884981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x668\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885261    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885450 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs\") pod \"42d7ba55-3c82-4fdf-8764-b88b33f70856\" (UID: \"42d7ba55-3c82-4fdf-8764-b88b33f70856\") "
Sep 10 23:43:25.885596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:25.885687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885668    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:25.885737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885673    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-credential-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.885790 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885724    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:25.885790 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data" (OuterVolumeSpecName: "istio-data") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:25.885925 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.885907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:25.888054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.888026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668" (OuterVolumeSpecName: "kube-api-access-4x668") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "kube-api-access-4x668". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:25.888196 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.888026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:43:25.888413 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.888392    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token" (OuterVolumeSpecName: "istio-token") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:25.888498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.888482    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42d7ba55-3c82-4fdf-8764-b88b33f70856" (UID: "42d7ba55-3c82-4fdf-8764-b88b33f70856"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986878    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d7ba55-3c82-4fdf-8764-b88b33f70856-istiod-ca-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986907    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-envoy\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986916    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-data\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986925    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986933    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-token\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986941    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d7ba55-3c82-4fdf-8764-b88b33f70856-workload-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986949    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d7ba55-3c82-4fdf-8764-b88b33f70856-istio-podinfo\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:25.986977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:25.986957    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x668\" (UniqueName: \"kubernetes.io/projected/42d7ba55-3c82-4fdf-8764-b88b33f70856-kube-api-access-4x668\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:26.531937 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.531898    2581 generic.go:356] "Generic (PLEG): container finished" podID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerID="8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13" exitCode=0
Sep 10 23:43:26.532127 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.531960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"
Sep 10 23:43:26.532127 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.531983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" event={"ID":"42d7ba55-3c82-4fdf-8764-b88b33f70856","Type":"ContainerDied","Data":"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"}
Sep 10 23:43:26.532127 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.532041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8" event={"ID":"42d7ba55-3c82-4fdf-8764-b88b33f70856","Type":"ContainerDied","Data":"fb1d3135a22b53f44226b2549b1c1765919c6f5aa0b4276e7d152f454e6266b8"}
Sep 10 23:43:26.532127 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.532064    2581 scope.go:117] "RemoveContainer" containerID="8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"
Sep 10 23:43:26.542108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.542084    2581 scope.go:117] "RemoveContainer" containerID="8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"
Sep 10 23:43:26.542457 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:43:26.542436    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13\": container with ID starting with 8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13 not found: ID does not exist" containerID="8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"
Sep 10 23:43:26.542534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.542464    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13"} err="failed to get container status \"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13\": rpc error: code = NotFound desc = could not find container \"8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13\": container with ID starting with 8d4af251bf4e04c68de8bec882d920b693de2dbef14af156ed866409ac43ca13 not found: ID does not exist"
Sep 10 23:43:26.577623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.577586    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:26.593442 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:26.593401    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc8r5p8"]
Sep 10 23:43:27.449300 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:27.449264    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" path="/var/lib/kubelet/pods/42d7ba55-3c82-4fdf-8764-b88b33f70856/volumes"
Sep 10 23:43:37.511417 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.511372    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-684cbdf6fd-47kb9" podUID="e6ed237d-6628-4e86-b531-039bb096cd35" containerName="console" containerID="cri-o://287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d" gracePeriod=15
Sep 10 23:43:37.769938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.769869    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:43:37.795992 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.795959    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92khn\" (UniqueName: \"kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796007    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796085    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796170    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config\") pod \"e6ed237d-6628-4e86-b531-039bb096cd35\" (UID: \"e6ed237d-6628-4e86-b531-039bb096cd35\") "
Sep 10 23:43:37.796708 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.796681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:37.797146 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.797120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:37.797393 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.797198    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config" (OuterVolumeSpecName: "console-config") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:37.797393 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.797254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:43:37.798941 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.798907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:43:37.799049 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.798933    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn" (OuterVolumeSpecName: "kube-api-access-92khn") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "kube-api-access-92khn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:43:37.799277 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.799252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6ed237d-6628-4e86-b531-039bb096cd35" (UID: "e6ed237d-6628-4e86-b531-039bb096cd35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:43:37.896911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896866    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-trusted-ca-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.896911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896903    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.896911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896918    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-oauth-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.897178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896932    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92khn\" (UniqueName: \"kubernetes.io/projected/e6ed237d-6628-4e86-b531-039bb096cd35-kube-api-access-92khn\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.897178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896944    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-console-config\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.897178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896957    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6ed237d-6628-4e86-b531-039bb096cd35-console-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:37.897178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:37.896968    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6ed237d-6628-4e86-b531-039bb096cd35-oauth-serving-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:43:38.598328 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.598275    2581 generic.go:356] "Generic (PLEG): container finished" podID="e6ed237d-6628-4e86-b531-039bb096cd35" containerID="287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d" exitCode=0
Sep 10 23:43:38.598730 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.598359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cbdf6fd-47kb9"
Sep 10 23:43:38.598730 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.598357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cbdf6fd-47kb9" event={"ID":"e6ed237d-6628-4e86-b531-039bb096cd35","Type":"ContainerDied","Data":"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"}
Sep 10 23:43:38.598730 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.598476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cbdf6fd-47kb9" event={"ID":"e6ed237d-6628-4e86-b531-039bb096cd35","Type":"ContainerDied","Data":"fd379c968b380050372d47e2320f83328910365e9e1293fea1fc4288166bdc6c"}
Sep 10 23:43:38.598730 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.598497    2581 scope.go:117] "RemoveContainer" containerID="287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"
Sep 10 23:43:38.607918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.607902    2581 scope.go:117] "RemoveContainer" containerID="287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"
Sep 10 23:43:38.608232 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:43:38.608214    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d\": container with ID starting with 287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d not found: ID does not exist" containerID="287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"
Sep 10 23:43:38.608272 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.608242    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d"} err="failed to get container status \"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d\": rpc error: code = NotFound desc = could not find container \"287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d\": container with ID starting with 287e506006f2157c2c892ce68644874ca6aac571e3c2d8d6b205d852819c8f8d not found: ID does not exist"
Sep 10 23:43:38.622486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.622452    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:43:38.627235 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:38.627208    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684cbdf6fd-47kb9"]
Sep 10 23:43:39.448762 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:39.448727    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ed237d-6628-4e86-b531-039bb096cd35" path="/var/lib/kubelet/pods/e6ed237d-6628-4e86-b531-039bb096cd35/volumes"
Sep 10 23:43:55.527426 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:55.527328    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rnwhb"
Sep 10 23:43:55.530207 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:43:55.530184    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sztjt"
Sep 10 23:44:14.253673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.253638    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"]
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.253985    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ed237d-6628-4e86-b531-039bb096cd35" containerName="console"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.253996    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ed237d-6628-4e86-b531-039bb096cd35" containerName="console"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" containerName="discovery"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254009    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" containerName="discovery"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254030    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254035    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254087    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ed237d-6628-4e86-b531-039bb096cd35" containerName="console"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254098    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d7ba55-3c82-4fdf-8764-b88b33f70856" containerName="istio-proxy"
Sep 10 23:44:14.254138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.254103    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c452af66-ef6e-42fd-8527-d091b92dc086" containerName="discovery"
Sep 10 23:44:14.269256 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.269221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"]
Sep 10 23:44:14.269429 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.269357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.271920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.271899    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:44:14.272165 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.272146    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n9p52\""
Sep 10 23:44:14.273126 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.273105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:44:14.340867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.340832    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"]
Sep 10 23:44:14.344502 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.344483    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.352811 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.352783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"]
Sep 10 23:44:14.428439 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.428621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.428621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.428621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.428621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h4fk\" (UniqueName: \"kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.428621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.428593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjtz\" (UniqueName: \"kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.435879 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.435851    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"]
Sep 10 23:44:14.439671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.439655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.446834 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.446808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"]
Sep 10 23:44:14.529904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.529817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.529904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.529853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.529904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.529880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.529959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h4fk\" (UniqueName: \"kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mp6\" (UniqueName: \"kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjtz\" (UniqueName: \"kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.530147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.530488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.530488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.530488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.530488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.530451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.541871 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.541836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h4fk\" (UniqueName: \"kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.543223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.543202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjtz\" (UniqueName: \"kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.547544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.547520    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"]
Sep 10 23:44:14.551560 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.551543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.560621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.560592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"]
Sep 10 23:44:14.579449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.579426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:14.630938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.630724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.630938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.630767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zp4v\" (UniqueName: \"kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.630938 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.630917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.631169 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.631001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.631169 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.631116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.631169 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.631148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mp6\" (UniqueName: \"kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.631632 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.631446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.631632 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.631624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.641581 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.641527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mp6\" (UniqueName: \"kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.653941 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.653871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:14.732016 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.731984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.732158 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.732027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zp4v\" (UniqueName: \"kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.732158 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.732093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.732372 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.732354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.732423 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.732404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.740920 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.740894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zp4v\" (UniqueName: \"kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.749784 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.749761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:14.851826 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.851801    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"]
Sep 10 23:44:14.853489 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:14.853464    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d578f5_8585_41f6_b95c_5d81b53fdc43.slice/crio-4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17 WatchSource:0}: Error finding container 4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17: Status 404 returned error can't find the container with id 4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17
Sep 10 23:44:14.865055 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.865037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:14.930737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:14.930710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"]
Sep 10 23:44:14.932526 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:14.932489    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03e6f8b_d954_47a8_a98e_77a5f93443bf.slice/crio-4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034 WatchSource:0}: Error finding container 4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034: Status 404 returned error can't find the container with id 4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034
Sep 10 23:44:15.024386 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.024362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"]
Sep 10 23:44:15.033349 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:15.033325    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3933cb_ee7f_4a6a_b64c_a1108f24fb98.slice/crio-5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385 WatchSource:0}: Error finding container 5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385: Status 404 returned error can't find the container with id 5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385
Sep 10 23:44:15.143607 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.143576    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"]
Sep 10 23:44:15.174121 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:15.174085    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82ebe2a_1457_4493_9640_8759715c03d4.slice/crio-805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076 WatchSource:0}: Error finding container 805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076: Status 404 returned error can't find the container with id 805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076
Sep 10 23:44:15.790737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.790702    2581 generic.go:356] "Generic (PLEG): container finished" podID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerID="519ed112d5307614c261b1ce606349be4b46da904754a5e2ba0812aad56cd946" exitCode=0
Sep 10 23:44:15.791224 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.790805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl" event={"ID":"c03e6f8b-d954-47a8-a98e-77a5f93443bf","Type":"ContainerDied","Data":"519ed112d5307614c261b1ce606349be4b46da904754a5e2ba0812aad56cd946"}
Sep 10 23:44:15.791224 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.790870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl" event={"ID":"c03e6f8b-d954-47a8-a98e-77a5f93443bf","Type":"ContainerStarted","Data":"4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034"}
Sep 10 23:44:15.792563 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.792538    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerID="3bea4c5d1f92752aa9abb3868291211931c39a11348b67b8364104226b5844b0" exitCode=0
Sep 10 23:44:15.792669 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.792578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl" event={"ID":"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98","Type":"ContainerDied","Data":"3bea4c5d1f92752aa9abb3868291211931c39a11348b67b8364104226b5844b0"}
Sep 10 23:44:15.792669 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.792629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl" event={"ID":"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98","Type":"ContainerStarted","Data":"5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385"}
Sep 10 23:44:15.794388 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.794369    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerID="3e87994583d9960943dd2c40aeda3d4d011bac03b6a83fffe5d3c85840c858a4" exitCode=0
Sep 10 23:44:15.794474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.794452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7" event={"ID":"f4d578f5-8585-41f6-b95c-5d81b53fdc43","Type":"ContainerDied","Data":"3e87994583d9960943dd2c40aeda3d4d011bac03b6a83fffe5d3c85840c858a4"}
Sep 10 23:44:15.794532 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.794500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7" event={"ID":"f4d578f5-8585-41f6-b95c-5d81b53fdc43","Type":"ContainerStarted","Data":"4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17"}
Sep 10 23:44:15.796065 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.796048    2581 generic.go:356] "Generic (PLEG): container finished" podID="e82ebe2a-1457-4493-9640-8759715c03d4" containerID="016f17c08787b835ba2d361d07203893b3d7224f9684b69260167d5c0b466307" exitCode=0
Sep 10 23:44:15.796129 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.796106    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l" event={"ID":"e82ebe2a-1457-4493-9640-8759715c03d4","Type":"ContainerDied","Data":"016f17c08787b835ba2d361d07203893b3d7224f9684b69260167d5c0b466307"}
Sep 10 23:44:15.796172 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:15.796131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l" event={"ID":"e82ebe2a-1457-4493-9640-8759715c03d4","Type":"ContainerStarted","Data":"805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076"}
Sep 10 23:44:16.804073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:16.804004    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerID="0bb77ae285b794496083e790ec18829b04caf6649f504201b0d6d2701d352f02" exitCode=0
Sep 10 23:44:16.804520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:16.804082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7" event={"ID":"f4d578f5-8585-41f6-b95c-5d81b53fdc43","Type":"ContainerDied","Data":"0bb77ae285b794496083e790ec18829b04caf6649f504201b0d6d2701d352f02"}
Sep 10 23:44:16.806254 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:16.806232    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerID="d40ecf31ece09803c3fb8403e5a68ac7ecff639ca5d30b69264dbbb62ea2d80f" exitCode=0
Sep 10 23:44:16.806392 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:16.806265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl" event={"ID":"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98","Type":"ContainerDied","Data":"d40ecf31ece09803c3fb8403e5a68ac7ecff639ca5d30b69264dbbb62ea2d80f"}
Sep 10 23:44:17.813387 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.813351    2581 generic.go:356] "Generic (PLEG): container finished" podID="e82ebe2a-1457-4493-9640-8759715c03d4" containerID="5365fbcb4a5147237b1e02b5175d36545c7fa334fd06c840b4e1d25e5643a907" exitCode=0
Sep 10 23:44:17.813819 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.813405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l" event={"ID":"e82ebe2a-1457-4493-9640-8759715c03d4","Type":"ContainerDied","Data":"5365fbcb4a5147237b1e02b5175d36545c7fa334fd06c840b4e1d25e5643a907"}
Sep 10 23:44:17.815684 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.815657    2581 generic.go:356] "Generic (PLEG): container finished" podID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerID="adf4c32ada89dbfa41001a7bbfcdc5dffc36e46863f227a7b8a39439dd70d9a1" exitCode=0
Sep 10 23:44:17.815775 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.815741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl" event={"ID":"c03e6f8b-d954-47a8-a98e-77a5f93443bf","Type":"ContainerDied","Data":"adf4c32ada89dbfa41001a7bbfcdc5dffc36e46863f227a7b8a39439dd70d9a1"}
Sep 10 23:44:17.818042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.818020    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerID="dffa3da2214b23ec63bdfd85e4ee7abcb68877c28a4057516935a08b90f19c43" exitCode=0
Sep 10 23:44:17.818141 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.818095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl" event={"ID":"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98","Type":"ContainerDied","Data":"dffa3da2214b23ec63bdfd85e4ee7abcb68877c28a4057516935a08b90f19c43"}
Sep 10 23:44:17.820552 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.820529    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerID="a5bc2b131602aed41d952dd287521cdb83f0725d352f9e7aaa9de5d24501f4dd" exitCode=0
Sep 10 23:44:17.820647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:17.820604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7" event={"ID":"f4d578f5-8585-41f6-b95c-5d81b53fdc43","Type":"ContainerDied","Data":"a5bc2b131602aed41d952dd287521cdb83f0725d352f9e7aaa9de5d24501f4dd"}
Sep 10 23:44:18.827797 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.827765    2581 generic.go:356] "Generic (PLEG): container finished" podID="e82ebe2a-1457-4493-9640-8759715c03d4" containerID="d097a7bb9eacea99c5fa9610df19b8852e0645d861edc33647cd33cfb0d17a48" exitCode=0
Sep 10 23:44:18.828259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.827858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l" event={"ID":"e82ebe2a-1457-4493-9640-8759715c03d4","Type":"ContainerDied","Data":"d097a7bb9eacea99c5fa9610df19b8852e0645d861edc33647cd33cfb0d17a48"}
Sep 10 23:44:18.830015 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.829992    2581 generic.go:356] "Generic (PLEG): container finished" podID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerID="5aa5b9c3fc88ff3614042fb33ee58abef5e570b33e10572b0239a90cd83bb68b" exitCode=0
Sep 10 23:44:18.830126 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.830066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl" event={"ID":"c03e6f8b-d954-47a8-a98e-77a5f93443bf","Type":"ContainerDied","Data":"5aa5b9c3fc88ff3614042fb33ee58abef5e570b33e10572b0239a90cd83bb68b"}
Sep 10 23:44:18.992375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.992352    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:18.995178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:18.995159    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:19.173557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle\") pod \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") "
Sep 10 23:44:19.173761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util\") pod \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") "
Sep 10 23:44:19.173761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util\") pod \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") "
Sep 10 23:44:19.173761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h4fk\" (UniqueName: \"kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk\") pod \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") "
Sep 10 23:44:19.173761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66mp6\" (UniqueName: \"kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6\") pod \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\" (UID: \"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98\") "
Sep 10 23:44:19.173761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.173667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle\") pod \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\" (UID: \"f4d578f5-8585-41f6-b95c-5d81b53fdc43\") "
Sep 10 23:44:19.174189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.174162    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle" (OuterVolumeSpecName: "bundle") pod "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" (UID: "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:19.174513 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.174480    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle" (OuterVolumeSpecName: "bundle") pod "f4d578f5-8585-41f6-b95c-5d81b53fdc43" (UID: "f4d578f5-8585-41f6-b95c-5d81b53fdc43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:19.176092 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.176066    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6" (OuterVolumeSpecName: "kube-api-access-66mp6") pod "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" (UID: "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98"). InnerVolumeSpecName "kube-api-access-66mp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:19.176341 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.176315    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk" (OuterVolumeSpecName: "kube-api-access-7h4fk") pod "f4d578f5-8585-41f6-b95c-5d81b53fdc43" (UID: "f4d578f5-8585-41f6-b95c-5d81b53fdc43"). InnerVolumeSpecName "kube-api-access-7h4fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:19.179551 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.179525    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util" (OuterVolumeSpecName: "util") pod "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" (UID: "4a3933cb-ee7f-4a6a-b64c-a1108f24fb98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:19.180958 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.180937    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util" (OuterVolumeSpecName: "util") pod "f4d578f5-8585-41f6-b95c-5d81b53fdc43" (UID: "f4d578f5-8585-41f6-b95c-5d81b53fdc43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:19.275047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.274992    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.275047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.275041    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.275047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.275052    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.275047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.275060    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h4fk\" (UniqueName: \"kubernetes.io/projected/f4d578f5-8585-41f6-b95c-5d81b53fdc43-kube-api-access-7h4fk\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.275047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.275069    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66mp6\" (UniqueName: \"kubernetes.io/projected/4a3933cb-ee7f-4a6a-b64c-a1108f24fb98-kube-api-access-66mp6\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.275421 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.275079    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4d578f5-8585-41f6-b95c-5d81b53fdc43-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:19.837768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.837682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl" event={"ID":"4a3933cb-ee7f-4a6a-b64c-a1108f24fb98","Type":"ContainerDied","Data":"5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385"}
Sep 10 23:44:19.837768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.837741    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d9b98e041f7d04101ca3d9a72be37f9f5c83eece08469b7d7f24ee9eff7c385"
Sep 10 23:44:19.837768 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.837690    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7c2dcl"
Sep 10 23:44:19.839837 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.839781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7" event={"ID":"f4d578f5-8585-41f6-b95c-5d81b53fdc43","Type":"ContainerDied","Data":"4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17"}
Sep 10 23:44:19.839988 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.839875    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c1798cdbec3ce59afe7f21de39850c17b118bed29f2ee884013444a91f7be17"
Sep 10 23:44:19.839988 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.839799    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awmbl7"
Sep 10 23:44:19.969108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:19.969079    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:20.008337 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.008311    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:20.083015 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.082981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle\") pod \"e82ebe2a-1457-4493-9640-8759715c03d4\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") "
Sep 10 23:44:20.083200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.083043    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zp4v\" (UniqueName: \"kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v\") pod \"e82ebe2a-1457-4493-9640-8759715c03d4\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") "
Sep 10 23:44:20.083200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.083091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util\") pod \"e82ebe2a-1457-4493-9640-8759715c03d4\" (UID: \"e82ebe2a-1457-4493-9640-8759715c03d4\") "
Sep 10 23:44:20.083715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.083673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle" (OuterVolumeSpecName: "bundle") pod "e82ebe2a-1457-4493-9640-8759715c03d4" (UID: "e82ebe2a-1457-4493-9640-8759715c03d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:20.085701 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.085676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v" (OuterVolumeSpecName: "kube-api-access-8zp4v") pod "e82ebe2a-1457-4493-9640-8759715c03d4" (UID: "e82ebe2a-1457-4493-9640-8759715c03d4"). InnerVolumeSpecName "kube-api-access-8zp4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:20.088308 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.088250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util" (OuterVolumeSpecName: "util") pod "e82ebe2a-1457-4493-9640-8759715c03d4" (UID: "e82ebe2a-1457-4493-9640-8759715c03d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:20.184453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle\") pod \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") "
Sep 10 23:44:20.184627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184490    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kjtz\" (UniqueName: \"kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz\") pod \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") "
Sep 10 23:44:20.184627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util\") pod \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\" (UID: \"c03e6f8b-d954-47a8-a98e-77a5f93443bf\") "
Sep 10 23:44:20.184780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184763    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.184852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184787    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zp4v\" (UniqueName: \"kubernetes.io/projected/e82ebe2a-1457-4493-9640-8759715c03d4-kube-api-access-8zp4v\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.184852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184801    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e82ebe2a-1457-4493-9640-8759715c03d4-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.184973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.184954    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle" (OuterVolumeSpecName: "bundle") pod "c03e6f8b-d954-47a8-a98e-77a5f93443bf" (UID: "c03e6f8b-d954-47a8-a98e-77a5f93443bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:20.186801 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.186772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz" (OuterVolumeSpecName: "kube-api-access-6kjtz") pod "c03e6f8b-d954-47a8-a98e-77a5f93443bf" (UID: "c03e6f8b-d954-47a8-a98e-77a5f93443bf"). InnerVolumeSpecName "kube-api-access-6kjtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:20.189100 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.189066    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util" (OuterVolumeSpecName: "util") pod "c03e6f8b-d954-47a8-a98e-77a5f93443bf" (UID: "c03e6f8b-d954-47a8-a98e-77a5f93443bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:20.285709 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.285667    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kjtz\" (UniqueName: \"kubernetes.io/projected/c03e6f8b-d954-47a8-a98e-77a5f93443bf-kube-api-access-6kjtz\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.285709 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.285701    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-util\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.285709 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.285717    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c03e6f8b-d954-47a8-a98e-77a5f93443bf-bundle\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:20.853309 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.853262    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l"
Sep 10 23:44:20.853761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.853311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbpj7l" event={"ID":"e82ebe2a-1457-4493-9640-8759715c03d4","Type":"ContainerDied","Data":"805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076"}
Sep 10 23:44:20.853761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.853397    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="805b0a40aaed078d477e25f6b1b0e0209e5b93bfa4e683cca317a74c22d8c076"
Sep 10 23:44:20.855396 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.855368    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl"
Sep 10 23:44:20.855522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.855362    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6f74tl" event={"ID":"c03e6f8b-d954-47a8-a98e-77a5f93443bf","Type":"ContainerDied","Data":"4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034"}
Sep 10 23:44:20.855522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:20.855483    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4088391a0f79dcd1d9dd0901230d1ae4a77edbb2e5fb669e89cd0ef4ea44d034"
Sep 10 23:44:25.449575 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"]
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449872    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="util"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449883    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="util"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449892    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="util"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="util"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449908    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="pull"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449913    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="pull"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449919    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="extract"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449924    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="extract"
Sep 10 23:44:25.449930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449933    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449939    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449945    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449951    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449956    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449961    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449972    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449977    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449983    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="util"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449988    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="util"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449994    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.449999    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450005    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450009    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="pull"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450020    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="util"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450025    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="util"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450074    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03e6f8b-d954-47a8-a98e-77a5f93443bf" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450083    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e82ebe2a-1457-4493-9640-8759715c03d4" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450088    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d578f5-8585-41f6-b95c-5d81b53fdc43" containerName="extract"
Sep 10 23:44:25.450220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.450093    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3933cb-ee7f-4a6a-b64c-a1108f24fb98" containerName="extract"
Sep 10 23:44:25.455746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.455721    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:25.458720 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.458694    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 23:44:25.458899 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.458694    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4xjp5\""
Sep 10 23:44:25.459007 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.458722    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 23:44:25.459487 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.459468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"]
Sep 10 23:44:25.635383 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.635339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48st\" (UniqueName: \"kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st\") pod \"limitador-operator-controller-manager-74495c69f8-9hnmm\" (UID: \"a7b574ad-4be4-43ec-9463-4d63a3a74b2c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:25.736627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.736540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z48st\" (UniqueName: \"kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st\") pod \"limitador-operator-controller-manager-74495c69f8-9hnmm\" (UID: \"a7b574ad-4be4-43ec-9463-4d63a3a74b2c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:25.750616 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.750589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48st\" (UniqueName: \"kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st\") pod \"limitador-operator-controller-manager-74495c69f8-9hnmm\" (UID: \"a7b574ad-4be4-43ec-9463-4d63a3a74b2c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:25.767518 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:25.767474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:26.053743 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:26.053708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"]
Sep 10 23:44:26.055160 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:26.055135    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b574ad_4be4_43ec_9463_4d63a3a74b2c.slice/crio-1a4e6faf20fdb6d832fa22ffa9e63147657d4623f783c6ce82ec83ad5f848ffd WatchSource:0}: Error finding container 1a4e6faf20fdb6d832fa22ffa9e63147657d4623f783c6ce82ec83ad5f848ffd: Status 404 returned error can't find the container with id 1a4e6faf20fdb6d832fa22ffa9e63147657d4623f783c6ce82ec83ad5f848ffd
Sep 10 23:44:26.890591 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:26.890554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm" event={"ID":"a7b574ad-4be4-43ec-9463-4d63a3a74b2c","Type":"ContainerStarted","Data":"1a4e6faf20fdb6d832fa22ffa9e63147657d4623f783c6ce82ec83ad5f848ffd"}
Sep 10 23:44:28.904207 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:28.904174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm" event={"ID":"a7b574ad-4be4-43ec-9463-4d63a3a74b2c","Type":"ContainerStarted","Data":"f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6"}
Sep 10 23:44:28.904616 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:28.904232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:28.923912 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:28.923862    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm" podStartSLOduration=1.6638591900000002 podStartE2EDuration="3.923845151s" totalImagesPullingTime="2.259985961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:28.922224553 +0000 UTC m=+486.021806655" watchObservedRunningTime="2026-09-10 23:44:28.923845151 +0000 UTC m=+486.023427252"
Sep 10 23:44:29.593207 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.593168    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"]
Sep 10 23:44:29.597019 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.596996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.600488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.600470    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fwgcp\""
Sep 10 23:44:29.623449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.623424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"]
Sep 10 23:44:29.668394 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.668354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrg6\" (UniqueName: \"kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.668575 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.668440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.769354 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.769314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.769539 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.769399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrg6\" (UniqueName: \"kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.769711 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.769693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.786091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.786067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrg6\" (UniqueName: \"kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:29.908186 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:29.908050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:30.194447 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:30.194412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"]
Sep 10 23:44:30.196748 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:30.196724    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c9fb1d_fe6a_4860_b24b_335fe897e381.slice/crio-95972aa00ef1cb34f0d985d0365cf058c563466f9edafd5712df19f39b58e749 WatchSource:0}: Error finding container 95972aa00ef1cb34f0d985d0365cf058c563466f9edafd5712df19f39b58e749: Status 404 returned error can't find the container with id 95972aa00ef1cb34f0d985d0365cf058c563466f9edafd5712df19f39b58e749
Sep 10 23:44:30.919686 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:30.919641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j" event={"ID":"94c9fb1d-fe6a-4860-b24b-335fe897e381","Type":"ContainerStarted","Data":"95972aa00ef1cb34f0d985d0365cf058c563466f9edafd5712df19f39b58e749"}
Sep 10 23:44:32.312098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.312058    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-847s8"]
Sep 10 23:44:32.316005 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.315977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:32.324537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.324113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-krst5\""
Sep 10 23:44:32.335922 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.335891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-847s8"]
Sep 10 23:44:32.390273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.390236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4ldw\" (UniqueName: \"kubernetes.io/projected/062cb76c-7ad9-4ede-abc1-438e81232d94-kube-api-access-h4ldw\") pod \"authorino-operator-76b478bd78-847s8\" (UID: \"062cb76c-7ad9-4ede-abc1-438e81232d94\") " pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:32.491711 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.491670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4ldw\" (UniqueName: \"kubernetes.io/projected/062cb76c-7ad9-4ede-abc1-438e81232d94-kube-api-access-h4ldw\") pod \"authorino-operator-76b478bd78-847s8\" (UID: \"062cb76c-7ad9-4ede-abc1-438e81232d94\") " pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:32.503140 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.503116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4ldw\" (UniqueName: \"kubernetes.io/projected/062cb76c-7ad9-4ede-abc1-438e81232d94-kube-api-access-h4ldw\") pod \"authorino-operator-76b478bd78-847s8\" (UID: \"062cb76c-7ad9-4ede-abc1-438e81232d94\") " pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:32.628983 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:32.628894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:33.938713 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:33.938672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j" event={"ID":"94c9fb1d-fe6a-4860-b24b-335fe897e381","Type":"ContainerStarted","Data":"abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743"}
Sep 10 23:44:33.939121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:33.938821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:33.961992 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:33.961905    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j" podStartSLOduration=1.383587178 podStartE2EDuration="4.961889965s" totalImagesPullingTime="3.578302787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:33.960584376 +0000 UTC m=+491.060166491" watchObservedRunningTime="2026-09-10 23:44:33.961889965 +0000 UTC m=+491.061472099"
Sep 10 23:44:33.977239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:33.977216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-847s8"]
Sep 10 23:44:33.979017 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:33.978988    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062cb76c_7ad9_4ede_abc1_438e81232d94.slice/crio-47d54da1af8df4e78d5357ea3ae6368a69a63c54a3f590e81d7f5955e3abedb4 WatchSource:0}: Error finding container 47d54da1af8df4e78d5357ea3ae6368a69a63c54a3f590e81d7f5955e3abedb4: Status 404 returned error can't find the container with id 47d54da1af8df4e78d5357ea3ae6368a69a63c54a3f590e81d7f5955e3abedb4
Sep 10 23:44:34.671305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.671252    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"]
Sep 10 23:44:34.675000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.674984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:34.677492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.677471    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 23:44:34.677625 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.677511    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tkvf2\""
Sep 10 23:44:34.689555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.689532    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"]
Sep 10 23:44:34.710557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.710516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjcjg\" (UniqueName: \"kubernetes.io/projected/31bdf3b0-7ddd-400e-9e65-e9f139367f9a-kube-api-access-gjcjg\") pod \"dns-operator-controller-manager-7b84cd7c9c-btp57\" (UID: \"31bdf3b0-7ddd-400e-9e65-e9f139367f9a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:34.811214 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.811169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjcjg\" (UniqueName: \"kubernetes.io/projected/31bdf3b0-7ddd-400e-9e65-e9f139367f9a-kube-api-access-gjcjg\") pod \"dns-operator-controller-manager-7b84cd7c9c-btp57\" (UID: \"31bdf3b0-7ddd-400e-9e65-e9f139367f9a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:34.820334 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.820275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjcjg\" (UniqueName: \"kubernetes.io/projected/31bdf3b0-7ddd-400e-9e65-e9f139367f9a-kube-api-access-gjcjg\") pod \"dns-operator-controller-manager-7b84cd7c9c-btp57\" (UID: \"31bdf3b0-7ddd-400e-9e65-e9f139367f9a\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:34.946933 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.946847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-847s8" event={"ID":"062cb76c-7ad9-4ede-abc1-438e81232d94","Type":"ContainerStarted","Data":"47d54da1af8df4e78d5357ea3ae6368a69a63c54a3f590e81d7f5955e3abedb4"}
Sep 10 23:44:34.986406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:34.986364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:35.278931 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:35.278902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"]
Sep 10 23:44:35.502404 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:35.502372    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bdf3b0_7ddd_400e_9e65_e9f139367f9a.slice/crio-ce1ae6010964bf1d920e8644e164050d11894d3e190e4fea499bcc40937b7231 WatchSource:0}: Error finding container ce1ae6010964bf1d920e8644e164050d11894d3e190e4fea499bcc40937b7231: Status 404 returned error can't find the container with id ce1ae6010964bf1d920e8644e164050d11894d3e190e4fea499bcc40937b7231
Sep 10 23:44:35.957834 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:35.957794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-847s8" event={"ID":"062cb76c-7ad9-4ede-abc1-438e81232d94","Type":"ContainerStarted","Data":"bf1b3e5dc8fe66d153c7b944bb4ad48a064444c50e825faf86ed89f52371fef8"}
Sep 10 23:44:35.958328 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:35.957872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:35.959275 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:35.959253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57" event={"ID":"31bdf3b0-7ddd-400e-9e65-e9f139367f9a","Type":"ContainerStarted","Data":"ce1ae6010964bf1d920e8644e164050d11894d3e190e4fea499bcc40937b7231"}
Sep 10 23:44:35.976893 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:35.976760    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-847s8" podStartSLOduration=2.396801423 podStartE2EDuration="3.976742011s" totalImagesPullingTime="1.579940588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:35.976148131 +0000 UTC m=+493.075730245" watchObservedRunningTime="2026-09-10 23:44:35.976742011 +0000 UTC m=+493.076324118"
Sep 10 23:44:36.547690 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.547650    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"]
Sep 10 23:44:36.551352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.551322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.553622 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.553599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 23:44:36.553747 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.553622    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 23:44:36.553747 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.553684    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tdvbq\""
Sep 10 23:44:36.561505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.561483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"]
Sep 10 23:44:36.628436 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.628407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.628617 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.628484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xx2\" (UniqueName: \"kubernetes.io/projected/1ed876f7-30be-4067-8449-f798ceb413c2-kube-api-access-f4xx2\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.628617 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.628510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed876f7-30be-4067-8449-f798ceb413c2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.729315 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.729250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xx2\" (UniqueName: \"kubernetes.io/projected/1ed876f7-30be-4067-8449-f798ceb413c2-kube-api-access-f4xx2\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.729518 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.729343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed876f7-30be-4067-8449-f798ceb413c2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.729518 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.729409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.729758 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:36.729530    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 10 23:44:36.729758 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:36.729601    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert podName:1ed876f7-30be-4067-8449-f798ceb413c2 nodeName:}" failed. No retries permitted until 2026-09-10 23:44:37.229580337 +0000 UTC m=+494.329162418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-d6mqc" (UID: "1ed876f7-30be-4067-8449-f798ceb413c2") : secret "plugin-serving-cert" not found
Sep 10 23:44:36.730061 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.730043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ed876f7-30be-4067-8449-f798ceb413c2-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:36.737641 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:36.737613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xx2\" (UniqueName: \"kubernetes.io/projected/1ed876f7-30be-4067-8449-f798ceb413c2-kube-api-access-f4xx2\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:37.235015 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.234979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:37.238150 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.238128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ed876f7-30be-4067-8449-f798ceb413c2-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-d6mqc\" (UID: \"1ed876f7-30be-4067-8449-f798ceb413c2\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:37.460862 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.460827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"
Sep 10 23:44:37.943868 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.943841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc"]
Sep 10 23:44:37.945643 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:37.945616    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ed876f7_30be_4067_8449_f798ceb413c2.slice/crio-9c14977525169153619b1585d4da63d3ae969101ec080765659e5b477b1a76f0 WatchSource:0}: Error finding container 9c14977525169153619b1585d4da63d3ae969101ec080765659e5b477b1a76f0: Status 404 returned error can't find the container with id 9c14977525169153619b1585d4da63d3ae969101ec080765659e5b477b1a76f0
Sep 10 23:44:37.973441 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.973410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57" event={"ID":"31bdf3b0-7ddd-400e-9e65-e9f139367f9a","Type":"ContainerStarted","Data":"8f6d43728f9b3a68d6b7400237d42394c83a3c7ce35e8891f4ef85f6c88a41a7"}
Sep 10 23:44:37.973643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.973626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:37.974724 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:37.974703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc" event={"ID":"1ed876f7-30be-4067-8449-f798ceb413c2","Type":"ContainerStarted","Data":"9c14977525169153619b1585d4da63d3ae969101ec080765659e5b477b1a76f0"}
Sep 10 23:44:38.018748 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:38.018696    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57" podStartSLOduration=1.801353378 podStartE2EDuration="4.018678614s" totalImagesPullingTime="2.217325236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:38.016259804 +0000 UTC m=+495.115841930" watchObservedRunningTime="2026-09-10 23:44:38.018678614 +0000 UTC m=+495.118260716"
Sep 10 23:44:39.915849 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:39.915813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:43.011934 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:43.011829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc" event={"ID":"1ed876f7-30be-4067-8449-f798ceb413c2","Type":"ContainerStarted","Data":"030140b0d5de0478ff1ebf663f684efd49908deba3c030855519b47b92c0a155"}
Sep 10 23:44:43.032857 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:43.032805    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-d6mqc" podStartSLOduration=2.286216007 podStartE2EDuration="7.032787264s" totalImagesPullingTime="4.746571257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:43.030192212 +0000 UTC m=+500.129774315" watchObservedRunningTime="2026-09-10 23:44:43.032787264 +0000 UTC m=+500.132369365"
Sep 10 23:44:44.949580 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:44.949543    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:46.948023 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.947982    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"]
Sep 10 23:44:46.948442 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.948186    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" containerName="manager" containerID="cri-o://abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743" gracePeriod=2
Sep 10 23:44:46.956995 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.956964    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"]
Sep 10 23:44:46.963651 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:46.963603    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"94c9fb1d-fe6a-4860-b24b-335fe897e381\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\": pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:46.968687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.968666    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-847s8"
Sep 10 23:44:46.970277 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.970260    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:44:46.970700 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.970683    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" containerName="manager"
Sep 10 23:44:46.970780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.970703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" containerName="manager"
Sep 10 23:44:46.970839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.970824    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" containerName="manager"
Sep 10 23:44:46.974019 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.973996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"]
Sep 10 23:44:46.974145 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.974124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:46.974201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.974185    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" containerName="manager" containerID="cri-o://f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6" gracePeriod=2
Sep 10 23:44:46.975330 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.975307    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"]
Sep 10 23:44:46.987189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.987159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:44:46.989108 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:46.989075    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:46.990853 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:46.990826    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:46.992688 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:46.992652    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9hnmm\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:46.994316 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.994269    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"]
Sep 10 23:44:46.995003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.994809    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" containerName="manager"
Sep 10 23:44:46.995003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.994830    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" containerName="manager"
Sep 10 23:44:46.995003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.994916    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" containerName="manager"
Sep 10 23:44:46.998225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:46.998209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:47.013865 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.013827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"]
Sep 10 23:44:47.023761 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.023730    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9hnmm\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:47.030090 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.030061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.030227 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.030186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5j2\" (UniqueName: \"kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.044394 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.044355    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:47.131445 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.131410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.131637 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.131482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5j2\" (UniqueName: \"kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.131637 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.131539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tm77\" (UniqueName: \"kubernetes.io/projected/a0b798d9-8935-4756-9618-4a6cadbd871a-kube-api-access-5tm77\") pod \"limitador-operator-controller-manager-74495c69f8-vd4qv\" (UID: \"a0b798d9-8935-4756-9618-4a6cadbd871a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:47.131827 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.131801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.141091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.141061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5j2\" (UniqueName: \"kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snmsp\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.224917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.224895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:47.227266 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.227235    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9hnmm\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:47.227579 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.227562    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:47.229186 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.229165    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:47.230863 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.230840    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-9hnmm\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:47.232181 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.232160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tm77\" (UniqueName: \"kubernetes.io/projected/a0b798d9-8935-4756-9618-4a6cadbd871a-kube-api-access-5tm77\") pod \"limitador-operator-controller-manager-74495c69f8-vd4qv\" (UID: \"a0b798d9-8935-4756-9618-4a6cadbd871a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:47.232312 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:47.232272    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-lfr6j\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:47.243983 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.243954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tm77\" (UniqueName: \"kubernetes.io/projected/a0b798d9-8935-4756-9618-4a6cadbd871a-kube-api-access-5tm77\") pod \"limitador-operator-controller-manager-74495c69f8-vd4qv\" (UID: \"a0b798d9-8935-4756-9618-4a6cadbd871a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:47.333312 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.333257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48st\" (UniqueName: \"kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st\") pod \"a7b574ad-4be4-43ec-9463-4d63a3a74b2c\" (UID: \"a7b574ad-4be4-43ec-9463-4d63a3a74b2c\") "
Sep 10 23:44:47.333488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.333325    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrg6\" (UniqueName: \"kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6\") pod \"94c9fb1d-fe6a-4860-b24b-335fe897e381\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") "
Sep 10 23:44:47.333488 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.333401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume\") pod \"94c9fb1d-fe6a-4860-b24b-335fe897e381\" (UID: \"94c9fb1d-fe6a-4860-b24b-335fe897e381\") "
Sep 10 23:44:47.333898 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.333872    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94c9fb1d-fe6a-4860-b24b-335fe897e381" (UID: "94c9fb1d-fe6a-4860-b24b-335fe897e381"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:44:47.335647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.335625    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st" (OuterVolumeSpecName: "kube-api-access-z48st") pod "a7b574ad-4be4-43ec-9463-4d63a3a74b2c" (UID: "a7b574ad-4be4-43ec-9463-4d63a3a74b2c"). InnerVolumeSpecName "kube-api-access-z48st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:47.335736 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.335672    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6" (OuterVolumeSpecName: "kube-api-access-rtrg6") pod "94c9fb1d-fe6a-4860-b24b-335fe897e381" (UID: "94c9fb1d-fe6a-4860-b24b-335fe897e381"). InnerVolumeSpecName "kube-api-access-rtrg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:44:47.371541 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.371496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:47.379645 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.379616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:47.435351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.435093    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48st\" (UniqueName: \"kubernetes.io/projected/a7b574ad-4be4-43ec-9463-4d63a3a74b2c-kube-api-access-z48st\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:47.435351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.435123    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtrg6\" (UniqueName: \"kubernetes.io/projected/94c9fb1d-fe6a-4860-b24b-335fe897e381-kube-api-access-rtrg6\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:47.435351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.435136    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94c9fb1d-fe6a-4860-b24b-335fe897e381-extensions-socket-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:44:47.457395 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.457318    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c9fb1d-fe6a-4860-b24b-335fe897e381" path="/var/lib/kubelet/pods/94c9fb1d-fe6a-4860-b24b-335fe897e381/volumes"
Sep 10 23:44:47.457872 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.457853    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" path="/var/lib/kubelet/pods/a7b574ad-4be4-43ec-9463-4d63a3a74b2c/volumes"
Sep 10 23:44:47.667337 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:47.667309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66b2985_27b3_4786_b951_bc7c8de12169.slice/crio-5de7d357761a0b822a9f2129998159ce653d14c72d3c47d7060078303df66a75 WatchSource:0}: Error finding container 5de7d357761a0b822a9f2129998159ce653d14c72d3c47d7060078303df66a75: Status 404 returned error can't find the container with id 5de7d357761a0b822a9f2129998159ce653d14c72d3c47d7060078303df66a75
Sep 10 23:44:47.669217 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.669185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:44:47.674805 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:47.674769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"]
Sep 10 23:44:47.687805 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:44:47.687778    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b798d9_8935_4756_9618_4a6cadbd871a.slice/crio-2ff0f601fa6f97fb9b9b828645ed22c2c3552c64d489d43107bd7bc0e8cfe990 WatchSource:0}: Error finding container 2ff0f601fa6f97fb9b9b828645ed22c2c3552c64d489d43107bd7bc0e8cfe990: Status 404 returned error can't find the container with id 2ff0f601fa6f97fb9b9b828645ed22c2c3552c64d489d43107bd7bc0e8cfe990
Sep 10 23:44:48.046465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.046431    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7b574ad-4be4-43ec-9463-4d63a3a74b2c" containerID="f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6" exitCode=0
Sep 10 23:44:48.046891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.046489    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-9hnmm"
Sep 10 23:44:48.046891 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.046511    2581 scope.go:117] "RemoveContainer" containerID="f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6"
Sep 10 23:44:48.048100 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.048078    2581 generic.go:356] "Generic (PLEG): container finished" podID="94c9fb1d-fe6a-4860-b24b-335fe897e381" containerID="abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743" exitCode=0
Sep 10 23:44:48.048207 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.048147    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lfr6j"
Sep 10 23:44:48.049957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.049935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv" event={"ID":"a0b798d9-8935-4756-9618-4a6cadbd871a","Type":"ContainerStarted","Data":"a71b1c4f635829a0a7901c0a67619bcc47ff99daacb44f9c23559cc0cfe928ff"}
Sep 10 23:44:48.050057 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.049978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv" event={"ID":"a0b798d9-8935-4756-9618-4a6cadbd871a","Type":"ContainerStarted","Data":"2ff0f601fa6f97fb9b9b828645ed22c2c3552c64d489d43107bd7bc0e8cfe990"}
Sep 10 23:44:48.050057 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.050034    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:48.052043 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.052021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" event={"ID":"d66b2985-27b3-4786-b951-bc7c8de12169","Type":"ContainerStarted","Data":"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"}
Sep 10 23:44:48.052134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.052068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" event={"ID":"d66b2985-27b3-4786-b951-bc7c8de12169","Type":"ContainerStarted","Data":"5de7d357761a0b822a9f2129998159ce653d14c72d3c47d7060078303df66a75"}
Sep 10 23:44:48.052134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.052095    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:44:48.056171 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.056157    2581 scope.go:117] "RemoveContainer" containerID="f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6"
Sep 10 23:44:48.056505 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:48.056488    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6\": container with ID starting with f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6 not found: ID does not exist" containerID="f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6"
Sep 10 23:44:48.056556 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.056513    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6"} err="failed to get container status \"f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6\": rpc error: code = NotFound desc = could not find container \"f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6\": container with ID starting with f4817654292c8cad4e03993a709e7d329b8004b07c5323095d001e9e1d310ae6 not found: ID does not exist"
Sep 10 23:44:48.056556 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.056528    2581 scope.go:117] "RemoveContainer" containerID="abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743"
Sep 10 23:44:48.064750 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.064734    2581 scope.go:117] "RemoveContainer" containerID="abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743"
Sep 10 23:44:48.065011 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:44:48.064993    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743\": container with ID starting with abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743 not found: ID does not exist" containerID="abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743"
Sep 10 23:44:48.065080 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.065030    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743"} err="failed to get container status \"abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743\": rpc error: code = NotFound desc = could not find container \"abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743\": container with ID starting with abc6000b490c1493f4ba2273bcfd5492eebd72bf1f64703308f7f2b26f040743 not found: ID does not exist"
Sep 10 23:44:48.069579 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.069542    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv" podStartSLOduration=2.0695292690000002 podStartE2EDuration="2.069529269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:48.068790407 +0000 UTC m=+505.168372514" watchObservedRunningTime="2026-09-10 23:44:48.069529269 +0000 UTC m=+505.169111371"
Sep 10 23:44:48.091043 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.090992    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" podStartSLOduration=2.090970831 podStartE2EDuration="2.090970831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:44:48.089679326 +0000 UTC m=+505.189261427" watchObservedRunningTime="2026-09-10 23:44:48.090970831 +0000 UTC m=+505.190552934"
Sep 10 23:44:48.985674 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:48.985644    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-btp57"
Sep 10 23:44:59.062476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:59.062448    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vd4qv"
Sep 10 23:44:59.062939 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:44:59.062518    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:45:04.824303 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:04.824256    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:45:04.824788 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:04.824481    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" podUID="d66b2985-27b3-4786-b951-bc7c8de12169" containerName="manager" containerID="cri-o://ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262" gracePeriod=10
Sep 10 23:45:05.073082 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.073056    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:45:05.153615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.153526    2581 generic.go:356] "Generic (PLEG): container finished" podID="d66b2985-27b3-4786-b951-bc7c8de12169" containerID="ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262" exitCode=0
Sep 10 23:45:05.153615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.153565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" event={"ID":"d66b2985-27b3-4786-b951-bc7c8de12169","Type":"ContainerDied","Data":"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"}
Sep 10 23:45:05.153615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.153571    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"
Sep 10 23:45:05.153615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.153604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp" event={"ID":"d66b2985-27b3-4786-b951-bc7c8de12169","Type":"ContainerDied","Data":"5de7d357761a0b822a9f2129998159ce653d14c72d3c47d7060078303df66a75"}
Sep 10 23:45:05.153887 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.153626    2581 scope.go:117] "RemoveContainer" containerID="ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"
Sep 10 23:45:05.162602 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.162573    2581 scope.go:117] "RemoveContainer" containerID="ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"
Sep 10 23:45:05.162887 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:05.162870    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262\": container with ID starting with ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262 not found: ID does not exist" containerID="ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"
Sep 10 23:45:05.162965 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.162899    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262"} err="failed to get container status \"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262\": rpc error: code = NotFound desc = could not find container \"ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262\": container with ID starting with ed5a3fa74d86cb96f0de3eafb22a4b379c760bf76287ca92be800127208ed262 not found: ID does not exist"
Sep 10 23:45:05.200239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.200212    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume\") pod \"d66b2985-27b3-4786-b951-bc7c8de12169\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") "
Sep 10 23:45:05.200407 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.200246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j5j2\" (UniqueName: \"kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2\") pod \"d66b2985-27b3-4786-b951-bc7c8de12169\" (UID: \"d66b2985-27b3-4786-b951-bc7c8de12169\") "
Sep 10 23:45:05.200675 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.200652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d66b2985-27b3-4786-b951-bc7c8de12169" (UID: "d66b2985-27b3-4786-b951-bc7c8de12169"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:45:05.202462 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.202434    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2" (OuterVolumeSpecName: "kube-api-access-4j5j2") pod "d66b2985-27b3-4786-b951-bc7c8de12169" (UID: "d66b2985-27b3-4786-b951-bc7c8de12169"). InnerVolumeSpecName "kube-api-access-4j5j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:05.301035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.301000    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d66b2985-27b3-4786-b951-bc7c8de12169-extensions-socket-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:05.301035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.301027    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j5j2\" (UniqueName: \"kubernetes.io/projected/d66b2985-27b3-4786-b951-bc7c8de12169-kube-api-access-4j5j2\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:05.478546 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.478515    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:45:05.485258 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:05.485231    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snmsp"]
Sep 10 23:45:07.448874 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:07.448833    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66b2985-27b3-4786-b951-bc7c8de12169" path="/var/lib/kubelet/pods/d66b2985-27b3-4786-b951-bc7c8de12169/volumes"
Sep 10 23:45:21.212639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.212523    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"]
Sep 10 23:45:21.213072 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.213059    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66b2985-27b3-4786-b951-bc7c8de12169" containerName="manager"
Sep 10 23:45:21.213136 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.213077    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66b2985-27b3-4786-b951-bc7c8de12169" containerName="manager"
Sep 10 23:45:21.213205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.213161    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66b2985-27b3-4786-b951-bc7c8de12169" containerName="manager"
Sep 10 23:45:21.216397 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.216374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.219098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.219077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:45:21.219205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.219077    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2n45f\""
Sep 10 23:45:21.232441 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.232417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"]
Sep 10 23:45:21.247200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247385 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d972cc9-2a27-4208-9aec-d15b73532793-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bvt\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-kube-api-access-27bvt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.247550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.247509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d972cc9-2a27-4208-9aec-d15b73532793-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348053 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348053 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348319 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348319 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348319 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d972cc9-2a27-4208-9aec-d15b73532793-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348319 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bvt\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-kube-api-access-27bvt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d972cc9-2a27-4208-9aec-d15b73532793-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348708 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348708 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.348816 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.348743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.349121 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.349105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d972cc9-2a27-4208-9aec-d15b73532793-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.350484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.350462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d972cc9-2a27-4208-9aec-d15b73532793-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.350822 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.350805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d972cc9-2a27-4208-9aec-d15b73532793-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.355729 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.355709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.355975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.355956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bvt\" (UniqueName: \"kubernetes.io/projected/0d972cc9-2a27-4208-9aec-d15b73532793-kube-api-access-27bvt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pfjmc\" (UID: \"0d972cc9-2a27-4208-9aec-d15b73532793\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.526782 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.526706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:21.800252 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.800224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"]
Sep 10 23:45:21.801983 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:21.801955    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d972cc9_2a27_4208_9aec_d15b73532793.slice/crio-229d4b9c6013576782c395131860e18d59fe23c9917b35fa0205d4efb20d095d WatchSource:0}: Error finding container 229d4b9c6013576782c395131860e18d59fe23c9917b35fa0205d4efb20d095d: Status 404 returned error can't find the container with id 229d4b9c6013576782c395131860e18d59fe23c9917b35fa0205d4efb20d095d
Sep 10 23:45:21.803991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.803963    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:45:21.804052 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.804040    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:45:21.804101 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:21.804076    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:45:22.248270 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:22.248229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" event={"ID":"0d972cc9-2a27-4208-9aec-d15b73532793","Type":"ContainerStarted","Data":"d6dc322eb381ca4bd2d2646c106ac52a9720d31200070ac0f0ee48b3f97f8fad"}
Sep 10 23:45:22.248762 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:22.248308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" event={"ID":"0d972cc9-2a27-4208-9aec-d15b73532793","Type":"ContainerStarted","Data":"229d4b9c6013576782c395131860e18d59fe23c9917b35fa0205d4efb20d095d"}
Sep 10 23:45:22.269368 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:22.269316    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podStartSLOduration=1.269300026 podStartE2EDuration="1.269300026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:22.266989577 +0000 UTC m=+539.366571690" watchObservedRunningTime="2026-09-10 23:45:22.269300026 +0000 UTC m=+539.368882124"
Sep 10 23:45:22.527761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:22.527663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:22.532645 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:22.532617    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:23.255373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.255332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:23.256498 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.256480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:45:23.337038 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.337002    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:23.340543 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.340518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.342647 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.342622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 23:45:23.350759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.350732    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:23.367457 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.367423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.367620 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.367467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxkk2\" (UniqueName: \"kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.434823 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.434785    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:23.467994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.467966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.467994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.467997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxkk2\" (UniqueName: \"kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.468671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.468647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.475715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.475692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxkk2\" (UniqueName: \"kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2\") pod \"limitador-limitador-8588749977-t6s7k\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") " pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.652388 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.652273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:23.927878 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:23.927848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:23.929129 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:23.929096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c609d6_e8ce_43c7_9be6_64ada822db14.slice/crio-09d329e6f957d4088bfd553d7a7b780d8402be15f2e8c965684c2298b6039081 WatchSource:0}: Error finding container 09d329e6f957d4088bfd553d7a7b780d8402be15f2e8c965684c2298b6039081: Status 404 returned error can't find the container with id 09d329e6f957d4088bfd553d7a7b780d8402be15f2e8c965684c2298b6039081
Sep 10 23:45:24.119217 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.119184    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:24.123918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.123898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:24.126814 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.126791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bp8fw\""
Sep 10 23:45:24.128932 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.128903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:24.175550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.175517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hbl\" (UniqueName: \"kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl\") pod \"authorino-7bcfd8f9cd-qgrkx\" (UID: \"96066a06-bf82-4a7f-89f3-ec1521ffa782\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:24.262945 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.262834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" event={"ID":"66c609d6-e8ce-43c7-9be6-64ada822db14","Type":"ContainerStarted","Data":"09d329e6f957d4088bfd553d7a7b780d8402be15f2e8c965684c2298b6039081"}
Sep 10 23:45:24.276736 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.276704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hbl\" (UniqueName: \"kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl\") pod \"authorino-7bcfd8f9cd-qgrkx\" (UID: \"96066a06-bf82-4a7f-89f3-ec1521ffa782\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:24.284177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.284149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hbl\" (UniqueName: \"kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl\") pod \"authorino-7bcfd8f9cd-qgrkx\" (UID: \"96066a06-bf82-4a7f-89f3-ec1521ffa782\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:24.314205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.314171    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:24.317867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.317845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:24.323561 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.323535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:24.377503 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.377474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspxr\" (UniqueName: \"kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr\") pod \"authorino-59c974bd48-lkqk8\" (UID: \"662d35d8-e05a-4b5e-9293-22d2fe46bb28\") " pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:24.434808 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.434771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:24.478423 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.478390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspxr\" (UniqueName: \"kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr\") pod \"authorino-59c974bd48-lkqk8\" (UID: \"662d35d8-e05a-4b5e-9293-22d2fe46bb28\") " pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:24.486838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.486737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspxr\" (UniqueName: \"kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr\") pod \"authorino-59c974bd48-lkqk8\" (UID: \"662d35d8-e05a-4b5e-9293-22d2fe46bb28\") " pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:24.628420 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.628259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:24.711201 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.711170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:24.713078 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:24.713048    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96066a06_bf82_4a7f_89f3_ec1521ffa782.slice/crio-42bb40c4cdd5093b4d60ba81c69f06a5793062313b6a0ef225d611fef04c10f6 WatchSource:0}: Error finding container 42bb40c4cdd5093b4d60ba81c69f06a5793062313b6a0ef225d611fef04c10f6: Status 404 returned error can't find the container with id 42bb40c4cdd5093b4d60ba81c69f06a5793062313b6a0ef225d611fef04c10f6
Sep 10 23:45:24.912733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:24.912705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:24.960609 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:24.960576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod662d35d8_e05a_4b5e_9293_22d2fe46bb28.slice/crio-87deabce22174b44fc686ff74e2d9841150c9ce2bbac33976ffe002f81636785 WatchSource:0}: Error finding container 87deabce22174b44fc686ff74e2d9841150c9ce2bbac33976ffe002f81636785: Status 404 returned error can't find the container with id 87deabce22174b44fc686ff74e2d9841150c9ce2bbac33976ffe002f81636785
Sep 10 23:45:25.271713 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:25.271615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-lkqk8" event={"ID":"662d35d8-e05a-4b5e-9293-22d2fe46bb28","Type":"ContainerStarted","Data":"87deabce22174b44fc686ff74e2d9841150c9ce2bbac33976ffe002f81636785"}
Sep 10 23:45:25.273627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:25.273584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" event={"ID":"66c609d6-e8ce-43c7-9be6-64ada822db14","Type":"ContainerStarted","Data":"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"}
Sep 10 23:45:25.273774 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:25.273696    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:25.275015 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:25.274990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" event={"ID":"96066a06-bf82-4a7f-89f3-ec1521ffa782","Type":"ContainerStarted","Data":"42bb40c4cdd5093b4d60ba81c69f06a5793062313b6a0ef225d611fef04c10f6"}
Sep 10 23:45:25.291842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:25.291794    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" podStartSLOduration=1.203698787 podStartE2EDuration="2.291776398s" totalImagesPullingTime="1.088077611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:25.28913345 +0000 UTC m=+542.388715562" watchObservedRunningTime="2026-09-10 23:45:25.291776398 +0000 UTC m=+542.391358498"
Sep 10 23:45:26.290418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:26.290383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" event={"ID":"96066a06-bf82-4a7f-89f3-ec1521ffa782","Type":"ContainerStarted","Data":"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"}
Sep 10 23:45:26.293469 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:26.293435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-lkqk8" event={"ID":"662d35d8-e05a-4b5e-9293-22d2fe46bb28","Type":"ContainerStarted","Data":"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"}
Sep 10 23:45:26.320805 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:26.320752    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" podStartSLOduration=0.852535217 podStartE2EDuration="2.320735759s" totalImagesPullingTime="1.468200542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:26.310887193 +0000 UTC m=+543.410469295" watchObservedRunningTime="2026-09-10 23:45:26.320735759 +0000 UTC m=+543.420317859"
Sep 10 23:45:26.368792 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:26.368711    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-lkqk8" podStartSLOduration=1.143424135 podStartE2EDuration="2.368688754s" totalImagesPullingTime="1.225264619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:26.364525318 +0000 UTC m=+543.464107421" watchObservedRunningTime="2026-09-10 23:45:26.368688754 +0000 UTC m=+543.468270857"
Sep 10 23:45:26.437158 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:26.437082    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:28.304903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:28.304856    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" podUID="96066a06-bf82-4a7f-89f3-ec1521ffa782" containerName="authorino" containerID="cri-o://90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94" gracePeriod=30
Sep 10 23:45:28.548045 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:28.548018    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:28.619035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:28.618944    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85hbl\" (UniqueName: \"kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl\") pod \"96066a06-bf82-4a7f-89f3-ec1521ffa782\" (UID: \"96066a06-bf82-4a7f-89f3-ec1521ffa782\") "
Sep 10 23:45:28.621230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:28.621207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl" (OuterVolumeSpecName: "kube-api-access-85hbl") pod "96066a06-bf82-4a7f-89f3-ec1521ffa782" (UID: "96066a06-bf82-4a7f-89f3-ec1521ffa782"). InnerVolumeSpecName "kube-api-access-85hbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:28.720034 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:28.719994    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85hbl\" (UniqueName: \"kubernetes.io/projected/96066a06-bf82-4a7f-89f3-ec1521ffa782-kube-api-access-85hbl\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:29.311280 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.311243    2581 generic.go:356] "Generic (PLEG): container finished" podID="96066a06-bf82-4a7f-89f3-ec1521ffa782" containerID="90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94" exitCode=0
Sep 10 23:45:29.311737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.311315    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx"
Sep 10 23:45:29.311737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.311327    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" event={"ID":"96066a06-bf82-4a7f-89f3-ec1521ffa782","Type":"ContainerDied","Data":"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"}
Sep 10 23:45:29.311737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.311377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qgrkx" event={"ID":"96066a06-bf82-4a7f-89f3-ec1521ffa782","Type":"ContainerDied","Data":"42bb40c4cdd5093b4d60ba81c69f06a5793062313b6a0ef225d611fef04c10f6"}
Sep 10 23:45:29.311737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.311394    2581 scope.go:117] "RemoveContainer" containerID="90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"
Sep 10 23:45:29.321951 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.321932    2581 scope.go:117] "RemoveContainer" containerID="90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"
Sep 10 23:45:29.322225 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:29.322207    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94\": container with ID starting with 90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94 not found: ID does not exist" containerID="90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"
Sep 10 23:45:29.322322 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.322233    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94"} err="failed to get container status \"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94\": rpc error: code = NotFound desc = could not find container \"90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94\": container with ID starting with 90fc6dab1b1f5584effc8da6489e24fa4e7e93030a4bb7b0d25fa663ecc5bb94 not found: ID does not exist"
Sep 10 23:45:29.332269 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.332244    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:29.337623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.337602    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qgrkx"]
Sep 10 23:45:29.450010 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:29.449979    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96066a06-bf82-4a7f-89f3-ec1521ffa782" path="/var/lib/kubelet/pods/96066a06-bf82-4a7f-89f3-ec1521ffa782/volumes"
Sep 10 23:45:36.294394 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:36.294367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:36.967189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:36.967152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:36.967421 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:36.967392    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" podUID="66c609d6-e8ce-43c7-9be6-64ada822db14" containerName="limitador" containerID="cri-o://9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea" gracePeriod=30
Sep 10 23:45:37.525800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.525777    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:37.607325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.607207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxkk2\" (UniqueName: \"kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2\") pod \"66c609d6-e8ce-43c7-9be6-64ada822db14\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") "
Sep 10 23:45:37.607493 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.607371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file\") pod \"66c609d6-e8ce-43c7-9be6-64ada822db14\" (UID: \"66c609d6-e8ce-43c7-9be6-64ada822db14\") "
Sep 10 23:45:37.607728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.607706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file" (OuterVolumeSpecName: "config-file") pod "66c609d6-e8ce-43c7-9be6-64ada822db14" (UID: "66c609d6-e8ce-43c7-9be6-64ada822db14"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:45:37.609470 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.609449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2" (OuterVolumeSpecName: "kube-api-access-wxkk2") pod "66c609d6-e8ce-43c7-9be6-64ada822db14" (UID: "66c609d6-e8ce-43c7-9be6-64ada822db14"). InnerVolumeSpecName "kube-api-access-wxkk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:37.708864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.708825    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxkk2\" (UniqueName: \"kubernetes.io/projected/66c609d6-e8ce-43c7-9be6-64ada822db14-kube-api-access-wxkk2\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:37.708864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:37.708859    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66c609d6-e8ce-43c7-9be6-64ada822db14-config-file\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:38.363191 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.363156    2581 generic.go:356] "Generic (PLEG): container finished" podID="66c609d6-e8ce-43c7-9be6-64ada822db14" containerID="9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea" exitCode=0
Sep 10 23:45:38.363412 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.363208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k"
Sep 10 23:45:38.363412 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.363243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" event={"ID":"66c609d6-e8ce-43c7-9be6-64ada822db14","Type":"ContainerDied","Data":"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"}
Sep 10 23:45:38.363412 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.363315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t6s7k" event={"ID":"66c609d6-e8ce-43c7-9be6-64ada822db14","Type":"ContainerDied","Data":"09d329e6f957d4088bfd553d7a7b780d8402be15f2e8c965684c2298b6039081"}
Sep 10 23:45:38.363412 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.363337    2581 scope.go:117] "RemoveContainer" containerID="9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"
Sep 10 23:45:38.372635 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.372618    2581 scope.go:117] "RemoveContainer" containerID="9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"
Sep 10 23:45:38.372951 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:38.372931    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea\": container with ID starting with 9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea not found: ID does not exist" containerID="9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"
Sep 10 23:45:38.373030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.372959    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea"} err="failed to get container status \"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea\": rpc error: code = NotFound desc = could not find container \"9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea\": container with ID starting with 9604d92157fb0d53d719c0ecab641cf943c699604d72e3feaa96ef6052c69bea not found: ID does not exist"
Sep 10 23:45:38.384113 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.384085    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:38.387546 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:38.387525    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t6s7k"]
Sep 10 23:45:39.450096 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.450061    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c609d6-e8ce-43c7-9be6-64ada822db14" path="/var/lib/kubelet/pods/66c609d6-e8ce-43c7-9be6-64ada822db14/volumes"
Sep 10 23:45:39.959706 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.959675    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"]
Sep 10 23:45:39.960064 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960052    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c609d6-e8ce-43c7-9be6-64ada822db14" containerName="limitador"
Sep 10 23:45:39.960108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960066    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c609d6-e8ce-43c7-9be6-64ada822db14" containerName="limitador"
Sep 10 23:45:39.960108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960083    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96066a06-bf82-4a7f-89f3-ec1521ffa782" containerName="authorino"
Sep 10 23:45:39.960108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960088    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96066a06-bf82-4a7f-89f3-ec1521ffa782" containerName="authorino"
Sep 10 23:45:39.960200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960144    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96066a06-bf82-4a7f-89f3-ec1521ffa782" containerName="authorino"
Sep 10 23:45:39.960200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.960154    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c609d6-e8ce-43c7-9be6-64ada822db14" containerName="limitador"
Sep 10 23:45:39.964686 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.964661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:39.967041 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.967019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 23:45:39.967169 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.967066    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:45:39.967169 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.967066    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 23:45:39.968279 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.968247    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5tpl7\""
Sep 10 23:45:39.970994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:39.970970    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"]
Sep 10 23:45:40.132692 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.132660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z8pj\" (UniqueName: \"kubernetes.io/projected/7d1f0563-37b0-4526-ba94-d95a6506902a-kube-api-access-9z8pj\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.132880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.132727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d1f0563-37b0-4526-ba94-d95a6506902a-data\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.233220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.233135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z8pj\" (UniqueName: \"kubernetes.io/projected/7d1f0563-37b0-4526-ba94-d95a6506902a-kube-api-access-9z8pj\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.233220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.233199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d1f0563-37b0-4526-ba94-d95a6506902a-data\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.233558 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.233541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d1f0563-37b0-4526-ba94-d95a6506902a-data\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.241215 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.241184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z8pj\" (UniqueName: \"kubernetes.io/projected/7d1f0563-37b0-4526-ba94-d95a6506902a-kube-api-access-9z8pj\") pod \"postgres-69fb4594cf-kt9cv\" (UID: \"7d1f0563-37b0-4526-ba94-d95a6506902a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.276193 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.276160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:40.546058 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:40.546027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"]
Sep 10 23:45:40.547013 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:40.546995    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1f0563_37b0_4526_ba94_d95a6506902a.slice/crio-4826c3ec34e37f8503572f4b8c30e24c898bc2d3a89d08ac035aa397ad63c9e5 WatchSource:0}: Error finding container 4826c3ec34e37f8503572f4b8c30e24c898bc2d3a89d08ac035aa397ad63c9e5: Status 404 returned error can't find the container with id 4826c3ec34e37f8503572f4b8c30e24c898bc2d3a89d08ac035aa397ad63c9e5
Sep 10 23:45:41.383057 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:41.383021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv" event={"ID":"7d1f0563-37b0-4526-ba94-d95a6506902a","Type":"ContainerStarted","Data":"4826c3ec34e37f8503572f4b8c30e24c898bc2d3a89d08ac035aa397ad63c9e5"}
Sep 10 23:45:44.400856 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:44.400816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv" event={"ID":"7d1f0563-37b0-4526-ba94-d95a6506902a","Type":"ContainerStarted","Data":"3945aa04cbced7a0d4dc8ee5c5c3d9baf7b7fc6acb60d022549fbd2962fd591b"}
Sep 10 23:45:44.401426 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:44.400878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:44.416225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:44.416170    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv" podStartSLOduration=1.7948248470000001 podStartE2EDuration="5.41615188s" totalImagesPullingTime="3.621327033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:44.414109231 +0000 UTC m=+561.513691332" watchObservedRunningTime="2026-09-10 23:45:44.41615188 +0000 UTC m=+561.515734032"
Sep 10 23:45:50.435469 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:50.435439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kt9cv"
Sep 10 23:45:51.024673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.024638    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-6wq8p"]
Sep 10 23:45:51.031222 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.031197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.034951 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.034928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-6wq8p"]
Sep 10 23:45:51.134821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.134788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7q4q\" (UniqueName: \"kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q\") pod \"authorino-557f876f69-6wq8p\" (UID: \"9df68422-c7fa-40ba-ac26-41add89b48ca\") " pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.150928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.150891    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6wq8p"]
Sep 10 23:45:51.151255 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:51.151236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-v7q4q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-6wq8p" podUID="9df68422-c7fa-40ba-ac26-41add89b48ca"
Sep 10 23:45:51.236084 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.236049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7q4q\" (UniqueName: \"kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q\") pod \"authorino-557f876f69-6wq8p\" (UID: \"9df68422-c7fa-40ba-ac26-41add89b48ca\") " pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.249104 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.249076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7q4q\" (UniqueName: \"kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q\") pod \"authorino-557f876f69-6wq8p\" (UID: \"9df68422-c7fa-40ba-ac26-41add89b48ca\") " pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.367492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.367410    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:45:51.372189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.372171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.374693 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.374672    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 23:45:51.382494 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.382473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:45:51.445945 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.445911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.453770 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.453748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:51.539278 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.539247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.539477 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.539306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9k7\" (UniqueName: \"kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.640232 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.640130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7q4q\" (UniqueName: \"kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q\") pod \"9df68422-c7fa-40ba-ac26-41add89b48ca\" (UID: \"9df68422-c7fa-40ba-ac26-41add89b48ca\") "
Sep 10 23:45:51.640449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.640407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.640449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.640438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9k7\" (UniqueName: \"kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.642630 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.642513    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q" (OuterVolumeSpecName: "kube-api-access-v7q4q") pod "9df68422-c7fa-40ba-ac26-41add89b48ca" (UID: "9df68422-c7fa-40ba-ac26-41add89b48ca"). InnerVolumeSpecName "kube-api-access-v7q4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:51.642944 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.642926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.648210 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.648186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9k7\" (UniqueName: \"kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7\") pod \"authorino-7d9965c686-4t6sh\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") " pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.682205 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.682177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:45:51.741962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.741937    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7q4q\" (UniqueName: \"kubernetes.io/projected/9df68422-c7fa-40ba-ac26-41add89b48ca-kube-api-access-v7q4q\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:51.955278 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:51.955254    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:45:51.957089 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:45:51.957067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19993a7a_d4d7_4ce4_89bb_35e106758c08.slice/crio-07265ea6131eb54eb2679595d85f754eb40a2ac775b7942b9ee0afd7118cf271 WatchSource:0}: Error finding container 07265ea6131eb54eb2679595d85f754eb40a2ac775b7942b9ee0afd7118cf271: Status 404 returned error can't find the container with id 07265ea6131eb54eb2679595d85f754eb40a2ac775b7942b9ee0afd7118cf271
Sep 10 23:45:52.453480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:52.453445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9965c686-4t6sh" event={"ID":"19993a7a-d4d7-4ce4-89bb-35e106758c08","Type":"ContainerStarted","Data":"07265ea6131eb54eb2679595d85f754eb40a2ac775b7942b9ee0afd7118cf271"}
Sep 10 23:45:52.453847 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:52.453529    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6wq8p"
Sep 10 23:45:52.482266 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:52.482240    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6wq8p"]
Sep 10 23:45:52.485025 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:52.485008    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-6wq8p"]
Sep 10 23:45:53.449562 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.449527    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df68422-c7fa-40ba-ac26-41add89b48ca" path="/var/lib/kubelet/pods/9df68422-c7fa-40ba-ac26-41add89b48ca/volumes"
Sep 10 23:45:53.468154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.468118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9965c686-4t6sh" event={"ID":"19993a7a-d4d7-4ce4-89bb-35e106758c08","Type":"ContainerStarted","Data":"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"}
Sep 10 23:45:53.484093 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.484036    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d9965c686-4t6sh" podStartSLOduration=1.97499119 podStartE2EDuration="2.484016534s" totalImagesPullingTime="509.025344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:45:53.482988055 +0000 UTC m=+570.582570159" watchObservedRunningTime="2026-09-10 23:45:53.484016534 +0000 UTC m=+570.583598638"
Sep 10 23:45:53.507206 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.507168    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:53.507695 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.507659    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-lkqk8" podUID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" containerName="authorino" containerID="cri-o://f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f" gracePeriod=30
Sep 10 23:45:53.761471 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.761445    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:53.765161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.765142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rspxr\" (UniqueName: \"kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr\") pod \"662d35d8-e05a-4b5e-9293-22d2fe46bb28\" (UID: \"662d35d8-e05a-4b5e-9293-22d2fe46bb28\") "
Sep 10 23:45:53.767359 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.767322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr" (OuterVolumeSpecName: "kube-api-access-rspxr") pod "662d35d8-e05a-4b5e-9293-22d2fe46bb28" (UID: "662d35d8-e05a-4b5e-9293-22d2fe46bb28"). InnerVolumeSpecName "kube-api-access-rspxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:45:53.866436 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:53.866396    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rspxr\" (UniqueName: \"kubernetes.io/projected/662d35d8-e05a-4b5e-9293-22d2fe46bb28-kube-api-access-rspxr\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:45:54.475244 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.475210    2581 generic.go:356] "Generic (PLEG): container finished" podID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" containerID="f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f" exitCode=0
Sep 10 23:45:54.475670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.475251    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-lkqk8"
Sep 10 23:45:54.475670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.475318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-lkqk8" event={"ID":"662d35d8-e05a-4b5e-9293-22d2fe46bb28","Type":"ContainerDied","Data":"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"}
Sep 10 23:45:54.475670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.475371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-lkqk8" event={"ID":"662d35d8-e05a-4b5e-9293-22d2fe46bb28","Type":"ContainerDied","Data":"87deabce22174b44fc686ff74e2d9841150c9ce2bbac33976ffe002f81636785"}
Sep 10 23:45:54.475670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.475393    2581 scope.go:117] "RemoveContainer" containerID="f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"
Sep 10 23:45:54.485505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.485484    2581 scope.go:117] "RemoveContainer" containerID="f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"
Sep 10 23:45:54.485775 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:54.485757    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f\": container with ID starting with f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f not found: ID does not exist" containerID="f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"
Sep 10 23:45:54.485838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.485784    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f"} err="failed to get container status \"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f\": rpc error: code = NotFound desc = could not find container \"f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f\": container with ID starting with f6d110a7f6b4e7658bf78b39e6484005d51b821ded9e3879aba42e7f6cacf59f not found: ID does not exist"
Sep 10 23:45:54.496311 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.496265    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:54.498648 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:54.498624    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-lkqk8"]
Sep 10 23:45:55.452486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:55.452452    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" path="/var/lib/kubelet/pods/662d35d8-e05a-4b5e-9293-22d2fe46bb28/volumes"
Sep 10 23:45:58.928918 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.928874    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:45:58.929332 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.929307    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" containerName="authorino"
Sep 10 23:45:58.929332 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.929321    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" containerName="authorino"
Sep 10 23:45:58.929418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.929396    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="662d35d8-e05a-4b5e-9293-22d2fe46bb28" containerName="authorino"
Sep 10 23:45:58.934156 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.934135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:58.938516 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.938487    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 23:45:58.938686 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.938522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5htr\""
Sep 10 23:45:58.938686 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.938563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 23:45:58.939111 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.939093    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 23:45:58.948365 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:58.948337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:45:59.007668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.007636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.007839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.007700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rjd\" (UniqueName: \"kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.007839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.007789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.108526 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.108486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.108705 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.108558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rjd\" (UniqueName: \"kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.108705 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.108622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.108778 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:59.108721    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 23:45:59.108814 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:59.108802    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs podName:03eeefb9-6614-4346-b327-3d959780d6bf nodeName:}" failed. No retries permitted until 2026-09-10 23:45:59.608780182 +0000 UTC m=+576.708362263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs") pod "maas-controller-5f9dfc9ddc-nftcb" (UID: "03eeefb9-6614-4346-b327-3d959780d6bf") : secret "maas-controller-metrics-tls" not found
Sep 10 23:45:59.111194 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.111166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.120467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.120436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rjd\" (UniqueName: \"kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.134152 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.134114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 10 23:45:59.137861 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.137838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.147381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.147355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 10 23:45:59.210069 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.209964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.210069 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.210010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.210069 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.210067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbd7x\" (UniqueName: \"kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.310861 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.310821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.310861 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.310861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.311069 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.310908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbd7x\" (UniqueName: \"kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.311069 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:59.311051    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 23:45:59.311138 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:45:59.311118    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs podName:ebdecb0a-08a3-48f8-92d4-9461f14800dc nodeName:}" failed. No retries permitted until 2026-09-10 23:45:59.811101983 +0000 UTC m=+576.910684081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs") pod "maas-controller-6bb769cbf8-nwfnm" (UID: "ebdecb0a-08a3-48f8-92d4-9461f14800dc") : secret "maas-controller-metrics-tls" not found
Sep 10 23:45:59.313619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.313597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.320622 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.320593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbd7x\" (UniqueName: \"kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.614362 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.614254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.616755 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.616735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") pod \"maas-controller-5f9dfc9ddc-nftcb\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") " pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:45:59.815950 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.815907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.818541 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.818521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") pod \"maas-controller-6bb769cbf8-nwfnm\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") " pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:45:59.845444 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:45:59.845405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:46:00.050303 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:00.050243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:46:00.120484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:00.120445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:46:00.123279 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:46:00.123243    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03eeefb9_6614_4346_b327_3d959780d6bf.slice/crio-f94656bafa69298964e16b065a99320faeef1128147e97b082acc0d0e8ce07ad WatchSource:0}: Error finding container f94656bafa69298964e16b065a99320faeef1128147e97b082acc0d0e8ce07ad: Status 404 returned error can't find the container with id f94656bafa69298964e16b065a99320faeef1128147e97b082acc0d0e8ce07ad
Sep 10 23:46:00.326035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:00.326011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 10 23:46:00.327547 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:46:00.327516    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdecb0a_08a3_48f8_92d4_9461f14800dc.slice/crio-cd40456435cb035f89b86b606ce36a2d51ca29765c8afb56c3fc02177e6ceb99 WatchSource:0}: Error finding container cd40456435cb035f89b86b606ce36a2d51ca29765c8afb56c3fc02177e6ceb99: Status 404 returned error can't find the container with id cd40456435cb035f89b86b606ce36a2d51ca29765c8afb56c3fc02177e6ceb99
Sep 10 23:46:00.513733 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:00.513693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" event={"ID":"ebdecb0a-08a3-48f8-92d4-9461f14800dc","Type":"ContainerStarted","Data":"cd40456435cb035f89b86b606ce36a2d51ca29765c8afb56c3fc02177e6ceb99"}
Sep 10 23:46:00.514987 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:00.514956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" event={"ID":"03eeefb9-6614-4346-b327-3d959780d6bf","Type":"ContainerStarted","Data":"f94656bafa69298964e16b065a99320faeef1128147e97b082acc0d0e8ce07ad"}
Sep 10 23:46:03.547036 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.546993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" event={"ID":"ebdecb0a-08a3-48f8-92d4-9461f14800dc","Type":"ContainerStarted","Data":"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"}
Sep 10 23:46:03.547727 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.547160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:46:03.548673 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.548649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" event={"ID":"03eeefb9-6614-4346-b327-3d959780d6bf","Type":"ContainerStarted","Data":"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"}
Sep 10 23:46:03.548804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.548786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:46:03.632567 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.632502    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" podStartSLOduration=2.984931203 podStartE2EDuration="5.632484606s" totalImagesPullingTime="2.647553403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:03.630745147 +0000 UTC m=+580.730327249" watchObservedRunningTime="2026-09-10 23:46:03.632484606 +0000 UTC m=+580.732066708"
Sep 10 23:46:03.632900 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:03.632870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" podStartSLOduration=2.182285419 podStartE2EDuration="4.632861827s" totalImagesPullingTime="2.450576408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:03.591515406 +0000 UTC m=+580.691097506" watchObservedRunningTime="2026-09-10 23:46:03.632861827 +0000 UTC m=+580.732443970"
Sep 10 23:46:14.557318 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.557267    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 10 23:46:14.557766 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.557362    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:46:14.616520 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.616484    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:46:14.616759 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.616730    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" podUID="03eeefb9-6614-4346-b327-3d959780d6bf" containerName="manager" containerID="cri-o://32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5" gracePeriod=30
Sep 10 23:46:14.873478 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.873451    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:46:14.965279 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.965241    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") pod \"03eeefb9-6614-4346-b327-3d959780d6bf\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") "
Sep 10 23:46:14.965473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.965372    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55rjd\" (UniqueName: \"kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd\") pod \"03eeefb9-6614-4346-b327-3d959780d6bf\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") "
Sep 10 23:46:14.965473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.965395    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert\") pod \"03eeefb9-6614-4346-b327-3d959780d6bf\" (UID: \"03eeefb9-6614-4346-b327-3d959780d6bf\") "
Sep 10 23:46:14.967720 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.967690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "03eeefb9-6614-4346-b327-3d959780d6bf" (UID: "03eeefb9-6614-4346-b327-3d959780d6bf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:46:14.967844 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.967800    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "03eeefb9-6614-4346-b327-3d959780d6bf" (UID: "03eeefb9-6614-4346-b327-3d959780d6bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:46:14.967844 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:14.967813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd" (OuterVolumeSpecName: "kube-api-access-55rjd") pod "03eeefb9-6614-4346-b327-3d959780d6bf" (UID: "03eeefb9-6614-4346-b327-3d959780d6bf"). InnerVolumeSpecName "kube-api-access-55rjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:46:15.066631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.066590    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55rjd\" (UniqueName: \"kubernetes.io/projected/03eeefb9-6614-4346-b327-3d959780d6bf-kube-api-access-55rjd\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:46:15.066631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.066625    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-webhook-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:46:15.066631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.066634    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03eeefb9-6614-4346-b327-3d959780d6bf-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:46:15.623220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.623179    2581 generic.go:356] "Generic (PLEG): container finished" podID="03eeefb9-6614-4346-b327-3d959780d6bf" containerID="32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5" exitCode=0
Sep 10 23:46:15.623220 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.623224    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb"
Sep 10 23:46:15.623683 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.623261    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" event={"ID":"03eeefb9-6614-4346-b327-3d959780d6bf","Type":"ContainerDied","Data":"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"}
Sep 10 23:46:15.623683 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.623329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f9dfc9ddc-nftcb" event={"ID":"03eeefb9-6614-4346-b327-3d959780d6bf","Type":"ContainerDied","Data":"f94656bafa69298964e16b065a99320faeef1128147e97b082acc0d0e8ce07ad"}
Sep 10 23:46:15.623683 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.623357    2581 scope.go:117] "RemoveContainer" containerID="32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"
Sep 10 23:46:15.632541 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.632524    2581 scope.go:117] "RemoveContainer" containerID="32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"
Sep 10 23:46:15.632816 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:15.632802    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5\": container with ID starting with 32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5 not found: ID does not exist" containerID="32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"
Sep 10 23:46:15.632878 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.632825    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5"} err="failed to get container status \"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5\": rpc error: code = NotFound desc = could not find container \"32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5\": container with ID starting with 32c0b8fe2471b800bf445ca4f707fa5829d38726aa45fd3ae8a7f3fcdb60a5e5 not found: ID does not exist"
Sep 10 23:46:15.639153 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.639129    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:46:15.644375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:15.644348    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f9dfc9ddc-nftcb"]
Sep 10 23:46:17.448817 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:17.448783    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03eeefb9-6614-4346-b327-3d959780d6bf" path="/var/lib/kubelet/pods/03eeefb9-6614-4346-b327-3d959780d6bf/volumes"
Sep 10 23:46:35.735906 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.735866    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 10 23:46:35.743245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.736357    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03eeefb9-6614-4346-b327-3d959780d6bf" containerName="manager"
Sep 10 23:46:35.743245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.736370    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="03eeefb9-6614-4346-b327-3d959780d6bf" containerName="manager"
Sep 10 23:46:35.743245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.736442    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="03eeefb9-6614-4346-b327-3d959780d6bf" containerName="manager"
Sep 10 23:46:35.743446 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.743354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.746425 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.746389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 23:46:35.746564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.746508    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-78nn9\""
Sep 10 23:46:35.746739 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.746726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 23:46:35.754751 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.754715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 10 23:46:35.861095 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.861058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqbs5\" (UniqueName: \"kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.861330 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.861141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.861330 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.861207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.861330 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.861246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.961936 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.961897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.962176 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.961955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.962176 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.961996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqbs5\" (UniqueName: \"kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.962176 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:35.962065    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 10 23:46:35.962176 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.962108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.962176 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:35.962147    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls podName:7716a269-783d-4ed7-a264-cb685254d56f nodeName:}" failed. No retries permitted until 2026-09-10 23:46:36.462124411 +0000 UTC m=+613.561706493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls") pod "maas-api-577f88484f-lw28x" (UID: "7716a269-783d-4ed7-a264-cb685254d56f") : secret "maas-api-serving-cert" not found
Sep 10 23:46:35.962485 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:35.962216    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 10 23:46:35.962485 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:35.962331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs podName:7716a269-783d-4ed7-a264-cb685254d56f nodeName:}" failed. No retries permitted until 2026-09-10 23:46:36.46227816 +0000 UTC m=+613.561860240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs") pod "maas-api-577f88484f-lw28x" (UID: "7716a269-783d-4ed7-a264-cb685254d56f") : secret "maas-api-metrics-tls" not found
Sep 10 23:46:35.962684 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.962667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:35.970306 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:35.970262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqbs5\" (UniqueName: \"kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:36.235887 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.235850    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"]
Sep 10 23:46:36.239606 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.239584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.241880 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.241844    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 23:46:36.242178 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.242152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lsq9h\""
Sep 10 23:46:36.252184 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.252155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"]
Sep 10 23:46:36.264068 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.263500    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"]
Sep 10 23:46:36.267711 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.267687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.281026 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.281000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"]
Sep 10 23:46:36.365817 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.365766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lxn\" (UniqueName: \"kubernetes.io/projected/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-kube-api-access-72lxn\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.365999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.365843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.365999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.365988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5263d3-c157-48fe-aaa9-dff5f181f4d3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.366116 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.366022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvrsl\" (UniqueName: \"kubernetes.io/projected/da5263d3-c157-48fe-aaa9-dff5f181f4d3-kube-api-access-wvrsl\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.467529 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5263d3-c157-48fe-aaa9-dff5f181f4d3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.467714 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvrsl\" (UniqueName: \"kubernetes.io/projected/da5263d3-c157-48fe-aaa9-dff5f181f4d3-kube-api-access-wvrsl\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.467714 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:36.467714 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lxn\" (UniqueName: \"kubernetes.io/projected/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-kube-api-access-72lxn\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.467714 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.467714 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.467679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:36.467951 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:36.467708    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 10 23:46:36.467951 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:46:36.467782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs podName:7716a269-783d-4ed7-a264-cb685254d56f nodeName:}" failed. No retries permitted until 2026-09-10 23:46:37.467760142 +0000 UTC m=+614.567342226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs") pod "maas-api-577f88484f-lw28x" (UID: "7716a269-783d-4ed7-a264-cb685254d56f") : secret "maas-api-metrics-tls" not found
Sep 10 23:46:36.468352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.468328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5263d3-c157-48fe-aaa9-dff5f181f4d3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.468631 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.468481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.470601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.470572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:36.475505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.475481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lxn\" (UniqueName: \"kubernetes.io/projected/506ec22b-7cfb-4109-bcb8-b6a2915d20e7-kube-api-access-72lxn\") pod \"payload-pre-processing-59fbc47bf8-jdjzn\" (UID: \"506ec22b-7cfb-4109-bcb8-b6a2915d20e7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.475871 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.475850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvrsl\" (UniqueName: \"kubernetes.io/projected/da5263d3-c157-48fe-aaa9-dff5f181f4d3-kube-api-access-wvrsl\") pod \"payload-processing-5b54b7fbb7-nbxtp\" (UID: \"da5263d3-c157-48fe-aaa9-dff5f181f4d3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.553827 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.553491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:36.580525 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.580489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:36.862413 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.862389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"]
Sep 10 23:46:36.863714 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:46:36.863680    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506ec22b_7cfb_4109_bcb8_b6a2915d20e7.slice/crio-5b3d5983ee40d6a52dd3deff4d9970c0ca91396942ff962e959c9edc76d6569f WatchSource:0}: Error finding container 5b3d5983ee40d6a52dd3deff4d9970c0ca91396942ff962e959c9edc76d6569f: Status 404 returned error can't find the container with id 5b3d5983ee40d6a52dd3deff4d9970c0ca91396942ff962e959c9edc76d6569f
Sep 10 23:46:36.865622 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.865595    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:46:36.911386 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:36.911333    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"]
Sep 10 23:46:37.480576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.480045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:37.510315 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.510006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"maas-api-577f88484f-lw28x\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") " pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:37.556599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.556564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:37.765000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.764912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp" event={"ID":"da5263d3-c157-48fe-aaa9-dff5f181f4d3","Type":"ContainerStarted","Data":"c4fac34d69314e609ae0282ebb0e00b9794ecf8f2b2b5048dc226c3655f695dd"}
Sep 10 23:46:37.766888 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.766856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn" event={"ID":"506ec22b-7cfb-4109-bcb8-b6a2915d20e7","Type":"ContainerStarted","Data":"5b3d5983ee40d6a52dd3deff4d9970c0ca91396942ff962e959c9edc76d6569f"}
Sep 10 23:46:37.910362 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:37.908560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 10 23:46:38.779365 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:38.779316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" event={"ID":"7716a269-783d-4ed7-a264-cb685254d56f","Type":"ContainerStarted","Data":"18a6c17d2a276035a0ac33f50d3fbf8cd368098d912dd134905772fbb9a60d8f"}
Sep 10 23:46:39.804601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.804554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp" event={"ID":"da5263d3-c157-48fe-aaa9-dff5f181f4d3","Type":"ContainerStarted","Data":"95c53832890412d91bb5c23311e32961c63d6a491c3900500e1ea501feb0a2f9"}
Sep 10 23:46:39.805407 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.805377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:39.810493 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.810441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn" event={"ID":"506ec22b-7cfb-4109-bcb8-b6a2915d20e7","Type":"ContainerStarted","Data":"516b5b7421d8b7ea46a1697da71b8b7f56f4ce3b174a999b9dd267dd83d623fa"}
Sep 10 23:46:39.811123 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.811092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:39.827521 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.827464    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp" podStartSLOduration=1.560587953 podStartE2EDuration="3.82744243s" totalImagesPullingTime="2.266854477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:39.82611837 +0000 UTC m=+616.925700473" watchObservedRunningTime="2026-09-10 23:46:39.82744243 +0000 UTC m=+616.927024533"
Sep 10 23:46:39.849305 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:39.844576    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn" podStartSLOduration=1.5376650939999998 podStartE2EDuration="3.844548492s" totalImagesPullingTime="2.306883398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:39.841532693 +0000 UTC m=+616.941114795" watchObservedRunningTime="2026-09-10 23:46:39.844548492 +0000 UTC m=+616.944130595"
Sep 10 23:46:40.818190 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:40.818148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" event={"ID":"7716a269-783d-4ed7-a264-cb685254d56f","Type":"ContainerStarted","Data":"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"}
Sep 10 23:46:40.818687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:40.818631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:40.837245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:40.837185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" podStartSLOduration=3.746467764 podStartE2EDuration="5.837165185s" totalImagesPullingTime="2.090697421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:46:40.834487353 +0000 UTC m=+617.934069455" watchObservedRunningTime="2026-09-10 23:46:40.837165185 +0000 UTC m=+617.936747288"
Sep 10 23:46:45.849034 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.849000    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d972cc9-2a27-4208-9aec-d15b73532793" containerID="d6dc322eb381ca4bd2d2646c106ac52a9720d31200070ac0f0ee48b3f97f8fad" exitCode=0
Sep 10 23:46:45.849034 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.849038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" event={"ID":"0d972cc9-2a27-4208-9aec-d15b73532793","Type":"ContainerDied","Data":"d6dc322eb381ca4bd2d2646c106ac52a9720d31200070ac0f0ee48b3f97f8fad"}
Sep 10 23:46:45.849558 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.849445    2581 scope.go:117] "RemoveContainer" containerID="d6dc322eb381ca4bd2d2646c106ac52a9720d31200070ac0f0ee48b3f97f8fad"
Sep 10 23:46:45.850434 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.850406    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:46:45.850537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.850474    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:46:45.850537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:45.850504    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:46:46.858106 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:46.858074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" event={"ID":"0d972cc9-2a27-4208-9aec-d15b73532793","Type":"ContainerStarted","Data":"85ad467d4ef2fffb4c9a8a56062fc52e3260fcc9e625128035d8522da2f75827"}
Sep 10 23:46:47.526886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:47.526846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:46:47.527098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:47.527077    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pfjmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:46:47.527146 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:47.527129    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podUID="0d972cc9-2a27-4208-9aec-d15b73532793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 23:46:47.836252 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:47.836154    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 10 23:46:48.527098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:48.527059    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pfjmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:46:48.527527 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:48.527150    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podUID="0d972cc9-2a27-4208-9aec-d15b73532793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 23:46:49.527068 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:49.527024    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pfjmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:46:49.527244 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:49.527096    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podUID="0d972cc9-2a27-4208-9aec-d15b73532793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 23:46:50.527452 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:50.527413    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pfjmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:46:50.527867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:50.527468    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podUID="0d972cc9-2a27-4208-9aec-d15b73532793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 23:46:51.527484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:51.527448    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pfjmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:46:51.527916 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:51.527507    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc" podUID="0d972cc9-2a27-4208-9aec-d15b73532793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 10 23:46:51.826772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:51.826693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jdjzn"
Sep 10 23:46:51.826772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:51.826767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-nbxtp"
Sep 10 23:46:52.531448 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:52.531417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:46:52.531821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:52.531714    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:46:52.532443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:46:52.532427    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pfjmc"
Sep 10 23:47:04.251042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.251000    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"]
Sep 10 23:47:04.254748 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.254730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.257250 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.257223    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ds5n5\""
Sep 10 23:47:04.257435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.257232    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 23:47:04.257435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.257237    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 23:47:04.257855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.257837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 23:47:04.264639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.264609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"]
Sep 10 23:47:04.380228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.380443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.380443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pht94\" (UniqueName: \"kubernetes.io/projected/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-kube-api-access-pht94\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.380443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.380554 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.380554 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.380473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481085 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pht94\" (UniqueName: \"kubernetes.io/projected/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-kube-api-access-pht94\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481085 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481682 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481770 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.481770 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.481749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.484003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.483978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.484110 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.484047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.488783 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.488751    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pht94\" (UniqueName: \"kubernetes.io/projected/2089cc60-484d-4edb-b07a-0fa1f1b3bc76-kube-api-access-pht94\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww\" (UID: \"2089cc60-484d-4edb-b07a-0fa1f1b3bc76\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.565640 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.565545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:04.842218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.842185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"]
Sep 10 23:47:04.843592 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:47:04.843560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2089cc60_484d_4edb_b07a_0fa1f1b3bc76.slice/crio-e86d692b78e23237b1122e40d0650516ffaa4781ba5be1d1cd9d6f20fb383633 WatchSource:0}: Error finding container e86d692b78e23237b1122e40d0650516ffaa4781ba5be1d1cd9d6f20fb383633: Status 404 returned error can't find the container with id e86d692b78e23237b1122e40d0650516ffaa4781ba5be1d1cd9d6f20fb383633
Sep 10 23:47:04.973525 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:04.973486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww" event={"ID":"2089cc60-484d-4edb-b07a-0fa1f1b3bc76","Type":"ContainerStarted","Data":"e86d692b78e23237b1122e40d0650516ffaa4781ba5be1d1cd9d6f20fb383633"}
Sep 10 23:47:06.987173 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:06.987136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww" event={"ID":"2089cc60-484d-4edb-b07a-0fa1f1b3bc76","Type":"ContainerStarted","Data":"65b0f4fe8052e5135f65ee4e63947d0d6816fb5ceb4a829258e03824e1a212aa"}
Sep 10 23:47:07.004467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:07.004410    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww" podStartSLOduration=1.908581792 podStartE2EDuration="3.004391259s" totalImagesPullingTime="1.095809467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:07.002571898 +0000 UTC m=+644.102153991" watchObservedRunningTime="2026-09-10 23:47:07.004391259 +0000 UTC m=+644.103973360"
Sep 10 23:47:14.565882 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:14.565836    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:14.566373 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:14.565907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:14.579378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:14.579340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:15.053239 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:15.053209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww"
Sep 10 23:47:30.440576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.440538    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"]
Sep 10 23:47:30.444418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.444387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.446837 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.446817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 23:47:30.454461 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.454435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"]
Sep 10 23:47:30.535645 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40070092-1bbb-44eb-bca4-941d74a4ef37-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.535838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.535838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.535838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.535838 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92qg\" (UniqueName: \"kubernetes.io/projected/40070092-1bbb-44eb-bca4-941d74a4ef37-kube-api-access-d92qg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.536074 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.535860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637254 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637254 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92qg\" (UniqueName: \"kubernetes.io/projected/40070092-1bbb-44eb-bca4-941d74a4ef37-kube-api-access-d92qg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40070092-1bbb-44eb-bca4-941d74a4ef37-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637808 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.637808 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.637770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.639844 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.639824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40070092-1bbb-44eb-bca4-941d74a4ef37-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.640107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.640088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40070092-1bbb-44eb-bca4-941d74a4ef37-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.645148 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.645126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92qg\" (UniqueName: \"kubernetes.io/projected/40070092-1bbb-44eb-bca4-941d74a4ef37-kube-api-access-d92qg\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7\" (UID: \"40070092-1bbb-44eb-bca4-941d74a4ef37\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:30.757447 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:30.757349    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:31.029934 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:31.029908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"]
Sep 10 23:47:31.030873 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:47:31.030851    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40070092_1bbb_44eb_bca4_941d74a4ef37.slice/crio-72b23684cd9fc010d8be81a99b0d3952d2d7bca4609a9534e8f9462e171e07f0 WatchSource:0}: Error finding container 72b23684cd9fc010d8be81a99b0d3952d2d7bca4609a9534e8f9462e171e07f0: Status 404 returned error can't find the container with id 72b23684cd9fc010d8be81a99b0d3952d2d7bca4609a9534e8f9462e171e07f0
Sep 10 23:47:31.137418 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:31.137387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7" event={"ID":"40070092-1bbb-44eb-bca4-941d74a4ef37","Type":"ContainerStarted","Data":"72b23684cd9fc010d8be81a99b0d3952d2d7bca4609a9534e8f9462e171e07f0"}
Sep 10 23:47:32.145371 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:32.145322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7" event={"ID":"40070092-1bbb-44eb-bca4-941d74a4ef37","Type":"ContainerStarted","Data":"828d2e7dc6831b6d576edae53b5922f71ff99c1ed3fe4055700b8475c04d9c4a"}
Sep 10 23:47:32.162700 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:32.162649    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7" podStartSLOduration=1.97962824 podStartE2EDuration="2.162633189s" totalImagesPullingTime="183.004949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:47:32.16146616 +0000 UTC m=+669.261048261" watchObservedRunningTime="2026-09-10 23:47:32.162633189 +0000 UTC m=+669.262215309"
Sep 10 23:47:40.757809 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:40.757769    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:40.758680 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:40.757845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:40.770893 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:40.770865    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:47:41.212110 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:47:41.212082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7"
Sep 10 23:49:37.019973 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.019938    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f8bd7f9f9-62fgm"]
Sep 10 23:49:37.023563 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.023546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.030476 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.030447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8bd7f9f9-62fgm"]
Sep 10 23:49:37.104928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.104891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2hd\" (UniqueName: \"kubernetes.io/projected/700c91da-1230-472a-b960-8fd89ff1a085-kube-api-access-lm2hd\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.104928 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.104932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/700c91da-1230-472a-b960-8fd89ff1a085-tls-cert\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.206343 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.206304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2hd\" (UniqueName: \"kubernetes.io/projected/700c91da-1230-472a-b960-8fd89ff1a085-kube-api-access-lm2hd\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.206514 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.206360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/700c91da-1230-472a-b960-8fd89ff1a085-tls-cert\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.209000 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.208977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/700c91da-1230-472a-b960-8fd89ff1a085-tls-cert\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.215246 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.215218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2hd\" (UniqueName: \"kubernetes.io/projected/700c91da-1230-472a-b960-8fd89ff1a085-kube-api-access-lm2hd\") pod \"authorino-5f8bd7f9f9-62fgm\" (UID: \"700c91da-1230-472a-b960-8fd89ff1a085\") " pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.334831 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.334749    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm"
Sep 10 23:49:37.609102 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.609070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8bd7f9f9-62fgm"]
Sep 10 23:49:37.609727 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:49:37.609701    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod700c91da_1230_472a_b960_8fd89ff1a085.slice/crio-1279656f0677e11952ca54646ea3c6987b056a4a9c3a63d1ee2cbe3d8bafa56f WatchSource:0}: Error finding container 1279656f0677e11952ca54646ea3c6987b056a4a9c3a63d1ee2cbe3d8bafa56f: Status 404 returned error can't find the container with id 1279656f0677e11952ca54646ea3c6987b056a4a9c3a63d1ee2cbe3d8bafa56f
Sep 10 23:49:37.917585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:37.917555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm" event={"ID":"700c91da-1230-472a-b960-8fd89ff1a085","Type":"ContainerStarted","Data":"1279656f0677e11952ca54646ea3c6987b056a4a9c3a63d1ee2cbe3d8bafa56f"}
Sep 10 23:49:38.932679 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:38.932628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm" event={"ID":"700c91da-1230-472a-b960-8fd89ff1a085","Type":"ContainerStarted","Data":"56b2596242779d4cb0ec19644ce11aebb5cbf873ab68e61e892c995ac746fa78"}
Sep 10 23:49:38.951393 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:38.951320    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f8bd7f9f9-62fgm" podStartSLOduration=1.252605494 podStartE2EDuration="1.951279299s" totalImagesPullingTime="698.673805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:49:38.950212955 +0000 UTC m=+796.049795056" watchObservedRunningTime="2026-09-10 23:49:38.951279299 +0000 UTC m=+796.050861402"
Sep 10 23:49:38.982572 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:38.982533    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:49:38.983035 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:38.982982    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d9965c686-4t6sh" podUID="19993a7a-d4d7-4ce4-89bb-35e106758c08" containerName="authorino" containerID="cri-o://defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8" gracePeriod=30
Sep 10 23:49:39.243659 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.243626    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:49:39.430591 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.430557    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r9k7\" (UniqueName: \"kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7\") pod \"19993a7a-d4d7-4ce4-89bb-35e106758c08\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") "
Sep 10 23:49:39.430761 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.430634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert\") pod \"19993a7a-d4d7-4ce4-89bb-35e106758c08\" (UID: \"19993a7a-d4d7-4ce4-89bb-35e106758c08\") "
Sep 10 23:49:39.433479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.433440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7" (OuterVolumeSpecName: "kube-api-access-5r9k7") pod "19993a7a-d4d7-4ce4-89bb-35e106758c08" (UID: "19993a7a-d4d7-4ce4-89bb-35e106758c08"). InnerVolumeSpecName "kube-api-access-5r9k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:49:39.444303 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.444247    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "19993a7a-d4d7-4ce4-89bb-35e106758c08" (UID: "19993a7a-d4d7-4ce4-89bb-35e106758c08"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:49:39.532095 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.532004    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19993a7a-d4d7-4ce4-89bb-35e106758c08-tls-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:49:39.532095 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.532036    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r9k7\" (UniqueName: \"kubernetes.io/projected/19993a7a-d4d7-4ce4-89bb-35e106758c08-kube-api-access-5r9k7\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:49:39.940576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.940533    2581 generic.go:356] "Generic (PLEG): container finished" podID="19993a7a-d4d7-4ce4-89bb-35e106758c08" containerID="defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8" exitCode=0
Sep 10 23:49:39.940576 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.940579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9965c686-4t6sh"
Sep 10 23:49:39.941134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.940609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9965c686-4t6sh" event={"ID":"19993a7a-d4d7-4ce4-89bb-35e106758c08","Type":"ContainerDied","Data":"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"}
Sep 10 23:49:39.941134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.940654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9965c686-4t6sh" event={"ID":"19993a7a-d4d7-4ce4-89bb-35e106758c08","Type":"ContainerDied","Data":"07265ea6131eb54eb2679595d85f754eb40a2ac775b7942b9ee0afd7118cf271"}
Sep 10 23:49:39.941134 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.940679    2581 scope.go:117] "RemoveContainer" containerID="defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"
Sep 10 23:49:39.950926 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.950897    2581 scope.go:117] "RemoveContainer" containerID="defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"
Sep 10 23:49:39.951271 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:49:39.951251    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8\": container with ID starting with defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8 not found: ID does not exist" containerID="defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"
Sep 10 23:49:39.951390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.951280    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8"} err="failed to get container status \"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8\": rpc error: code = NotFound desc = could not find container \"defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8\": container with ID starting with defe6d4165b33e1e9c6ed17ed1d9cc1a451c1a9072b7ebfcb610a44c321090c8 not found: ID does not exist"
Sep 10 23:49:39.959633 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.959601    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:49:39.964695 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:39.964671    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d9965c686-4t6sh"]
Sep 10 23:49:41.451363 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:49:41.451316    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19993a7a-d4d7-4ce4-89bb-35e106758c08" path="/var/lib/kubelet/pods/19993a7a-d4d7-4ce4-89bb-35e106758c08/volumes"
Sep 10 23:50:01.028639 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.028606    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:50:01.029242 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.029224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19993a7a-d4d7-4ce4-89bb-35e106758c08" containerName="authorino"
Sep 10 23:50:01.029311 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.029245    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19993a7a-d4d7-4ce4-89bb-35e106758c08" containerName="authorino"
Sep 10 23:50:01.029352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.029343    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19993a7a-d4d7-4ce4-89bb-35e106758c08" containerName="authorino"
Sep 10 23:50:01.032794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.032761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.035468 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.035446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4c5699-serving-cert\""
Sep 10 23:50:01.042752 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.042727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:50:01.149737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.149704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.149737 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.149749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpd4\" (UniqueName: \"kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.149969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.149826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.149969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.149860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.250654 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.250620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.250654 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.250668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpd4\" (UniqueName: \"kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.250944 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.250709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.250944 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.250729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.251862 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.251835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.254225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.254201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.254359 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.254322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.260378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.260353    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpd4\" (UniqueName: \"kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4\") pod \"maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.346164 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.346072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:01.619130 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.619103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:50:01.620798 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:01.620768    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c56340_1691_4cb9_afa5_e5eb05df5c01.slice/crio-8d796e8a3578c34b90e47a8cd29b5422ed966d2443b75c5301a3d4e5bda72414 WatchSource:0}: Error finding container 8d796e8a3578c34b90e47a8cd29b5422ed966d2443b75c5301a3d4e5bda72414: Status 404 returned error can't find the container with id 8d796e8a3578c34b90e47a8cd29b5422ed966d2443b75c5301a3d4e5bda72414
Sep 10 23:50:01.799951 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.799914    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:50:01.805718 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.805692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.808889 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.808869    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4c5699\""
Sep 10 23:50:01.809042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.808869    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-4c5699-dockercfg-n2dbs\""
Sep 10 23:50:01.815247 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.815226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:50:01.856991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.856957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.857166 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.857040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qddl\" (UniqueName: \"kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.958409 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.958363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qddl\" (UniqueName: \"kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.958606 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.958507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.959408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.959376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:01.971683 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:01.971654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qddl\" (UniqueName: \"kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl\") pod \"payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:02.084067 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:02.084022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" event={"ID":"f4c56340-1691-4cb9-afa5-e5eb05df5c01","Type":"ContainerStarted","Data":"8d796e8a3578c34b90e47a8cd29b5422ed966d2443b75c5301a3d4e5bda72414"}
Sep 10 23:50:02.119475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:02.119438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:02.407674 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:02.407645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:50:02.408743 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:02.408722    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf20d88c_7d96_419e_8d01_24ef1f88c043.slice/crio-47f7e8e9f96640f21bc889a05edb7d098e0d0bbee695bf2160a1a09251a4eee4 WatchSource:0}: Error finding container 47f7e8e9f96640f21bc889a05edb7d098e0d0bbee695bf2160a1a09251a4eee4: Status 404 returned error can't find the container with id 47f7e8e9f96640f21bc889a05edb7d098e0d0bbee695bf2160a1a09251a4eee4
Sep 10 23:50:03.092199 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.092160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" event={"ID":"df20d88c-7d96-419e-8d01-24ef1f88c043","Type":"ContainerStarted","Data":"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"}
Sep 10 23:50:03.092643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.092226    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:03.092643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.092248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" event={"ID":"df20d88c-7d96-419e-8d01-24ef1f88c043","Type":"ContainerStarted","Data":"47f7e8e9f96640f21bc889a05edb7d098e0d0bbee695bf2160a1a09251a4eee4"}
Sep 10 23:50:03.093878 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.093850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" event={"ID":"f4c56340-1691-4cb9-afa5-e5eb05df5c01","Type":"ContainerStarted","Data":"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"}
Sep 10 23:50:03.093995 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.093897    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:03.110102 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.110055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" podStartSLOduration=2.110037741 podStartE2EDuration="2.110037741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:03.108678199 +0000 UTC m=+820.208260301" watchObservedRunningTime="2026-09-10 23:50:03.110037741 +0000 UTC m=+820.209619842"
Sep 10 23:50:03.130507 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:03.130443    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" podStartSLOduration=1.2968383399999999 podStartE2EDuration="2.130422259s" totalImagesPullingTime="833.583919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:03.126885359 +0000 UTC m=+820.226467461" watchObservedRunningTime="2026-09-10 23:50:03.130422259 +0000 UTC m=+820.230004362"
Sep 10 23:50:09.107842 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:09.107802    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:50:10.505885 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.505851    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:50:10.510778 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.510756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.513578 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.513557    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-b3de77\""
Sep 10 23:50:10.523990 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.523965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:50:10.529218 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.529186    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:50:10.534449 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.534157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.537780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.537726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-b3de77-dockercfg-bmdz7\""
Sep 10 23:50:10.549154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.549114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:50:10.649148 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.649100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.649361 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.649174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxrz\" (UniqueName: \"kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.649361 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.649305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2szcp\" (UniqueName: \"kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.649479 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.649358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.750748 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.750712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxrz\" (UniqueName: \"kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.750930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.750758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2szcp\" (UniqueName: \"kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.750930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.750784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.750930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.750897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.751784 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.751761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.751839 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.751767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.761561 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.761490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2szcp\" (UniqueName: \"kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp\") pod \"payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") " pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:10.762124 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.762102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxrz\" (UniqueName: \"kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz\") pod \"payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.821771 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.821732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:10.849396 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:10.849364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:11.098619 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.098591    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:50:11.100397 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:11.100369    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc65148_a251_42c7_a52c_15a2374436d5.slice/crio-2d435f3a77c206a4dca938805b5ba7bc78e5ad3ff3bbe945567ca2702b993478 WatchSource:0}: Error finding container 2d435f3a77c206a4dca938805b5ba7bc78e5ad3ff3bbe945567ca2702b993478: Status 404 returned error can't find the container with id 2d435f3a77c206a4dca938805b5ba7bc78e5ad3ff3bbe945567ca2702b993478
Sep 10 23:50:11.139954 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.139930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:50:11.141915 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:11.141890    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7a724e_ec21_40ec_854e_588edfd942c5.slice/crio-8bb56c5557702e3e54c6c4093668982180fedd931d02295d49c09ca39a937a3b WatchSource:0}: Error finding container 8bb56c5557702e3e54c6c4093668982180fedd931d02295d49c09ca39a937a3b: Status 404 returned error can't find the container with id 8bb56c5557702e3e54c6c4093668982180fedd931d02295d49c09ca39a937a3b
Sep 10 23:50:11.149703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.149672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" event={"ID":"bbc65148-a251-42c7-a52c-15a2374436d5","Type":"ContainerStarted","Data":"2d435f3a77c206a4dca938805b5ba7bc78e5ad3ff3bbe945567ca2702b993478"}
Sep 10 23:50:11.413911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.413873    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:11.417668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.417651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.419960 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.419938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6c506b66\""
Sep 10 23:50:11.430548 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.430526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:11.466803 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.466764    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:11.471246 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.471221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.475210 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.475186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6c506b66-dockercfg-k2xkh\""
Sep 10 23:50:11.479867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.479839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:11.560744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.560466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.560744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.560539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vj8\" (UniqueName: \"kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.560744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.560570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt572\" (UniqueName: \"kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.560744 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.560664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.661492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.661453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.661704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.661508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vj8\" (UniqueName: \"kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.661704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.661529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt572\" (UniqueName: \"kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.661704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.661552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.662195 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.662173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.662321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.662250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.672094 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.672035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt572\" (UniqueName: \"kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572\") pod \"payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.672184 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.672169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vj8\" (UniqueName: \"kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8\") pod \"payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") " pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:11.731036 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.731003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:11.786924 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:11.786633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:12.009550 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.009522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:12.011222 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:12.011199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3c9574_23b5_4128_be8b_5fdae09792e0.slice/crio-00b52b1bdc4aaeb92c0398d668813210b9c87ce44bcb2d202f753475588aaa2c WatchSource:0}: Error finding container 00b52b1bdc4aaeb92c0398d668813210b9c87ce44bcb2d202f753475588aaa2c: Status 404 returned error can't find the container with id 00b52b1bdc4aaeb92c0398d668813210b9c87ce44bcb2d202f753475588aaa2c
Sep 10 23:50:12.077111 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.077081    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:12.077467 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:12.077443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765015ed_eb8e_4126_8d29_d57a48a6d20f.slice/crio-8fc990311caa79b19f3bbd63740817695f1e8d78fd5515d67dbd69adb55650f3 WatchSource:0}: Error finding container 8fc990311caa79b19f3bbd63740817695f1e8d78fd5515d67dbd69adb55650f3: Status 404 returned error can't find the container with id 8fc990311caa79b19f3bbd63740817695f1e8d78fd5515d67dbd69adb55650f3
Sep 10 23:50:12.159566 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.159536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" event={"ID":"765015ed-eb8e-4126-8d29-d57a48a6d20f","Type":"ContainerStarted","Data":"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"}
Sep 10 23:50:12.159741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.159590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" event={"ID":"765015ed-eb8e-4126-8d29-d57a48a6d20f","Type":"ContainerStarted","Data":"8fc990311caa79b19f3bbd63740817695f1e8d78fd5515d67dbd69adb55650f3"}
Sep 10 23:50:12.159741 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.159656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:12.161352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.161323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" event={"ID":"5d3c9574-23b5-4128-be8b-5fdae09792e0","Type":"ContainerStarted","Data":"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"}
Sep 10 23:50:12.161513 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.161369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" event={"ID":"5d3c9574-23b5-4128-be8b-5fdae09792e0","Type":"ContainerStarted","Data":"00b52b1bdc4aaeb92c0398d668813210b9c87ce44bcb2d202f753475588aaa2c"}
Sep 10 23:50:12.161513 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.161394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:12.163185 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.163160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" event={"ID":"0a7a724e-ec21-40ec-854e-588edfd942c5","Type":"ContainerStarted","Data":"dc9153e0def2216147060f7310954f5a9bc724e578917e4d29a16ad72ad0a71c"}
Sep 10 23:50:12.163331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.163210    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:12.163331 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.163235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" event={"ID":"0a7a724e-ec21-40ec-854e-588edfd942c5","Type":"ContainerStarted","Data":"8bb56c5557702e3e54c6c4093668982180fedd931d02295d49c09ca39a937a3b"}
Sep 10 23:50:12.164847 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.164827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" event={"ID":"bbc65148-a251-42c7-a52c-15a2374436d5","Type":"ContainerStarted","Data":"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"}
Sep 10 23:50:12.164961 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.164948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:12.181999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.181936    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" podStartSLOduration=1.181917877 podStartE2EDuration="1.181917877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:12.177427358 +0000 UTC m=+829.277009460" watchObservedRunningTime="2026-09-10 23:50:12.181917877 +0000 UTC m=+829.281499976"
Sep 10 23:50:12.197474 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.197412    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" podStartSLOduration=2.197388643 podStartE2EDuration="2.197388643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:12.193984715 +0000 UTC m=+829.293566811" watchObservedRunningTime="2026-09-10 23:50:12.197388643 +0000 UTC m=+829.296970783"
Sep 10 23:50:12.212504 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.212448    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" podStartSLOduration=1.212430007 podStartE2EDuration="1.212430007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:12.210266769 +0000 UTC m=+829.309848870" watchObservedRunningTime="2026-09-10 23:50:12.212430007 +0000 UTC m=+829.312012170"
Sep 10 23:50:12.229952 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:12.229890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" podStartSLOduration=2.229866504 podStartE2EDuration="2.229866504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:12.227223358 +0000 UTC m=+829.326805475" watchObservedRunningTime="2026-09-10 23:50:12.229866504 +0000 UTC m=+829.329448611"
Sep 10 23:50:14.104145 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:14.104111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:50:23.175074 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:23.175043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:50:23.175568 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:23.175114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:23.175568 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:23.175246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:50:23.175568 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:23.175468    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:36.681731 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:36.681692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:36.682222 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:36.681928    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" podUID="765015ed-eb8e-4126-8d29-d57a48a6d20f" containerName="payload-processing" containerID="cri-o://e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d" gracePeriod=30
Sep 10 23:50:36.699166 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:36.697684    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:36.699166 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:36.697936    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" podUID="5d3c9574-23b5-4128-be8b-5fdae09792e0" containerName="payload-pre-processing" containerID="cri-o://b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722" gracePeriod=30
Sep 10 23:50:36.964665 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:36.964637    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:37.012343 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.012255    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:37.034346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.033467    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2vj8\" (UniqueName: \"kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8\") pod \"765015ed-eb8e-4126-8d29-d57a48a6d20f\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") "
Sep 10 23:50:37.034346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.033576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume\") pod \"765015ed-eb8e-4126-8d29-d57a48a6d20f\" (UID: \"765015ed-eb8e-4126-8d29-d57a48a6d20f\") "
Sep 10 23:50:37.034674 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.034643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "765015ed-eb8e-4126-8d29-d57a48a6d20f" (UID: "765015ed-eb8e-4126-8d29-d57a48a6d20f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:37.037268 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.037241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8" (OuterVolumeSpecName: "kube-api-access-s2vj8") pod "765015ed-eb8e-4126-8d29-d57a48a6d20f" (UID: "765015ed-eb8e-4126-8d29-d57a48a6d20f"). InnerVolumeSpecName "kube-api-access-s2vj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:37.134425 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt572\" (UniqueName: \"kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572\") pod \"5d3c9574-23b5-4128-be8b-5fdae09792e0\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") "
Sep 10 23:50:37.134599 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume\") pod \"5d3c9574-23b5-4128-be8b-5fdae09792e0\" (UID: \"5d3c9574-23b5-4128-be8b-5fdae09792e0\") "
Sep 10 23:50:37.134853 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134833    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d3c9574-23b5-4128-be8b-5fdae09792e0" (UID: "5d3c9574-23b5-4128-be8b-5fdae09792e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:50:37.134946 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134927    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d3c9574-23b5-4128-be8b-5fdae09792e0-plugins-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:50:37.134946 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134940    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/765015ed-eb8e-4126-8d29-d57a48a6d20f-plugins-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:50:37.135226 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.134952    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2vj8\" (UniqueName: \"kubernetes.io/projected/765015ed-eb8e-4126-8d29-d57a48a6d20f-kube-api-access-s2vj8\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:50:37.136986 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.136958    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572" (OuterVolumeSpecName: "kube-api-access-mt572") pod "5d3c9574-23b5-4128-be8b-5fdae09792e0" (UID: "5d3c9574-23b5-4128-be8b-5fdae09792e0"). InnerVolumeSpecName "kube-api-access-mt572". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:50:37.235941 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.235849    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt572\" (UniqueName: \"kubernetes.io/projected/5d3c9574-23b5-4128-be8b-5fdae09792e0-kube-api-access-mt572\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:50:37.333118 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.333080    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d3c9574-23b5-4128-be8b-5fdae09792e0" containerID="b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722" exitCode=0
Sep 10 23:50:37.333336 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.333134    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"
Sep 10 23:50:37.333336 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.333173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" event={"ID":"5d3c9574-23b5-4128-be8b-5fdae09792e0","Type":"ContainerDied","Data":"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"}
Sep 10 23:50:37.333336 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.333222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z" event={"ID":"5d3c9574-23b5-4128-be8b-5fdae09792e0","Type":"ContainerDied","Data":"00b52b1bdc4aaeb92c0398d668813210b9c87ce44bcb2d202f753475588aaa2c"}
Sep 10 23:50:37.333336 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.333244    2581 scope.go:117] "RemoveContainer" containerID="b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"
Sep 10 23:50:37.334687 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.334668    2581 generic.go:356] "Generic (PLEG): container finished" podID="765015ed-eb8e-4126-8d29-d57a48a6d20f" containerID="e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d" exitCode=0
Sep 10 23:50:37.334801 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.334706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"
Sep 10 23:50:37.334801 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.334715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" event={"ID":"765015ed-eb8e-4126-8d29-d57a48a6d20f","Type":"ContainerDied","Data":"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"}
Sep 10 23:50:37.334801 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.334749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr" event={"ID":"765015ed-eb8e-4126-8d29-d57a48a6d20f","Type":"ContainerDied","Data":"8fc990311caa79b19f3bbd63740817695f1e8d78fd5515d67dbd69adb55650f3"}
Sep 10 23:50:37.344054 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.344025    2581 scope.go:117] "RemoveContainer" containerID="b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"
Sep 10 23:50:37.344484 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:50:37.344410    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722\": container with ID starting with b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722 not found: ID does not exist" containerID="b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"
Sep 10 23:50:37.344484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.344445    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722"} err="failed to get container status \"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722\": rpc error: code = NotFound desc = could not find container \"b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722\": container with ID starting with b7974bf0e21da43c81a8d3c598ffd0b66d01d753d13b08e8ce8ff88e4185e722 not found: ID does not exist"
Sep 10 23:50:37.344484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.344470    2581 scope.go:117] "RemoveContainer" containerID="e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"
Sep 10 23:50:37.353934 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.353916    2581 scope.go:117] "RemoveContainer" containerID="e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"
Sep 10 23:50:37.354250 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:50:37.354231    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d\": container with ID starting with e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d not found: ID does not exist" containerID="e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"
Sep 10 23:50:37.354325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.354260    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d"} err="failed to get container status \"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d\": rpc error: code = NotFound desc = could not find container \"e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d\": container with ID starting with e31407d711468f25123b63947d5e096c077fdb1a4483d3c7d56b4209a58a5f4d not found: ID does not exist"
Sep 10 23:50:37.359480 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.359452    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:37.366595 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.366548    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c506b66-58fbf9b466-g2s8z"]
Sep 10 23:50:37.384804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.384763    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:37.391745 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.391713    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6c506b66-f4fb9bc59-dcddr"]
Sep 10 23:50:37.450804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.450760    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3c9574-23b5-4128-be8b-5fdae09792e0" path="/var/lib/kubelet/pods/5d3c9574-23b5-4128-be8b-5fdae09792e0/volumes"
Sep 10 23:50:37.451185 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:37.451166    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="765015ed-eb8e-4126-8d29-d57a48a6d20f" path="/var/lib/kubelet/pods/765015ed-eb8e-4126-8d29-d57a48a6d20f/volumes"
Sep 10 23:50:40.675745 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.675705    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:50:40.676391 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676372    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="765015ed-eb8e-4126-8d29-d57a48a6d20f" containerName="payload-processing"
Sep 10 23:50:40.676451 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="765015ed-eb8e-4126-8d29-d57a48a6d20f" containerName="payload-processing"
Sep 10 23:50:40.676451 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676407    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3c9574-23b5-4128-be8b-5fdae09792e0" containerName="payload-pre-processing"
Sep 10 23:50:40.676451 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676413    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3c9574-23b5-4128-be8b-5fdae09792e0" containerName="payload-pre-processing"
Sep 10 23:50:40.676545 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676505    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3c9574-23b5-4128-be8b-5fdae09792e0" containerName="payload-pre-processing"
Sep 10 23:50:40.676545 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.676515    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="765015ed-eb8e-4126-8d29-d57a48a6d20f" containerName="payload-processing"
Sep 10 23:50:40.681525 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.681500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.684265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.684243    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-113befcd-serving-cert\""
Sep 10 23:50:40.690225 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.690200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:50:40.770223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.770186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.770223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.770218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.770454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.770282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.770454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.770363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7qk\" (UniqueName: \"kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.871398 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.871360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7qk\" (UniqueName: \"kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.871596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.871464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.871596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.871490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.871596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.871539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.871727 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:50:40.871622    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-serving-cert: secret "maas-api-e2e-migrate-113befcd-serving-cert" not found
Sep 10 23:50:40.871727 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:50:40.871702    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls podName:c0916659-9fea-4ed5-ac2a-7dbd161a876a nodeName:}" failed. No retries permitted until 2026-09-10 23:50:41.371684067 +0000 UTC m=+858.471266160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls") pod "maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" (UID: "c0916659-9fea-4ed5-ac2a-7dbd161a876a") : secret "maas-api-e2e-migrate-113befcd-serving-cert" not found
Sep 10 23:50:40.872202 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.872185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.874066 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.874048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:40.887079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:40.887055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7qk\" (UniqueName: \"kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:41.377133 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:41.377099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:41.379797 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:41.379777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") pod \"maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:41.593627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:41.593591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:41.937715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:41.937681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:50:41.938859 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:50:41.938830    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0916659_9fea_4ed5_ac2a_7dbd161a876a.slice/crio-2514dd01a8a6edf38d8811de69debb5c4bae77e432b7f1ac7d7c481fe72b0543 WatchSource:0}: Error finding container 2514dd01a8a6edf38d8811de69debb5c4bae77e432b7f1ac7d7c481fe72b0543: Status 404 returned error can't find the container with id 2514dd01a8a6edf38d8811de69debb5c4bae77e432b7f1ac7d7c481fe72b0543
Sep 10 23:50:42.373381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:42.373264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" event={"ID":"c0916659-9fea-4ed5-ac2a-7dbd161a876a","Type":"ContainerStarted","Data":"2514dd01a8a6edf38d8811de69debb5c4bae77e432b7f1ac7d7c481fe72b0543"}
Sep 10 23:50:43.381870 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:43.381826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" event={"ID":"c0916659-9fea-4ed5-ac2a-7dbd161a876a","Type":"ContainerStarted","Data":"9d7dfd2aa20791a7ffa0d83e10a9f9cf9e4c055bb84f9852892e35888bedd78b"}
Sep 10 23:50:43.382408 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:43.382032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:50:43.408499 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:43.408445    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" podStartSLOduration=2.965208299 podStartE2EDuration="3.408426762s" totalImagesPullingTime="443.218463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:50:43.406849976 +0000 UTC m=+860.506432079" watchObservedRunningTime="2026-09-10 23:50:43.408426762 +0000 UTC m=+860.508008864"
Sep 10 23:50:49.399300 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:50:49.399250    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:51:12.346994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.346954    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:51:12.347628 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.347200    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" podUID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" containerName="maas-api" containerID="cri-o://9d7dfd2aa20791a7ffa0d83e10a9f9cf9e4c055bb84f9852892e35888bedd78b" gracePeriod=30
Sep 10 23:51:12.585436 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.585398    2581 generic.go:356] "Generic (PLEG): container finished" podID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" containerID="9d7dfd2aa20791a7ffa0d83e10a9f9cf9e4c055bb84f9852892e35888bedd78b" exitCode=0
Sep 10 23:51:12.585629 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.585473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" event={"ID":"c0916659-9fea-4ed5-ac2a-7dbd161a876a","Type":"ContainerDied","Data":"9d7dfd2aa20791a7ffa0d83e10a9f9cf9e4c055bb84f9852892e35888bedd78b"}
Sep 10 23:51:12.621085 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.621054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:51:12.705423 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.705384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg7qk\" (UniqueName: \"kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk\") pod \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") "
Sep 10 23:51:12.705623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.705435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca\") pod \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") "
Sep 10 23:51:12.705623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.705484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs\") pod \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") "
Sep 10 23:51:12.705623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.705500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") pod \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\" (UID: \"c0916659-9fea-4ed5-ac2a-7dbd161a876a\") "
Sep 10 23:51:12.705883 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.705848    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0916659-9fea-4ed5-ac2a-7dbd161a876a" (UID: "c0916659-9fea-4ed5-ac2a-7dbd161a876a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:51:12.707999 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.707977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c0916659-9fea-4ed5-ac2a-7dbd161a876a" (UID: "c0916659-9fea-4ed5-ac2a-7dbd161a876a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:51:12.708108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.708003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk" (OuterVolumeSpecName: "kube-api-access-sg7qk") pod "c0916659-9fea-4ed5-ac2a-7dbd161a876a" (UID: "c0916659-9fea-4ed5-ac2a-7dbd161a876a"). InnerVolumeSpecName "kube-api-access-sg7qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:51:12.708108 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.708002    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0916659-9fea-4ed5-ac2a-7dbd161a876a" (UID: "c0916659-9fea-4ed5-ac2a-7dbd161a876a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:51:12.806884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.806846    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg7qk\" (UniqueName: \"kubernetes.io/projected/c0916659-9fea-4ed5-ac2a-7dbd161a876a-kube-api-access-sg7qk\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:12.806884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.806876    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0916659-9fea-4ed5-ac2a-7dbd161a876a-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:12.806884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.806886    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:12.807154 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:12.806895    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0916659-9fea-4ed5-ac2a-7dbd161a876a-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:13.594565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:13.594531    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"
Sep 10 23:51:13.594565 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:13.594549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88" event={"ID":"c0916659-9fea-4ed5-ac2a-7dbd161a876a","Type":"ContainerDied","Data":"2514dd01a8a6edf38d8811de69debb5c4bae77e432b7f1ac7d7c481fe72b0543"}
Sep 10 23:51:13.595044 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:13.594614    2581 scope.go:117] "RemoveContainer" containerID="9d7dfd2aa20791a7ffa0d83e10a9f9cf9e4c055bb84f9852892e35888bedd78b"
Sep 10 23:51:13.616729 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:13.616692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:51:13.626640 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:13.626552    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-113befcd-7b6d99c48-t9r88"]
Sep 10 23:51:15.450428 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:15.450348    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" path="/var/lib/kubelet/pods/c0916659-9fea-4ed5-ac2a-7dbd161a876a/volumes"
Sep 10 23:51:19.134553 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.134516    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:19.135322 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.135276    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" containerName="maas-api"
Sep 10 23:51:19.135909 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.135889    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" containerName="maas-api"
Sep 10 23:51:19.136306 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.136264    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0916659-9fea-4ed5-ac2a-7dbd161a876a" containerName="maas-api"
Sep 10 23:51:19.140057 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.140039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.142275 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.142255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9566fcb0-serving-cert\""
Sep 10 23:51:19.147092 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.147070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:19.273499 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.273460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.273499 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.273494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.273715 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.273606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.273753 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.273728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-858fz\" (UniqueName: \"kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.374281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.374243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.374486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.374372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-858fz\" (UniqueName: \"kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.374486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.374418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.374486 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.374436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.375430 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.375396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.377175 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.377152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.377280 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.377204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.399230 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.399159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-858fz\" (UniqueName: \"kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz\") pod \"maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.453666 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.453638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:19.740612 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:19.740582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:20.643197 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:20.643163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" event={"ID":"80d113da-737b-4b89-bf94-b9489c8747b2","Type":"ContainerStarted","Data":"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"}
Sep 10 23:51:20.643671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:20.643226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" event={"ID":"80d113da-737b-4b89-bf94-b9489c8747b2","Type":"ContainerStarted","Data":"abf0a88ccba36f7f4b843b152faf245b14d2bd8889549bfab6973a90f7630d95"}
Sep 10 23:51:20.643671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:20.643256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:20.661622 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:20.661573    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" podStartSLOduration=1.311275297 podStartE2EDuration="1.661557018s" totalImagesPullingTime="350.281721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:20.661005763 +0000 UTC m=+897.760587864" watchObservedRunningTime="2026-09-10 23:51:20.661557018 +0000 UTC m=+897.761139119"
Sep 10 23:51:26.655029 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:26.655002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:48.857835 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:48.857799    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:48.860422 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:48.858033    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" podUID="80d113da-737b-4b89-bf94-b9489c8747b2" containerName="maas-api" containerID="cri-o://980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4" gracePeriod=30
Sep 10 23:51:49.126944 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.126871    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:49.179772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.179729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca\") pod \"80d113da-737b-4b89-bf94-b9489c8747b2\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") "
Sep 10 23:51:49.179958 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.179878    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs\") pod \"80d113da-737b-4b89-bf94-b9489c8747b2\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") "
Sep 10 23:51:49.179958 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.179915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls\") pod \"80d113da-737b-4b89-bf94-b9489c8747b2\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") "
Sep 10 23:51:49.179958 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.179933    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-858fz\" (UniqueName: \"kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz\") pod \"80d113da-737b-4b89-bf94-b9489c8747b2\" (UID: \"80d113da-737b-4b89-bf94-b9489c8747b2\") "
Sep 10 23:51:49.180245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.180216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80d113da-737b-4b89-bf94-b9489c8747b2" (UID: "80d113da-737b-4b89-bf94-b9489c8747b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:51:49.182621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.182556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz" (OuterVolumeSpecName: "kube-api-access-858fz") pod "80d113da-737b-4b89-bf94-b9489c8747b2" (UID: "80d113da-737b-4b89-bf94-b9489c8747b2"). InnerVolumeSpecName "kube-api-access-858fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:51:49.182776 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.182750    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "80d113da-737b-4b89-bf94-b9489c8747b2" (UID: "80d113da-737b-4b89-bf94-b9489c8747b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:51:49.182852 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.182776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80d113da-737b-4b89-bf94-b9489c8747b2" (UID: "80d113da-737b-4b89-bf94-b9489c8747b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:51:49.281811 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.281760    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:49.281811 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.281801    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80d113da-737b-4b89-bf94-b9489c8747b2-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:49.281811 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.281813    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-858fz\" (UniqueName: \"kubernetes.io/projected/80d113da-737b-4b89-bf94-b9489c8747b2-kube-api-access-858fz\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:49.282148 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.281828    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80d113da-737b-4b89-bf94-b9489c8747b2-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:51:49.836896 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.836802    2581 generic.go:356] "Generic (PLEG): container finished" podID="80d113da-737b-4b89-bf94-b9489c8747b2" containerID="980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4" exitCode=0
Sep 10 23:51:49.836896 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.836845    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"
Sep 10 23:51:49.836896 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.836884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" event={"ID":"80d113da-737b-4b89-bf94-b9489c8747b2","Type":"ContainerDied","Data":"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"}
Sep 10 23:51:49.837125 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.836939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb" event={"ID":"80d113da-737b-4b89-bf94-b9489c8747b2","Type":"ContainerDied","Data":"abf0a88ccba36f7f4b843b152faf245b14d2bd8889549bfab6973a90f7630d95"}
Sep 10 23:51:49.837125 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.836962    2581 scope.go:117] "RemoveContainer" containerID="980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"
Sep 10 23:51:49.847216 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.847195    2581 scope.go:117] "RemoveContainer" containerID="980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"
Sep 10 23:51:49.847538 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:51:49.847520    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4\": container with ID starting with 980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4 not found: ID does not exist" containerID="980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"
Sep 10 23:51:49.847604 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.847549    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4"} err="failed to get container status \"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4\": rpc error: code = NotFound desc = could not find container \"980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4\": container with ID starting with 980a04dcf0e6da742babd4c5465f54af0a3e85f850f282df3198c56f9086e8e4 not found: ID does not exist"
Sep 10 23:51:49.854101 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.854078    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:49.857903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:49.857880    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9566fcb0-757bbbddf7-9ktsb"]
Sep 10 23:51:51.451515 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:51.451475    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80d113da-737b-4b89-bf94-b9489c8747b2" path="/var/lib/kubelet/pods/80d113da-737b-4b89-bf94-b9489c8747b2/volumes"
Sep 10 23:51:56.544522 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.544487    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:51:56.544987 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.544974    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d113da-737b-4b89-bf94-b9489c8747b2" containerName="maas-api"
Sep 10 23:51:56.545031 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.544989    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d113da-737b-4b89-bf94-b9489c8747b2" containerName="maas-api"
Sep 10 23:51:56.545075 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.545066    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d113da-737b-4b89-bf94-b9489c8747b2" containerName="maas-api"
Sep 10 23:51:56.549758 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.549727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.551850 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.551825    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a105b100-serving-cert\""
Sep 10 23:51:56.558785 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.558755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:51:56.661796 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.661763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.661997 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.661831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.661997 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.661865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvxsq\" (UniqueName: \"kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.662079 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.662013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.763492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.763455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.763492 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.763496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvxsq\" (UniqueName: \"kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.763716 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.763590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.763716 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.763632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.764596 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.764566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.766388 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.766356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.766541 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.766432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.772024 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.772001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvxsq\" (UniqueName: \"kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq\") pod \"maas-api-e2e-derive-a105b100-6fc75cb59-qggfd\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:56.864976 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:56.864881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:57.164064 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.164033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:51:57.165173 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:51:57.165146    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01de5346_db4b_4526_95ff_875363a7eaa0.slice/crio-9114af069fb448cc4192980bef7c7103730797a1ddb497d45073e65a803b2505 WatchSource:0}: Error finding container 9114af069fb448cc4192980bef7c7103730797a1ddb497d45073e65a803b2505: Status 404 returned error can't find the container with id 9114af069fb448cc4192980bef7c7103730797a1ddb497d45073e65a803b2505
Sep 10 23:51:57.166718 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.166696    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:51:57.898006 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.897910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" event={"ID":"01de5346-db4b-4526-95ff-875363a7eaa0","Type":"ContainerStarted","Data":"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"}
Sep 10 23:51:57.898432 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.898066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:51:57.898432 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.898086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" event={"ID":"01de5346-db4b-4526-95ff-875363a7eaa0","Type":"ContainerStarted","Data":"9114af069fb448cc4192980bef7c7103730797a1ddb497d45073e65a803b2505"}
Sep 10 23:51:57.916468 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:51:57.916406    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" podStartSLOduration=1.5460322130000002 podStartE2EDuration="1.916389482s" totalImagesPullingTime="370.357269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:51:57.913788324 +0000 UTC m=+935.013370467" watchObservedRunningTime="2026-09-10 23:51:57.916389482 +0000 UTC m=+935.015971584"
Sep 10 23:52:03.910045 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:03.910015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:52:25.796472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:25.796438    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:52:25.797001 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:25.796658    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" podUID="01de5346-db4b-4526-95ff-875363a7eaa0" containerName="maas-api" containerID="cri-o://125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959" gracePeriod=30
Sep 10 23:52:26.065400 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.065372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:52:26.079027 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.078994    2581 generic.go:356] "Generic (PLEG): container finished" podID="01de5346-db4b-4526-95ff-875363a7eaa0" containerID="125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959" exitCode=0
Sep 10 23:52:26.079228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.079045    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"
Sep 10 23:52:26.079228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.079072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" event={"ID":"01de5346-db4b-4526-95ff-875363a7eaa0","Type":"ContainerDied","Data":"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"}
Sep 10 23:52:26.079228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.079133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd" event={"ID":"01de5346-db4b-4526-95ff-875363a7eaa0","Type":"ContainerDied","Data":"9114af069fb448cc4192980bef7c7103730797a1ddb497d45073e65a803b2505"}
Sep 10 23:52:26.079228 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.079160    2581 scope.go:117] "RemoveContainer" containerID="125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"
Sep 10 23:52:26.091627 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.091604    2581 scope.go:117] "RemoveContainer" containerID="125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"
Sep 10 23:52:26.092051 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:52:26.092023    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959\": container with ID starting with 125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959 not found: ID does not exist" containerID="125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"
Sep 10 23:52:26.092182 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.092056    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959"} err="failed to get container status \"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959\": rpc error: code = NotFound desc = could not find container \"125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959\": container with ID starting with 125c6b903accaafb0c30b2f3fe9def0973d61eb9b941b8dccc97d049197cb959 not found: ID does not exist"
Sep 10 23:52:26.180645 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.180604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca\") pod \"01de5346-db4b-4526-95ff-875363a7eaa0\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") "
Sep 10 23:52:26.180855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.180684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs\") pod \"01de5346-db4b-4526-95ff-875363a7eaa0\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") "
Sep 10 23:52:26.180855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.180732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvxsq\" (UniqueName: \"kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq\") pod \"01de5346-db4b-4526-95ff-875363a7eaa0\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") "
Sep 10 23:52:26.180855 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.180773    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls\") pod \"01de5346-db4b-4526-95ff-875363a7eaa0\" (UID: \"01de5346-db4b-4526-95ff-875363a7eaa0\") "
Sep 10 23:52:26.181126 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.181095    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01de5346-db4b-4526-95ff-875363a7eaa0" (UID: "01de5346-db4b-4526-95ff-875363a7eaa0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:26.183884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.183842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "01de5346-db4b-4526-95ff-875363a7eaa0" (UID: "01de5346-db4b-4526-95ff-875363a7eaa0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:52:26.183884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.183847    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq" (OuterVolumeSpecName: "kube-api-access-bvxsq") pod "01de5346-db4b-4526-95ff-875363a7eaa0" (UID: "01de5346-db4b-4526-95ff-875363a7eaa0"). InnerVolumeSpecName "kube-api-access-bvxsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:26.183884 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.183881    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01de5346-db4b-4526-95ff-875363a7eaa0" (UID: "01de5346-db4b-4526-95ff-875363a7eaa0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:52:26.282620 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.282573    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:26.282620 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.282613    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvxsq\" (UniqueName: \"kubernetes.io/projected/01de5346-db4b-4526-95ff-875363a7eaa0-kube-api-access-bvxsq\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:26.282620 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.282631    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01de5346-db4b-4526-95ff-875363a7eaa0-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:26.282930 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.282646    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01de5346-db4b-4526-95ff-875363a7eaa0-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:26.405282 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.405247    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:52:26.408135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:26.408111    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a105b100-6fc75cb59-qggfd"]
Sep 10 23:52:27.449904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:27.449872    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01de5346-db4b-4526-95ff-875363a7eaa0" path="/var/lib/kubelet/pods/01de5346-db4b-4526-95ff-875363a7eaa0/volumes"
Sep 10 23:52:52.123484 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.123366    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:52:52.123940 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.123692    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" podUID="0a7a724e-ec21-40ec-854e-588edfd942c5" containerName="payload-processing" containerID="cri-o://dc9153e0def2216147060f7310954f5a9bc724e578917e4d29a16ad72ad0a71c" gracePeriod=30
Sep 10 23:52:52.136341 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.136267    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:52:52.136640 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.136569    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" podUID="bbc65148-a251-42c7-a52c-15a2374436d5" containerName="payload-pre-processing" containerID="cri-o://4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989" gracePeriod=30
Sep 10 23:52:52.252271 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.252233    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a7a724e-ec21-40ec-854e-588edfd942c5" containerID="dc9153e0def2216147060f7310954f5a9bc724e578917e4d29a16ad72ad0a71c" exitCode=0
Sep 10 23:52:52.252271 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.252267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" event={"ID":"0a7a724e-ec21-40ec-854e-588edfd942c5","Type":"ContainerDied","Data":"dc9153e0def2216147060f7310954f5a9bc724e578917e4d29a16ad72ad0a71c"}
Sep 10 23:52:52.434574 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.434550    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:52:52.440907 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.440880    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:52:52.549807 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.549773    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2szcp\" (UniqueName: \"kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp\") pod \"0a7a724e-ec21-40ec-854e-588edfd942c5\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") "
Sep 10 23:52:52.549968 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.549848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxxrz\" (UniqueName: \"kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz\") pod \"bbc65148-a251-42c7-a52c-15a2374436d5\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") "
Sep 10 23:52:52.549968 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.549907    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume\") pod \"bbc65148-a251-42c7-a52c-15a2374436d5\" (UID: \"bbc65148-a251-42c7-a52c-15a2374436d5\") "
Sep 10 23:52:52.549968 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.549936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume\") pod \"0a7a724e-ec21-40ec-854e-588edfd942c5\" (UID: \"0a7a724e-ec21-40ec-854e-588edfd942c5\") "
Sep 10 23:52:52.550367 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.550344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a7a724e-ec21-40ec-854e-588edfd942c5" (UID: "0a7a724e-ec21-40ec-854e-588edfd942c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:52.550367 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.550349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bbc65148-a251-42c7-a52c-15a2374436d5" (UID: "bbc65148-a251-42c7-a52c-15a2374436d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:52:52.552321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.552267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz" (OuterVolumeSpecName: "kube-api-access-lxxrz") pod "bbc65148-a251-42c7-a52c-15a2374436d5" (UID: "bbc65148-a251-42c7-a52c-15a2374436d5"). InnerVolumeSpecName "kube-api-access-lxxrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:52.552321 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.552303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp" (OuterVolumeSpecName: "kube-api-access-2szcp") pod "0a7a724e-ec21-40ec-854e-588edfd942c5" (UID: "0a7a724e-ec21-40ec-854e-588edfd942c5"). InnerVolumeSpecName "kube-api-access-2szcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:52:52.650975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.650934    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a7a724e-ec21-40ec-854e-588edfd942c5-plugins-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:52.650975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.650966    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2szcp\" (UniqueName: \"kubernetes.io/projected/0a7a724e-ec21-40ec-854e-588edfd942c5-kube-api-access-2szcp\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:52.650975 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.650980    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxxrz\" (UniqueName: \"kubernetes.io/projected/bbc65148-a251-42c7-a52c-15a2374436d5-kube-api-access-lxxrz\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:52.651217 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:52.650992    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbc65148-a251-42c7-a52c-15a2374436d5-plugins-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:52:53.261590 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.261559    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"
Sep 10 23:52:53.262093 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.261598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx" event={"ID":"0a7a724e-ec21-40ec-854e-588edfd942c5","Type":"ContainerDied","Data":"8bb56c5557702e3e54c6c4093668982180fedd931d02295d49c09ca39a937a3b"}
Sep 10 23:52:53.262093 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.261673    2581 scope.go:117] "RemoveContainer" containerID="dc9153e0def2216147060f7310954f5a9bc724e578917e4d29a16ad72ad0a71c"
Sep 10 23:52:53.263192 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.263142    2581 generic.go:356] "Generic (PLEG): container finished" podID="bbc65148-a251-42c7-a52c-15a2374436d5" containerID="4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989" exitCode=0
Sep 10 23:52:53.263262 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.263188    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"
Sep 10 23:52:53.263325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.263186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" event={"ID":"bbc65148-a251-42c7-a52c-15a2374436d5","Type":"ContainerDied","Data":"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"}
Sep 10 23:52:53.263325 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.263319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd" event={"ID":"bbc65148-a251-42c7-a52c-15a2374436d5","Type":"ContainerDied","Data":"2d435f3a77c206a4dca938805b5ba7bc78e5ad3ff3bbe945567ca2702b993478"}
Sep 10 23:52:53.276406 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.276381    2581 scope.go:117] "RemoveContainer" containerID="4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"
Sep 10 23:52:53.287582 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.287560    2581 scope.go:117] "RemoveContainer" containerID="4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"
Sep 10 23:52:53.287927 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:52:53.287904    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989\": container with ID starting with 4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989 not found: ID does not exist" containerID="4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"
Sep 10 23:52:53.288001 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.287939    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989"} err="failed to get container status \"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989\": rpc error: code = NotFound desc = could not find container \"4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989\": container with ID starting with 4261d0ae900415fb0d865cb820f73cacab0c2c994fde82342587712d90bd5989 not found: ID does not exist"
Sep 10 23:52:53.296966 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.296935    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:52:53.303991 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.303952    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-b3de77-7f659dc546-mhkbd"]
Sep 10 23:52:53.316340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.316313    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:52:53.318883 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.318860    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-b3de77-77c7b78b45-c27tx"]
Sep 10 23:52:53.456143 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.456106    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7a724e-ec21-40ec-854e-588edfd942c5" path="/var/lib/kubelet/pods/0a7a724e-ec21-40ec-854e-588edfd942c5/volumes"
Sep 10 23:52:53.456525 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:52:53.456512    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc65148-a251-42c7-a52c-15a2374436d5" path="/var/lib/kubelet/pods/bbc65148-a251-42c7-a52c-15a2374436d5/volumes"
Sep 10 23:54:02.369933 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.369896    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:54:02.370435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc65148-a251-42c7-a52c-15a2374436d5" containerName="payload-pre-processing"
Sep 10 23:54:02.370435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370425    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc65148-a251-42c7-a52c-15a2374436d5" containerName="payload-pre-processing"
Sep 10 23:54:02.370435 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370434    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7a724e-ec21-40ec-854e-588edfd942c5" containerName="payload-processing"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370442    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7a724e-ec21-40ec-854e-588edfd942c5" containerName="payload-processing"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370448    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01de5346-db4b-4526-95ff-875363a7eaa0" containerName="maas-api"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370454    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="01de5346-db4b-4526-95ff-875363a7eaa0" containerName="maas-api"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370527    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7a724e-ec21-40ec-854e-588edfd942c5" containerName="payload-processing"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370536    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="01de5346-db4b-4526-95ff-875363a7eaa0" containerName="maas-api"
Sep 10 23:54:02.370585 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.370548    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc65148-a251-42c7-a52c-15a2374436d5" containerName="payload-pre-processing"
Sep 10 23:54:02.379185 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.379160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.381828 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.381802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fe49c344-openshift-default-dockercfg-7n94s\""
Sep 10 23:54:02.387747 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.387709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:54:02.452954 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.452916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv5jz\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453123 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.452960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453123 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453123 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453340 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.453503 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.453355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554077 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv5jz\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554453 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554840 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554840 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.554840 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.555004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.555004 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.554992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.556904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.556880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.557135 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.557113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.578162 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.578128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.578472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.578450    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv5jz\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz\") pod \"e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") " pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.692400 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.692363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:02.973968 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.973944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:54:02.975912 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:54:02.975885    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3ace74_ae6e_4dc1_947e_5357362e5c30.slice/crio-07aeb2f4634d107b0b61aa7001b3f2deabca50b3fcf1c2719bae0ef1911c74c3 WatchSource:0}: Error finding container 07aeb2f4634d107b0b61aa7001b3f2deabca50b3fcf1c2719bae0ef1911c74c3: Status 404 returned error can't find the container with id 07aeb2f4634d107b0b61aa7001b3f2deabca50b3fcf1c2719bae0ef1911c74c3
Sep 10 23:54:02.978138 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.978107    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:02.978203 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.978175    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:02.978245 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:02.978203    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:03.728945 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:03.728901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerStarted","Data":"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"}
Sep 10 23:54:03.729396 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:03.728960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerStarted","Data":"07aeb2f4634d107b0b61aa7001b3f2deabca50b3fcf1c2719bae0ef1911c74c3"}
Sep 10 23:54:03.772702 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:03.772646    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podStartSLOduration=1.772627752 podStartE2EDuration="1.772627752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:54:03.770784929 +0000 UTC m=+1060.870367034" watchObservedRunningTime="2026-09-10 23:54:03.772627752 +0000 UTC m=+1060.872209854"
Sep 10 23:54:04.693133 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:04.693101    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:04.698679 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:04.698652    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:04.736275 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:04.736241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:04.737370 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:04.737348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:07.674943 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.674904    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:07.678990 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.678966    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.681670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.681641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fe49c344-serving-cert\""
Sep 10 23:54:07.691374 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.691343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:07.814725 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.814691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6flb\" (UniqueName: \"kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.814901 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.814730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.814901 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.814878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.814972 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.814902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.916505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.916467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.916505 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.916506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.916784 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.916643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6flb\" (UniqueName: \"kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.916784 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.916685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.916924 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:54:07.916879    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-serving-cert: secret "maas-api-e2e-mt-fe49c344-serving-cert" not found
Sep 10 23:54:07.916975 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:54:07.916957    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls podName:6b1a691b-19e4-4f95-8514-35df191269b8 nodeName:}" failed. No retries permitted until 2026-09-10 23:54:08.416935292 +0000 UTC m=+1065.516517392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls") pod "maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" (UID: "6b1a691b-19e4-4f95-8514-35df191269b8") : secret "maas-api-e2e-mt-fe49c344-serving-cert" not found
Sep 10 23:54:07.917346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.917325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.919281 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.919258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:07.927439 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:07.927350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6flb\" (UniqueName: \"kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:08.422558 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:08.422270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:08.425047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:08.425023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") pod \"maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:08.593813 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:08.593775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:08.872472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:08.872447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:08.874164 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:54:08.874137    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1a691b_19e4_4f95_8514_35df191269b8.slice/crio-b495a3488134d5e558a6089e7cbef4b8b321381c9ac68c5f00a352ae775d0340 WatchSource:0}: Error finding container b495a3488134d5e558a6089e7cbef4b8b321381c9ac68c5f00a352ae775d0340: Status 404 returned error can't find the container with id b495a3488134d5e558a6089e7cbef4b8b321381c9ac68c5f00a352ae775d0340
Sep 10 23:54:09.768864 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:09.768831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" event={"ID":"6b1a691b-19e4-4f95-8514-35df191269b8","Type":"ContainerStarted","Data":"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"}
Sep 10 23:54:09.769087 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:09.768892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:09.769087 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:09.768912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" event={"ID":"6b1a691b-19e4-4f95-8514-35df191269b8","Type":"ContainerStarted","Data":"b495a3488134d5e558a6089e7cbef4b8b321381c9ac68c5f00a352ae775d0340"}
Sep 10 23:54:09.788809 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:09.788748    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" podStartSLOduration=2.46973421 podStartE2EDuration="2.788730067s" totalImagesPullingTime="318.995857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:54:09.786681685 +0000 UTC m=+1066.886263788" watchObservedRunningTime="2026-09-10 23:54:09.788730067 +0000 UTC m=+1066.888312169"
Sep 10 23:54:15.783834 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:15.783743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:25.877903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.877816    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerID="445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea" exitCode=0
Sep 10 23:54:25.877903 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.877862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerDied","Data":"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"}
Sep 10 23:54:25.878356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.878324    2581 scope.go:117] "RemoveContainer" containerID="445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"
Sep 10 23:54:25.879473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.879449    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:25.879538 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.879525    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:25.879573 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:25.879557    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:54:26.890831 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:26.890784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerStarted","Data":"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"}
Sep 10 23:54:27.692828 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:27.692793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:27.693208 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:27.693114    2581 patch_prober.go:28] interesting pod/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:54:27.693481 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:27.693454    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:54:28.693568 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:28.693526    2581 patch_prober.go:28] interesting pod/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:54:28.694182 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:28.694152    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:54:29.693534 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:29.693487    2581 patch_prober.go:28] interesting pod/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:54:29.693760 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:29.693575    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:54:30.693555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:30.693092    2581 patch_prober.go:28] interesting pod/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:54:30.693555 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:30.693156    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:54:31.693939 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:31.693468    2581 patch_prober.go:28] interesting pod/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:54:31.693939 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:31.693545    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 10 23:54:32.697323 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:32.697278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:32.697771 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:32.697620    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:32.698237 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:32.698220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:54:48.398916 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.398886    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:48.399537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.399121    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" podUID="6b1a691b-19e4-4f95-8514-35df191269b8" containerName="maas-api" containerID="cri-o://21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4" gracePeriod=30
Sep 10 23:54:48.644200 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.644174    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:48.739923 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.739889    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca\") pod \"6b1a691b-19e4-4f95-8514-35df191269b8\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") "
Sep 10 23:54:48.740131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.739970    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6flb\" (UniqueName: \"kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb\") pod \"6b1a691b-19e4-4f95-8514-35df191269b8\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") "
Sep 10 23:54:48.740131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.740005    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs\") pod \"6b1a691b-19e4-4f95-8514-35df191269b8\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") "
Sep 10 23:54:48.740131 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.740031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") pod \"6b1a691b-19e4-4f95-8514-35df191269b8\" (UID: \"6b1a691b-19e4-4f95-8514-35df191269b8\") "
Sep 10 23:54:48.740352 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.740322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b1a691b-19e4-4f95-8514-35df191269b8" (UID: "6b1a691b-19e4-4f95-8514-35df191269b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:54:48.742223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.742191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb" (OuterVolumeSpecName: "kube-api-access-m6flb") pod "6b1a691b-19e4-4f95-8514-35df191269b8" (UID: "6b1a691b-19e4-4f95-8514-35df191269b8"). InnerVolumeSpecName "kube-api-access-m6flb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:54:48.742364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.742280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b1a691b-19e4-4f95-8514-35df191269b8" (UID: "6b1a691b-19e4-4f95-8514-35df191269b8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:54:48.742364 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.742345    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b1a691b-19e4-4f95-8514-35df191269b8" (UID: "6b1a691b-19e4-4f95-8514-35df191269b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:54:48.841767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.841730    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b1a691b-19e4-4f95-8514-35df191269b8-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:54:48.841767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.841760    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6flb\" (UniqueName: \"kubernetes.io/projected/6b1a691b-19e4-4f95-8514-35df191269b8-kube-api-access-m6flb\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:54:48.841767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.841770    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:54:48.842008 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:48.841779    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b1a691b-19e4-4f95-8514-35df191269b8-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:54:49.056259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.056164    2581 generic.go:356] "Generic (PLEG): container finished" podID="6b1a691b-19e4-4f95-8514-35df191269b8" containerID="21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4" exitCode=0
Sep 10 23:54:49.056259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.056208    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"
Sep 10 23:54:49.056491 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.056251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" event={"ID":"6b1a691b-19e4-4f95-8514-35df191269b8","Type":"ContainerDied","Data":"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"}
Sep 10 23:54:49.056491 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.056330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv" event={"ID":"6b1a691b-19e4-4f95-8514-35df191269b8","Type":"ContainerDied","Data":"b495a3488134d5e558a6089e7cbef4b8b321381c9ac68c5f00a352ae775d0340"}
Sep 10 23:54:49.056491 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.056354    2581 scope.go:117] "RemoveContainer" containerID="21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"
Sep 10 23:54:49.067143 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.067129    2581 scope.go:117] "RemoveContainer" containerID="21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"
Sep 10 23:54:49.067461 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:54:49.067440    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4\": container with ID starting with 21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4 not found: ID does not exist" containerID="21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"
Sep 10 23:54:49.067507 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.067469    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4"} err="failed to get container status \"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4\": rpc error: code = NotFound desc = could not find container \"21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4\": container with ID starting with 21e242504aa8fda635e2ba3c383f934f4d218312673de6a8c92ae85b3a14d6c4 not found: ID does not exist"
Sep 10 23:54:49.079265 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.079242    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:49.085516 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.085492    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fe49c344-594bd848b9-l4ftv"]
Sep 10 23:54:49.449871 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:49.449837    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1a691b-19e4-4f95-8514-35df191269b8" path="/var/lib/kubelet/pods/6b1a691b-19e4-4f95-8514-35df191269b8/volumes"
Sep 10 23:54:55.377351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:55.377312    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:54:55.377821 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:54:55.377607    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy" containerID="cri-o://776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb" gracePeriod=30
Sep 10 23:55:00.638098 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.638072    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:55:00.662620 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662647    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662704    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662773 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv5jz\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.662962 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data\") pod \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\" (UID: \"2c3ace74-ae6e-4dc1-947e-5357362e5c30\") "
Sep 10 23:55:00.663167 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.662992    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:00.663167 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663062    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:00.663167 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663114    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:00.663378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:00.663378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663303    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.663378 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663333    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-workload-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.663540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.663503    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:00.665310 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.665260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:55:00.665431 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.665405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz" (OuterVolumeSpecName: "kube-api-access-zv5jz") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "kube-api-access-zv5jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:00.665501 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.665445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:00.665501 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.665460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c3ace74-ae6e-4dc1-947e-5357362e5c30" (UID: "2c3ace74-ae6e-4dc1-947e-5357362e5c30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:55:00.764537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764506    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-token\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764532    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-envoy\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764537 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764540    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istiod-ca-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764549    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-credential-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764558    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-podinfo\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764567    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv5jz\" (UniqueName: \"kubernetes.io/projected/2c3ace74-ae6e-4dc1-947e-5357362e5c30-kube-api-access-zv5jz\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:00.764780 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:00.764575    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3ace74-ae6e-4dc1-947e-5357362e5c30-istio-data\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:01.142856 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.142768    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerID="776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb" exitCode=0
Sep 10 23:55:01.142856 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.142824    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"
Sep 10 23:55:01.143030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.142865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerDied","Data":"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"}
Sep 10 23:55:01.143030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.142956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w" event={"ID":"2c3ace74-ae6e-4dc1-947e-5357362e5c30","Type":"ContainerDied","Data":"07aeb2f4634d107b0b61aa7001b3f2deabca50b3fcf1c2719bae0ef1911c74c3"}
Sep 10 23:55:01.143030 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.142982    2581 scope.go:117] "RemoveContainer" containerID="776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"
Sep 10 23:55:01.153791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.153772    2581 scope.go:117] "RemoveContainer" containerID="445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"
Sep 10 23:55:01.164235 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.164215    2581 scope.go:117] "RemoveContainer" containerID="776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"
Sep 10 23:55:01.164562 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:55:01.164543    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb\": container with ID starting with 776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb not found: ID does not exist" containerID="776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"
Sep 10 23:55:01.164646 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.164573    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb"} err="failed to get container status \"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb\": rpc error: code = NotFound desc = could not find container \"776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb\": container with ID starting with 776198b2d8a58ef804ed1ae856b4859d352ce1a3fec8cf628758d80a9ee0e6eb not found: ID does not exist"
Sep 10 23:55:01.164646 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.164590    2581 scope.go:117] "RemoveContainer" containerID="445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"
Sep 10 23:55:01.164862 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:55:01.164847    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea\": container with ID starting with 445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea not found: ID does not exist" containerID="445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"
Sep 10 23:55:01.164904 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.164868    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea"} err="failed to get container status \"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea\": rpc error: code = NotFound desc = could not find container \"445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea\": container with ID starting with 445d8a4a709253de528c04b25069ea48fdd6802f10580ba0a2213c6bfda880ea not found: ID does not exist"
Sep 10 23:55:01.166448 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.166427    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:55:01.169279 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.169258    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fe49c344-openshift-default-7c8c8b4c56-4kf4w"]
Sep 10 23:55:01.450099 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:01.450067    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" path="/var/lib/kubelet/pods/2c3ace74-ae6e-4dc1-947e-5357362e5c30/volumes"
Sep 10 23:55:14.139073 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139038    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 10 23:55:14.139547 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139531    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139547 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139548    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139558    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1a691b-19e4-4f95-8514-35df191269b8" containerName="maas-api"
Sep 10 23:55:14.139643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139563    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1a691b-19e4-4f95-8514-35df191269b8" containerName="maas-api"
Sep 10 23:55:14.139643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139572    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139578    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139643 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139639    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139648    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3ace74-ae6e-4dc1-947e-5357362e5c30" containerName="istio-proxy"
Sep 10 23:55:14.139791 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.139653    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1a691b-19e4-4f95-8514-35df191269b8" containerName="maas-api"
Sep 10 23:55:14.144456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.144433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.146601 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.146575    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-396319-serving-cert\""
Sep 10 23:55:14.156097 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.156073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 10 23:55:14.201828 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.201787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.202032 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.201840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.202032 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.201937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfcd\" (UniqueName: \"kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.202032 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.201963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.303130 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.303097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.303351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.303137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.303351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.303205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfcd\" (UniqueName: \"kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.303351 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.303231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.303890 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.303854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.305790 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.305772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.305901 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.305789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.311515 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.311491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfcd\" (UniqueName: \"kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd\") pod \"maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.457050 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.457016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:14.730637 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:14.730603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 10 23:55:14.732107 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:55:14.732085    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e22c02_bd93_48db_aa42_30e0c997b3f8.slice/crio-e8e5ab49c06a9a0af0b596d411a5caf97fcee95a6945326fea1404e9990c2185 WatchSource:0}: Error finding container e8e5ab49c06a9a0af0b596d411a5caf97fcee95a6945326fea1404e9990c2185: Status 404 returned error can't find the container with id e8e5ab49c06a9a0af0b596d411a5caf97fcee95a6945326fea1404e9990c2185
Sep 10 23:55:15.238403 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:15.238370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" event={"ID":"91e22c02-bd93-48db-aa42-30e0c997b3f8","Type":"ContainerStarted","Data":"e8e5ab49c06a9a0af0b596d411a5caf97fcee95a6945326fea1404e9990c2185"}
Sep 10 23:55:16.245547 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:16.245506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" event={"ID":"91e22c02-bd93-48db-aa42-30e0c997b3f8","Type":"ContainerStarted","Data":"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"}
Sep 10 23:55:16.246015 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:16.245569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:16.273708 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:16.273659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" podStartSLOduration=1.787610308 podStartE2EDuration="2.273644147s" totalImagesPullingTime="486.033839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:16.273062535 +0000 UTC m=+1133.372644637" watchObservedRunningTime="2026-09-10 23:55:16.273644147 +0000 UTC m=+1133.373226248"
Sep 10 23:55:22.257468 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:22.257434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 10 23:55:37.947867 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:37.947836    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 10 23:55:37.953350 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:37.953325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:37.956276 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:37.956254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-16e45a-openshift-default-dockercfg-9h69z\""
Sep 10 23:55:37.974540 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:37.974508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 10 23:55:38.048952 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.048913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049156 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.048982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049156 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049156 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049156 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mks4r\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.049410 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.049267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150018 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.149981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150177 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mks4r\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150792 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.150917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.150894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.152906 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.152887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.153018 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.152974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.172774 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.172739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.185252 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.185215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mks4r\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r\") pod \"e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") " pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.263750 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.263671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:38.553676 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.553646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 10 23:55:38.554344 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:55:38.554317    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc931ce3a_a20b_4d22_a9d8_4e0396a1b230.slice/crio-673542dde5424b11ef488fdb82324991b6bda357653fdfe01476dc3ddaab35c5 WatchSource:0}: Error finding container 673542dde5424b11ef488fdb82324991b6bda357653fdfe01476dc3ddaab35c5: Status 404 returned error can't find the container with id 673542dde5424b11ef488fdb82324991b6bda357653fdfe01476dc3ddaab35c5
Sep 10 23:55:38.556557 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.556527    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:38.556621 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.556609    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:38.556664 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:38.556640    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:39.430025 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:39.429983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerStarted","Data":"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"}
Sep 10 23:55:39.430426 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:39.430048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerStarted","Data":"673542dde5424b11ef488fdb82324991b6bda357653fdfe01476dc3ddaab35c5"}
Sep 10 23:55:39.458942 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:39.458892    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podStartSLOduration=2.458873267 podStartE2EDuration="2.458873267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:39.455577901 +0000 UTC m=+1156.555160002" watchObservedRunningTime="2026-09-10 23:55:39.458873267 +0000 UTC m=+1156.558455368"
Sep 10 23:55:40.264762 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:40.264721    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:40.269767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:40.269741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:40.437570 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:40.437540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:40.438473 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:40.438456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:55:44.172462 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.172429    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 10 23:55:44.177859 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.177819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.180807 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.180783    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-16e45a-serving-cert\""
Sep 10 23:55:44.185977 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.185948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 10 23:55:44.214887 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.214854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.215041 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.214889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.215041 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.214980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.215141 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.215043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9pn\" (UniqueName: \"kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.315907 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.315870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.315907 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.315904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.316161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.315946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.316161 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.315991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9pn\" (UniqueName: \"kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.316623 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.316600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.318638 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.318607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.318638 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.318604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.323573 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.323551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9pn\" (UniqueName: \"kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn\") pod \"maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.493392 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.493302    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:44.790472 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:55:44.790436    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f29d2b_b4d7_4fef_8fb8_490b73e70f1c.slice/crio-e99ec7a2bcf8f7fa2393cfb09b74c5e9b06c5f7450b806c2f5681f6bbfbea7b7 WatchSource:0}: Error finding container e99ec7a2bcf8f7fa2393cfb09b74c5e9b06c5f7450b806c2f5681f6bbfbea7b7: Status 404 returned error can't find the container with id e99ec7a2bcf8f7fa2393cfb09b74c5e9b06c5f7450b806c2f5681f6bbfbea7b7
Sep 10 23:55:44.790734 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:44.790707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 10 23:55:45.468139 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.468049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" event={"ID":"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c","Type":"ContainerStarted","Data":"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"}
Sep 10 23:55:45.468139 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.468109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" event={"ID":"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c","Type":"ContainerStarted","Data":"e99ec7a2bcf8f7fa2393cfb09b74c5e9b06c5f7450b806c2f5681f6bbfbea7b7"}
Sep 10 23:55:45.468544 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.468140    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:45.484467 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.484419    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" podStartSLOduration=1.111436186 podStartE2EDuration="1.484400796s" totalImagesPullingTime="372.96461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:55:45.483319123 +0000 UTC m=+1162.582901226" watchObservedRunningTime="2026-09-10 23:55:45.484400796 +0000 UTC m=+1162.583982898"
Sep 10 23:55:45.631489 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.631456    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:55:45.631713 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.631679    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" podUID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" containerName="maas-api" containerID="cri-o://19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945" gracePeriod=30
Sep 10 23:55:45.698767 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.698732    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:55:45.699001 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.698977    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" podUID="df20d88c-7d96-419e-8d01-24ef1f88c043" containerName="payload-pre-processing" containerID="cri-o://1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7" gracePeriod=30
Sep 10 23:55:45.973583 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:45.973509    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:55:46.033916 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.033887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qddl\" (UniqueName: \"kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl\") pod \"df20d88c-7d96-419e-8d01-24ef1f88c043\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") "
Sep 10 23:55:46.034066 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.033929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume\") pod \"df20d88c-7d96-419e-8d01-24ef1f88c043\" (UID: \"df20d88c-7d96-419e-8d01-24ef1f88c043\") "
Sep 10 23:55:46.034356 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.034332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "df20d88c-7d96-419e-8d01-24ef1f88c043" (UID: "df20d88c-7d96-419e-8d01-24ef1f88c043"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:46.037091 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.037068    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl" (OuterVolumeSpecName: "kube-api-access-2qddl") pod "df20d88c-7d96-419e-8d01-24ef1f88c043" (UID: "df20d88c-7d96-419e-8d01-24ef1f88c043"). InnerVolumeSpecName "kube-api-access-2qddl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:46.122253 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.122226    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:55:46.135763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.135734    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qddl\" (UniqueName: \"kubernetes.io/projected/df20d88c-7d96-419e-8d01-24ef1f88c043-kube-api-access-2qddl\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.135763 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.135762    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df20d88c-7d96-419e-8d01-24ef1f88c043-plugins-config-volume\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.236800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.236717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkpd4\" (UniqueName: \"kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4\") pod \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") "
Sep 10 23:55:46.236957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.236827    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls\") pod \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") "
Sep 10 23:55:46.236957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.236885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca\") pod \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") "
Sep 10 23:55:46.236957 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.236932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs\") pod \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\" (UID: \"f4c56340-1691-4cb9-afa5-e5eb05df5c01\") "
Sep 10 23:55:46.237376 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.237345    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4c56340-1691-4cb9-afa5-e5eb05df5c01" (UID: "f4c56340-1691-4cb9-afa5-e5eb05df5c01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:55:46.239070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.239040    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4c56340-1691-4cb9-afa5-e5eb05df5c01" (UID: "f4c56340-1691-4cb9-afa5-e5eb05df5c01"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:46.239070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.239057    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4c56340-1691-4cb9-afa5-e5eb05df5c01" (UID: "f4c56340-1691-4cb9-afa5-e5eb05df5c01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:55:46.239070 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.239066    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4" (OuterVolumeSpecName: "kube-api-access-lkpd4") pod "f4c56340-1691-4cb9-afa5-e5eb05df5c01" (UID: "f4c56340-1691-4cb9-afa5-e5eb05df5c01"). InnerVolumeSpecName "kube-api-access-lkpd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:55:46.338374 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.338348    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkpd4\" (UniqueName: \"kubernetes.io/projected/f4c56340-1691-4cb9-afa5-e5eb05df5c01-kube-api-access-lkpd4\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.338374 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.338374    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.338615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.338385    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c56340-1691-4cb9-afa5-e5eb05df5c01-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.338615 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.338393    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c56340-1691-4cb9-afa5-e5eb05df5c01-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:55:46.475679 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.475641    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" containerID="19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945" exitCode=0
Sep 10 23:55:46.476157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.475688    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"
Sep 10 23:55:46.476157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.475731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" event={"ID":"f4c56340-1691-4cb9-afa5-e5eb05df5c01","Type":"ContainerDied","Data":"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"}
Sep 10 23:55:46.476157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.475783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl" event={"ID":"f4c56340-1691-4cb9-afa5-e5eb05df5c01","Type":"ContainerDied","Data":"8d796e8a3578c34b90e47a8cd29b5422ed966d2443b75c5301a3d4e5bda72414"}
Sep 10 23:55:46.476157 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.475807    2581 scope.go:117] "RemoveContainer" containerID="19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"
Sep 10 23:55:46.477362 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.477332    2581 generic.go:356] "Generic (PLEG): container finished" podID="df20d88c-7d96-419e-8d01-24ef1f88c043" containerID="1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7" exitCode=0
Sep 10 23:55:46.477472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.477379    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"
Sep 10 23:55:46.477472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.477414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" event={"ID":"df20d88c-7d96-419e-8d01-24ef1f88c043","Type":"ContainerDied","Data":"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"}
Sep 10 23:55:46.477472 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.477452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp" event={"ID":"df20d88c-7d96-419e-8d01-24ef1f88c043","Type":"ContainerDied","Data":"47f7e8e9f96640f21bc889a05edb7d098e0d0bbee695bf2160a1a09251a4eee4"}
Sep 10 23:55:46.490825 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.490800    2581 scope.go:117] "RemoveContainer" containerID="19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"
Sep 10 23:55:46.491378 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:55:46.491348    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945\": container with ID starting with 19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945 not found: ID does not exist" containerID="19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"
Sep 10 23:55:46.491458 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.491389    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945"} err="failed to get container status \"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945\": rpc error: code = NotFound desc = could not find container \"19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945\": container with ID starting with 19961d41a61b5a0a1fb52e16617418dc5249f6ef4f1eee11575200b51c891945 not found: ID does not exist"
Sep 10 23:55:46.491458 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.491427    2581 scope.go:117] "RemoveContainer" containerID="1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"
Sep 10 23:55:46.500375 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.500355    2581 scope.go:117] "RemoveContainer" containerID="1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"
Sep 10 23:55:46.500678 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:55:46.500659    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7\": container with ID starting with 1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7 not found: ID does not exist" containerID="1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"
Sep 10 23:55:46.500725 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.500687    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7"} err="failed to get container status \"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7\": rpc error: code = NotFound desc = could not find container \"1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7\": container with ID starting with 1bdbd6879d0bf9d4c776c755ebaf1e6960574bd35ff2c514c3fe3f12c7e321c7 not found: ID does not exist"
Sep 10 23:55:46.505704 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.505682    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:55:46.509328 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.509308    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4c5699-5c979bfcbc-x22rl"]
Sep 10 23:55:46.518685 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.518666    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:55:46.524718 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:46.524700    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4c5699-5744f56df8-wgpnp"]
Sep 10 23:55:47.449703 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:47.449672    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df20d88c-7d96-419e-8d01-24ef1f88c043" path="/var/lib/kubelet/pods/df20d88c-7d96-419e-8d01-24ef1f88c043/volumes"
Sep 10 23:55:47.450103 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:47.450088    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" path="/var/lib/kubelet/pods/f4c56340-1691-4cb9-afa5-e5eb05df5c01/volumes"
Sep 10 23:55:51.489605 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:51.489563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 10 23:55:56.480465 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:56.480420    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:55:56.480917 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:56.480496    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:55:58.558902 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.558810    2581 generic.go:356] "Generic (PLEG): container finished" podID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerID="db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70" exitCode=0
Sep 10 23:55:58.558902 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.558887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerDied","Data":"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"}
Sep 10 23:55:58.559365 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.559349    2581 scope.go:117] "RemoveContainer" containerID="db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"
Sep 10 23:55:58.560381 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.560356    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:58.560451 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.560419    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:58.560490 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:58.560449    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 10 23:55:59.567275 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:55:59.567238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerStarted","Data":"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"}
Sep 10 23:56:00.264068 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:00.264033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:56:00.264369 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:00.264342    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 23:56:00.264475 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:00.264401    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 23:56:01.264671 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:01.264635    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 23:56:01.265047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:01.264695    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 23:56:02.264401 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:02.264348    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 23:56:02.264574 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:02.264409    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 23:56:03.264246 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:03.264199    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 23:56:03.264728 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:03.264265    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 23:56:04.264969 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:04.264933    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 23:56:04.265390 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:04.264987    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 23:56:05.268111 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:05.268082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:56:05.268591 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:05.268479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:56:05.269048 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:05.269031    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 10 23:56:20.179190 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179157    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 10 23:56:20.179670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179628    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df20d88c-7d96-419e-8d01-24ef1f88c043" containerName="payload-pre-processing"
Sep 10 23:56:20.179670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df20d88c-7d96-419e-8d01-24ef1f88c043" containerName="payload-pre-processing"
Sep 10 23:56:20.179670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179653    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" containerName="maas-api"
Sep 10 23:56:20.179670 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179658    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" containerName="maas-api"
Sep 10 23:56:20.179800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179738    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c56340-1691-4cb9-afa5-e5eb05df5c01" containerName="maas-api"
Sep 10 23:56:20.179800 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.179747    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df20d88c-7d96-419e-8d01-24ef1f88c043" containerName="payload-pre-processing"
Sep 10 23:56:20.184377 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.184355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.186645 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.186625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-6fa41e-serving-cert\""
Sep 10 23:56:20.194095 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.194072    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 10 23:56:20.297940 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.297904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngsnr\" (UniqueName: \"kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.298107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.297947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.298107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.297973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.298107 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.298081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.399677 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.399645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.399846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.399766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngsnr\" (UniqueName: \"kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.399846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.399797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.399846 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.399812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.400447 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.400380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.402189 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.402170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.402308 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.402206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.414470 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.414447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngsnr\" (UniqueName: \"kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr\") pod \"maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.495771 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.495687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:20.769805 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:20.769776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 10 23:56:20.770762 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:56:20.770741    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2751bf_4dd0_48fa_aeb4_a38669dca2ba.slice/crio-63d06e099f4972cedeeb21db3aa2ca0bac3f2f6db5d7323d31f0f15c811b32c7 WatchSource:0}: Error finding container 63d06e099f4972cedeeb21db3aa2ca0bac3f2f6db5d7323d31f0f15c811b32c7: Status 404 returned error can't find the container with id 63d06e099f4972cedeeb21db3aa2ca0bac3f2f6db5d7323d31f0f15c811b32c7
Sep 10 23:56:21.710247 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:21.710212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" event={"ID":"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba","Type":"ContainerStarted","Data":"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"}
Sep 10 23:56:21.710618 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:21.710274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" event={"ID":"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba","Type":"ContainerStarted","Data":"63d06e099f4972cedeeb21db3aa2ca0bac3f2f6db5d7323d31f0f15c811b32c7"}
Sep 10 23:56:21.710618 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:21.710317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:56:21.728032 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:21.727977    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" podStartSLOduration=1.359306039 podStartE2EDuration="1.727959615s" totalImagesPullingTime="368.653576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:56:21.725975623 +0000 UTC m=+1198.825557735" watchObservedRunningTime="2026-09-10 23:56:21.727959615 +0000 UTC m=+1198.827541716"
Sep 10 23:56:27.723047 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:56:27.723017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 10 23:59:29.461958 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.461908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 10 23:59:29.466147 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.466119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.468772 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.468736    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-afe559-serving-cert\""
Sep 10 23:59:29.480460 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.480417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 10 23:59:29.490886 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.490842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg6lv\" (UniqueName: \"kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.491199 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.491177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.491273 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.491221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.491432 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.491400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.592911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.592868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg6lv\" (UniqueName: \"kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.592911 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.592926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.593196 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.592953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.593196 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.593028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.593196 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:59:29.593069    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-serving-cert: secret "maas-api-e2e-api-a-afe559-serving-cert" not found
Sep 10 23:59:29.593196 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:59:29.593154    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls podName:b5721131-e80a-4ae4-9866-72400c74d7c8 nodeName:}" failed. No retries permitted until 2026-09-10 23:59:30.09313269 +0000 UTC m=+1387.192714775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls") pod "maas-api-e2e-api-a-afe559-86786db75c-742wl" (UID: "b5721131-e80a-4ae4-9866-72400c74d7c8") : secret "maas-api-e2e-api-a-afe559-serving-cert" not found
Sep 10 23:59:29.593942 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.593905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.596003 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.595968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:29.601581 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:29.601543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg6lv\" (UniqueName: \"kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:30.098511 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.098470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:30.101372 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.101335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") pod \"maas-api-e2e-api-a-afe559-86786db75c-742wl\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:30.382346 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.382202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:30.671985 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.671950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 10 23:59:30.674673 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:59:30.674638    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5721131_e80a_4ae4_9866_72400c74d7c8.slice/crio-8a15fa71c959b866c988979f66df26f35e057b220c8ff532f1d245f5d0c34aad WatchSource:0}: Error finding container 8a15fa71c959b866c988979f66df26f35e057b220c8ff532f1d245f5d0c34aad: Status 404 returned error can't find the container with id 8a15fa71c959b866c988979f66df26f35e057b220c8ff532f1d245f5d0c34aad
Sep 10 23:59:30.676612 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.676579    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:59:30.902249 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:30.902207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" event={"ID":"b5721131-e80a-4ae4-9866-72400c74d7c8","Type":"ContainerStarted","Data":"8a15fa71c959b866c988979f66df26f35e057b220c8ff532f1d245f5d0c34aad"}
Sep 10 23:59:31.910804 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:31.910756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" event={"ID":"b5721131-e80a-4ae4-9866-72400c74d7c8","Type":"ContainerStarted","Data":"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"}
Sep 10 23:59:31.911259 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:31.910856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:31.930076 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:31.929994    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" podStartSLOduration=2.428117758 podStartE2EDuration="2.929970984s" totalImagesPullingTime="501.853226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:59:31.927618601 +0000 UTC m=+1389.027200704" watchObservedRunningTime="2026-09-10 23:59:31.929970984 +0000 UTC m=+1389.029553083"
Sep 10 23:59:37.924032 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:37.923999    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 10 23:59:40.050794 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.050747    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7747-f408de"]
Sep 10 23:59:40.055229 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.055198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:40.057674 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.057641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk84\""
Sep 10 23:59:40.060456 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.060420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-f408de"]
Sep 10 23:59:40.109963 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.109918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bch5q\" (UniqueName: \"kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q\") pod \"test-curl-7747-f408de\" (UID: \"3d6534eb-f9c6-4132-a68f-042d73cd5e83\") " pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:40.210935 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.210886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bch5q\" (UniqueName: \"kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q\") pod \"test-curl-7747-f408de\" (UID: \"3d6534eb-f9c6-4132-a68f-042d73cd5e83\") " pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:40.219454 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.219421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bch5q\" (UniqueName: \"kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q\") pod \"test-curl-7747-f408de\" (UID: \"3d6534eb-f9c6-4132-a68f-042d73cd5e83\") " pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:40.369812 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.369710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:40.655795 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.655761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-f408de"]
Sep 10 23:59:40.659269 ip-10-0-129-151 kubenswrapper[2581]: W0910 23:59:40.659236    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d6534eb_f9c6_4132_a68f_042d73cd5e83.slice/crio-226ee359a83c0d99051920e3100b5081f17800008f13bb0e1daab3b1fc41b08d WatchSource:0}: Error finding container 226ee359a83c0d99051920e3100b5081f17800008f13bb0e1daab3b1fc41b08d: Status 404 returned error can't find the container with id 226ee359a83c0d99051920e3100b5081f17800008f13bb0e1daab3b1fc41b08d
Sep 10 23:59:40.984222 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:40.984185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-f408de" event={"ID":"3d6534eb-f9c6-4132-a68f-042d73cd5e83","Type":"ContainerStarted","Data":"226ee359a83c0d99051920e3100b5081f17800008f13bb0e1daab3b1fc41b08d"}
Sep 10 23:59:45.015909 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:45.015803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-f408de" event={"ID":"3d6534eb-f9c6-4132-a68f-042d73cd5e83","Type":"ContainerStarted","Data":"97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30"}
Sep 10 23:59:45.031564 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:45.031493    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7747-f408de" podStartSLOduration=0.998026658 podStartE2EDuration="5.03146952s" totalImagesPullingTime="4.033442862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:59:45.029058258 +0000 UTC m=+1402.128640360" watchObservedRunningTime="2026-09-10 23:59:45.03146952 +0000 UTC m=+1402.131051621"
Sep 10 23:59:45.648939 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:45.648882    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7747-f408de"]
Sep 10 23:59:45.653775 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:45.653741    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7747-f408de"]
Sep 10 23:59:46.022664 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:59:46.022625    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7747-f408de" container="test-curl-7747-f408de"
Sep 10 23:59:47.029155 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:47.029099    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7747-f408de" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" containerName="test-curl-7747-f408de" containerID="cri-o://97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30" gracePeriod=2
Sep 10 23:59:47.031421 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:59:47.031359    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7747-f408de\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:49.240042 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:49.240000    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:49.410223 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:49.410193    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bch5q\" (UniqueName: \"kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q\") pod \"3d6534eb-f9c6-4132-a68f-042d73cd5e83\" (UID: \"3d6534eb-f9c6-4132-a68f-042d73cd5e83\") "
Sep 10 23:59:49.412666 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:49.412628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q" (OuterVolumeSpecName: "kube-api-access-bch5q") pod "3d6534eb-f9c6-4132-a68f-042d73cd5e83" (UID: "3d6534eb-f9c6-4132-a68f-042d73cd5e83"). InnerVolumeSpecName "kube-api-access-bch5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:59:49.450805 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:49.450765    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" path="/var/lib/kubelet/pods/3d6534eb-f9c6-4132-a68f-042d73cd5e83/volumes"
Sep 10 23:59:49.511668 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:49.511629    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bch5q\" (UniqueName: \"kubernetes.io/projected/3d6534eb-f9c6-4132-a68f-042d73cd5e83-kube-api-access-bch5q\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 10 23:59:50.053536 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:50.053497    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" containerID="97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30" exitCode=137
Sep 10 23:59:50.053746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:50.053546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-f408de"
Sep 10 23:59:50.053746 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:50.053608    2581 scope.go:117] "RemoveContainer" containerID="97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30"
Sep 10 23:59:50.064443 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:50.064419    2581 scope.go:117] "RemoveContainer" containerID="97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30"
Sep 10 23:59:50.064872 ip-10-0-129-151 kubenswrapper[2581]: E0910 23:59:50.064843    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30\": container with ID starting with 97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30 not found: ID does not exist" containerID="97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30"
Sep 10 23:59:50.064994 ip-10-0-129-151 kubenswrapper[2581]: I0910 23:59:50.064881    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30"} err="failed to get container status \"97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30\": rpc error: code = NotFound desc = could not find container \"97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30\": container with ID starting with 97b3976fc871d3c1e4310142dda056d5f2db5205cc91388bf4519a1933260b30 not found: ID does not exist"
Sep 11 00:00:00.265699 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.265640    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29818080-hj8fk"]
Sep 11 00:00:00.266233 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.266216    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" containerName="test-curl-7747-f408de"
Sep 11 00:00:00.266233 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.266233    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" containerName="test-curl-7747-f408de"
Sep 11 00:00:00.266351 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.266333    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6534eb-f9c6-4132-a68f-042d73cd5e83" containerName="test-curl-7747-f408de"
Sep 11 00:00:00.269585 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.269557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.272397 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.272363    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-8gbc5\""
Sep 11 00:00:00.272775 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.272757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Sep 11 00:00:00.284675 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.284630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29818080-hj8fk"]
Sep 11 00:00:00.334371 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.334331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mg4\" (UniqueName: \"kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.334547 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.334493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.435342 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.435269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mg4\" (UniqueName: \"kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.435547 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.435473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.436257 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.436226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.451941 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.451895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mg4\" (UniqueName: \"kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4\") pod \"image-pruner-29818080-hj8fk\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") " pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.605981 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.605878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:00.898822 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:00.898766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29818080-hj8fk"]
Sep 11 00:00:00.901944 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:00:00.901901    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e92cb6_757f_44bb_ba81_0de3954c3cda.slice/crio-a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332 WatchSource:0}: Error finding container a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332: Status 404 returned error can't find the container with id a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332
Sep 11 00:00:01.135120 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:01.135076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-hj8fk" event={"ID":"52e92cb6-757f-44bb-ba81-0de3954c3cda","Type":"ContainerStarted","Data":"4c2a330cb7172c553baf14be40fb5ac897415ae0044f08db31afd8d0c3c55a5e"}
Sep 11 00:00:01.135315 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:01.135144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-hj8fk" event={"ID":"52e92cb6-757f-44bb-ba81-0de3954c3cda","Type":"ContainerStarted","Data":"a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332"}
Sep 11 00:00:01.154308 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:01.154165    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29818080-hj8fk" podStartSLOduration=1.154145915 podStartE2EDuration="1.154145915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:01.152133849 +0000 UTC m=+1418.251715950" watchObservedRunningTime="2026-09-11 00:00:01.154145915 +0000 UTC m=+1418.253728086"
Sep 11 00:00:02.144332 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:02.144257    2581 generic.go:356] "Generic (PLEG): container finished" podID="52e92cb6-757f-44bb-ba81-0de3954c3cda" containerID="4c2a330cb7172c553baf14be40fb5ac897415ae0044f08db31afd8d0c3c55a5e" exitCode=0
Sep 11 00:00:02.144812 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:02.144394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-hj8fk" event={"ID":"52e92cb6-757f-44bb-ba81-0de3954c3cda","Type":"ContainerDied","Data":"4c2a330cb7172c553baf14be40fb5ac897415ae0044f08db31afd8d0c3c55a5e"}
Sep 11 00:00:03.334147 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.334103    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:03.366201 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.366142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca\") pod \"52e92cb6-757f-44bb-ba81-0de3954c3cda\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") "
Sep 11 00:00:03.366201 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.366207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7mg4\" (UniqueName: \"kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4\") pod \"52e92cb6-757f-44bb-ba81-0de3954c3cda\" (UID: \"52e92cb6-757f-44bb-ba81-0de3954c3cda\") "
Sep 11 00:00:03.366653 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.366619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca" (OuterVolumeSpecName: "serviceca") pod "52e92cb6-757f-44bb-ba81-0de3954c3cda" (UID: "52e92cb6-757f-44bb-ba81-0de3954c3cda"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:03.366745 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.366728    2581 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52e92cb6-757f-44bb-ba81-0de3954c3cda-serviceca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:03.368884 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.368838    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4" (OuterVolumeSpecName: "kube-api-access-l7mg4") pod "52e92cb6-757f-44bb-ba81-0de3954c3cda" (UID: "52e92cb6-757f-44bb-ba81-0de3954c3cda"). InnerVolumeSpecName "kube-api-access-l7mg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:03.467880 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:03.467834    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7mg4\" (UniqueName: \"kubernetes.io/projected/52e92cb6-757f-44bb-ba81-0de3954c3cda-kube-api-access-l7mg4\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:04.160722 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.160690    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29818080-hj8fk"
Sep 11 00:00:04.160912 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.160726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29818080-hj8fk" event={"ID":"52e92cb6-757f-44bb-ba81-0de3954c3cda","Type":"ContainerDied","Data":"a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332"}
Sep 11 00:00:04.160912 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.160775    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7ef18a12ef0cb9f0ff12529376317c2971016308c02a2363875e5d0fd686332"
Sep 11 00:00:04.240575 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.240528    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:00:04.241715 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.241673    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e92cb6-757f-44bb-ba81-0de3954c3cda" containerName="image-pruner"
Sep 11 00:00:04.241715 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.241714    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e92cb6-757f-44bb-ba81-0de3954c3cda" containerName="image-pruner"
Sep 11 00:00:04.241932 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.241845    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e92cb6-757f-44bb-ba81-0de3954c3cda" containerName="image-pruner"
Sep 11 00:00:04.245961 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.245928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.248640 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.248604    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-02bac9-serving-cert\""
Sep 11 00:00:04.257700 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.257666    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:00:04.277573 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.277533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.277785 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.277684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.277785 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.277736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ch9\" (UniqueName: \"kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.277785 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.277777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.379134 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.379086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.379134 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.379135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ch9\" (UniqueName: \"kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.379688 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.379171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.379688 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.379242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.379688 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:00:04.379262    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-serving-cert: secret "maas-api-e2e-api-b-02bac9-serving-cert" not found
Sep 11 00:00:04.379688 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:00:04.379367    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls podName:3c67352e-5bb1-463d-88bf-310b8a880e74 nodeName:}" failed. No retries permitted until 2026-09-11 00:00:04.879340275 +0000 UTC m=+1421.978922355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls") pod "maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" (UID: "3c67352e-5bb1-463d-88bf-310b8a880e74") : secret "maas-api-e2e-api-b-02bac9-serving-cert" not found
Sep 11 00:00:04.379958 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.379936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.382272 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.382231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.388643 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.388614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ch9\" (UniqueName: \"kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.887274 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.887223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:04.890476 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:04.890444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") pod \"maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:05.165563 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:05.165520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:05.456055 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:05.456014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:00:05.457261 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:00:05.457225    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c67352e_5bb1_463d_88bf_310b8a880e74.slice/crio-fb2164614fd4a7001a3b7a66bee43bf4d7278d6799be22d3ef5944b6f285ab9b WatchSource:0}: Error finding container fb2164614fd4a7001a3b7a66bee43bf4d7278d6799be22d3ef5944b6f285ab9b: Status 404 returned error can't find the container with id fb2164614fd4a7001a3b7a66bee43bf4d7278d6799be22d3ef5944b6f285ab9b
Sep 11 00:00:06.180247 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:06.180208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" event={"ID":"3c67352e-5bb1-463d-88bf-310b8a880e74","Type":"ContainerStarted","Data":"fb2164614fd4a7001a3b7a66bee43bf4d7278d6799be22d3ef5944b6f285ab9b"}
Sep 11 00:00:07.193029 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:07.192984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" event={"ID":"3c67352e-5bb1-463d-88bf-310b8a880e74","Type":"ContainerStarted","Data":"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"}
Sep 11 00:00:07.193568 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:07.193112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:07.213012 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:07.212927    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" podStartSLOduration=2.535247779 podStartE2EDuration="3.212900391s" totalImagesPullingTime="677.652612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:00:07.208469217 +0000 UTC m=+1424.308051321" watchObservedRunningTime="2026-09-11 00:00:07.212900391 +0000 UTC m=+1424.312482495"
Sep 11 00:00:13.205871 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:13.205830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:00:48.563346 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.563277    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 11 00:00:48.564053 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.563643    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" podUID="b5721131-e80a-4ae4-9866-72400c74d7c8" containerName="maas-api" containerID="cri-o://eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5" gracePeriod=30
Sep 11 00:00:48.856877 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.856831    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 11 00:00:48.985237 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.985192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg6lv\" (UniqueName: \"kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv\") pod \"b5721131-e80a-4ae4-9866-72400c74d7c8\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") "
Sep 11 00:00:48.985466 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.985260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca\") pod \"b5721131-e80a-4ae4-9866-72400c74d7c8\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") "
Sep 11 00:00:48.985466 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.985420    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") pod \"b5721131-e80a-4ae4-9866-72400c74d7c8\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") "
Sep 11 00:00:48.985466 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.985465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs\") pod \"b5721131-e80a-4ae4-9866-72400c74d7c8\" (UID: \"b5721131-e80a-4ae4-9866-72400c74d7c8\") "
Sep 11 00:00:48.986702 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.986654    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5721131-e80a-4ae4-9866-72400c74d7c8" (UID: "b5721131-e80a-4ae4-9866-72400c74d7c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:00:48.988171 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.988131    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5721131-e80a-4ae4-9866-72400c74d7c8" (UID: "b5721131-e80a-4ae4-9866-72400c74d7c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:48.988610 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.988574    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv" (OuterVolumeSpecName: "kube-api-access-jg6lv") pod "b5721131-e80a-4ae4-9866-72400c74d7c8" (UID: "b5721131-e80a-4ae4-9866-72400c74d7c8"). InnerVolumeSpecName "kube-api-access-jg6lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:00:48.988815 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:48.988778    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b5721131-e80a-4ae4-9866-72400c74d7c8" (UID: "b5721131-e80a-4ae4-9866-72400c74d7c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:00:49.087316 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.087162    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg6lv\" (UniqueName: \"kubernetes.io/projected/b5721131-e80a-4ae4-9866-72400c74d7c8-kube-api-access-jg6lv\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:49.087316 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.087217    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5721131-e80a-4ae4-9866-72400c74d7c8-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:49.087316 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.087233    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:49.087316 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.087250    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5721131-e80a-4ae4-9866-72400c74d7c8-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:00:49.493759 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.493715    2581 generic.go:356] "Generic (PLEG): container finished" podID="b5721131-e80a-4ae4-9866-72400c74d7c8" containerID="eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5" exitCode=0
Sep 11 00:00:49.493992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.493780    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"
Sep 11 00:00:49.493992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.493809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" event={"ID":"b5721131-e80a-4ae4-9866-72400c74d7c8","Type":"ContainerDied","Data":"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"}
Sep 11 00:00:49.493992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.493871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl" event={"ID":"b5721131-e80a-4ae4-9866-72400c74d7c8","Type":"ContainerDied","Data":"8a15fa71c959b866c988979f66df26f35e057b220c8ff532f1d245f5d0c34aad"}
Sep 11 00:00:49.493992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.493897    2581 scope.go:117] "RemoveContainer" containerID="eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"
Sep 11 00:00:49.505632 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.505610    2581 scope.go:117] "RemoveContainer" containerID="eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"
Sep 11 00:00:49.506041 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:00:49.506019    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5\": container with ID starting with eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5 not found: ID does not exist" containerID="eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"
Sep 11 00:00:49.506117 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.506058    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5"} err="failed to get container status \"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5\": rpc error: code = NotFound desc = could not find container \"eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5\": container with ID starting with eb81fea01d3171d49572c9efa4d6156946dc27b8d91df344c593cf0181fc7be5 not found: ID does not exist"
Sep 11 00:00:49.524305 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.524259    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 11 00:00:49.538102 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:49.538058    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-afe559-86786db75c-742wl"]
Sep 11 00:00:51.451690 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:00:51.451645    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5721131-e80a-4ae4-9866-72400c74d7c8" path="/var/lib/kubelet/pods/b5721131-e80a-4ae4-9866-72400c74d7c8/volumes"
Sep 11 00:01:11.013879 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.013813    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:01:11.014507 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.014167    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" podUID="3c67352e-5bb1-463d-88bf-310b8a880e74" containerName="maas-api" containerID="cri-o://211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25" gracePeriod=30
Sep 11 00:01:11.311011 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.310960    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:01:11.441268 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2ch9\" (UniqueName: \"kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9\") pod \"3c67352e-5bb1-463d-88bf-310b8a880e74\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") "
Sep 11 00:01:11.441525 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") pod \"3c67352e-5bb1-463d-88bf-310b8a880e74\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") "
Sep 11 00:01:11.441525 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441458    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca\") pod \"3c67352e-5bb1-463d-88bf-310b8a880e74\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") "
Sep 11 00:01:11.441658 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441598    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs\") pod \"3c67352e-5bb1-463d-88bf-310b8a880e74\" (UID: \"3c67352e-5bb1-463d-88bf-310b8a880e74\") "
Sep 11 00:01:11.441819 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441793    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c67352e-5bb1-463d-88bf-310b8a880e74" (UID: "3c67352e-5bb1-463d-88bf-310b8a880e74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:11.441982 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.441963    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c67352e-5bb1-463d-88bf-310b8a880e74-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:11.444003 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.443959    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9" (OuterVolumeSpecName: "kube-api-access-z2ch9") pod "3c67352e-5bb1-463d-88bf-310b8a880e74" (UID: "3c67352e-5bb1-463d-88bf-310b8a880e74"). InnerVolumeSpecName "kube-api-access-z2ch9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:11.444304 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.444250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c67352e-5bb1-463d-88bf-310b8a880e74" (UID: "3c67352e-5bb1-463d-88bf-310b8a880e74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:11.444451 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.444263    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c67352e-5bb1-463d-88bf-310b8a880e74" (UID: "3c67352e-5bb1-463d-88bf-310b8a880e74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:11.543644 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.543537    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2ch9\" (UniqueName: \"kubernetes.io/projected/3c67352e-5bb1-463d-88bf-310b8a880e74-kube-api-access-z2ch9\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:11.543644 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.543576    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:11.543644 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.543589    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c67352e-5bb1-463d-88bf-310b8a880e74-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:11.655229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.655187    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c67352e-5bb1-463d-88bf-310b8a880e74" containerID="211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25" exitCode=0
Sep 11 00:01:11.655502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.655241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"
Sep 11 00:01:11.655502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.655326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" event={"ID":"3c67352e-5bb1-463d-88bf-310b8a880e74","Type":"ContainerDied","Data":"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"}
Sep 11 00:01:11.655502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.655405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46" event={"ID":"3c67352e-5bb1-463d-88bf-310b8a880e74","Type":"ContainerDied","Data":"fb2164614fd4a7001a3b7a66bee43bf4d7278d6799be22d3ef5944b6f285ab9b"}
Sep 11 00:01:11.655502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.655432    2581 scope.go:117] "RemoveContainer" containerID="211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"
Sep 11 00:01:11.668121 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.668095    2581 scope.go:117] "RemoveContainer" containerID="211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"
Sep 11 00:01:11.668543 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:11.668518    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25\": container with ID starting with 211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25 not found: ID does not exist" containerID="211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"
Sep 11 00:01:11.668611 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.668556    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25"} err="failed to get container status \"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25\": rpc error: code = NotFound desc = could not find container \"211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25\": container with ID starting with 211d5ab6156cbf9862cb11a0d0476e7835d967637cfc722ff9944c8fd4bcde25 not found: ID does not exist"
Sep 11 00:01:11.678381 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.678329    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:01:11.683693 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:11.683647    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-02bac9-69b8bb7bbd-9dv46"]
Sep 11 00:01:13.450926 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:13.450870    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c67352e-5bb1-463d-88bf-310b8a880e74" path="/var/lib/kubelet/pods/3c67352e-5bb1-463d-88bf-310b8a880e74/volumes"
Sep 11 00:01:18.054398 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.054356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7747-c6b5f1"]
Sep 11 00:01:18.055363 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055322    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c67352e-5bb1-463d-88bf-310b8a880e74" containerName="maas-api"
Sep 11 00:01:18.055363 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055365    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c67352e-5bb1-463d-88bf-310b8a880e74" containerName="maas-api"
Sep 11 00:01:18.055562 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055379    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5721131-e80a-4ae4-9866-72400c74d7c8" containerName="maas-api"
Sep 11 00:01:18.055562 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055387    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5721131-e80a-4ae4-9866-72400c74d7c8" containerName="maas-api"
Sep 11 00:01:18.055562 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055541    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c67352e-5bb1-463d-88bf-310b8a880e74" containerName="maas-api"
Sep 11 00:01:18.055562 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.055557    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5721131-e80a-4ae4-9866-72400c74d7c8" containerName="maas-api"
Sep 11 00:01:18.060597 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.060558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:18.062583 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.062546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-c6b5f1"]
Sep 11 00:01:18.063068 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.063042    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wtk84\""
Sep 11 00:01:18.221128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.221079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28748\" (UniqueName: \"kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748\") pod \"test-curl-7747-c6b5f1\" (UID: \"a1cdbece-b4bb-471b-8a9a-f2e9c694eede\") " pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:18.322232 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.322117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28748\" (UniqueName: \"kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748\") pod \"test-curl-7747-c6b5f1\" (UID: \"a1cdbece-b4bb-471b-8a9a-f2e9c694eede\") " pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:18.330303 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.330247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28748\" (UniqueName: \"kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748\") pod \"test-curl-7747-c6b5f1\" (UID: \"a1cdbece-b4bb-471b-8a9a-f2e9c694eede\") " pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:18.374215 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.374157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:18.660139 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.660103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-c6b5f1"]
Sep 11 00:01:18.662547 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:01:18.662515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1cdbece_b4bb_471b_8a9a_f2e9c694eede.slice/crio-17c20f00689d7cd7e42937467a1aaaf0e4cf9bcb6865d0d12970f94c384ad348 WatchSource:0}: Error finding container 17c20f00689d7cd7e42937467a1aaaf0e4cf9bcb6865d0d12970f94c384ad348: Status 404 returned error can't find the container with id 17c20f00689d7cd7e42937467a1aaaf0e4cf9bcb6865d0d12970f94c384ad348
Sep 11 00:01:18.709783 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:18.709737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-c6b5f1" event={"ID":"a1cdbece-b4bb-471b-8a9a-f2e9c694eede","Type":"ContainerStarted","Data":"17c20f00689d7cd7e42937467a1aaaf0e4cf9bcb6865d0d12970f94c384ad348"}
Sep 11 00:01:19.720137 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:19.720099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-c6b5f1" event={"ID":"a1cdbece-b4bb-471b-8a9a-f2e9c694eede","Type":"ContainerStarted","Data":"9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0"}
Sep 11 00:01:19.736323 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:19.736245    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7747-c6b5f1" podStartSLOduration=1.736226194 podStartE2EDuration="1.736226194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:19.733474193 +0000 UTC m=+1496.833056296" watchObservedRunningTime="2026-09-11 00:01:19.736226194 +0000 UTC m=+1496.835808296"
Sep 11 00:01:20.370864 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.370822    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7747-c6b5f1"]
Sep 11 00:01:20.374473 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.374433    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7747-c6b5f1"]
Sep 11 00:01:20.497047 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.496990    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7747-d61511"]
Sep 11 00:01:20.497851 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.497819    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" containerName="test-curl-7747-c6b5f1"
Sep 11 00:01:20.497851 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.497856    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" containerName="test-curl-7747-c6b5f1"
Sep 11 00:01:20.498087 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.498013    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" containerName="test-curl-7747-c6b5f1"
Sep 11 00:01:20.502937 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.502118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:20.505107 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.505067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-d61511"]
Sep 11 00:01:20.547002 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.546950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pqk\" (UniqueName: \"kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk\") pod \"test-curl-7747-d61511\" (UID: \"a6b8576d-bdca-499f-89f4-8b60f448b77b\") " pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:20.648479 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.648432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pqk\" (UniqueName: \"kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk\") pod \"test-curl-7747-d61511\" (UID: \"a6b8576d-bdca-499f-89f4-8b60f448b77b\") " pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:20.656803 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.656748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pqk\" (UniqueName: \"kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk\") pod \"test-curl-7747-d61511\" (UID: \"a6b8576d-bdca-499f-89f4-8b60f448b77b\") " pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:20.727484 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:20.727434    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7747-c6b5f1" container="test-curl-7747-c6b5f1"
Sep 11 00:01:20.816548 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:20.816448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:21.099375 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:21.099325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7747-d61511"]
Sep 11 00:01:21.100755 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:01:21.100718    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6b8576d_bdca_499f_89f4_8b60f448b77b.slice/crio-11ea23456c6a2210a90f88ddfa5e72a2a2506924150c1a49a4ba4abefe8995a1 WatchSource:0}: Error finding container 11ea23456c6a2210a90f88ddfa5e72a2a2506924150c1a49a4ba4abefe8995a1: Status 404 returned error can't find the container with id 11ea23456c6a2210a90f88ddfa5e72a2a2506924150c1a49a4ba4abefe8995a1
Sep 11 00:01:21.736344 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:21.736305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-d61511" event={"ID":"a6b8576d-bdca-499f-89f4-8b60f448b77b","Type":"ContainerStarted","Data":"622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd"}
Sep 11 00:01:21.736792 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:21.736357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7747-d61511" event={"ID":"a6b8576d-bdca-499f-89f4-8b60f448b77b","Type":"ContainerStarted","Data":"11ea23456c6a2210a90f88ddfa5e72a2a2506924150c1a49a4ba4abefe8995a1"}
Sep 11 00:01:21.736792 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:21.736358    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7747-c6b5f1" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" containerName="test-curl-7747-c6b5f1" containerID="cri-o://9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0" gracePeriod=2
Sep 11 00:01:21.751107 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:21.751044    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7747-d61511" podStartSLOduration=1.75102848 podStartE2EDuration="1.75102848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:01:21.749531173 +0000 UTC m=+1498.849113277" watchObservedRunningTime="2026-09-11 00:01:21.75102848 +0000 UTC m=+1498.850610581"
Sep 11 00:01:22.381297 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:22.381244    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7747-d61511"]
Sep 11 00:01:22.384575 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:22.384531    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7747-d61511"]
Sep 11 00:01:22.744606 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:22.744553    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7747-d61511" container="test-curl-7747-d61511"
Sep 11 00:01:23.752372 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:23.752278    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7747-d61511" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" containerName="test-curl-7747-d61511" containerID="cri-o://622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd" gracePeriod=2
Sep 11 00:01:23.954483 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:23.954440    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:23.983818 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:23.983762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28748\" (UniqueName: \"kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748\") pod \"a1cdbece-b4bb-471b-8a9a-f2e9c694eede\" (UID: \"a1cdbece-b4bb-471b-8a9a-f2e9c694eede\") "
Sep 11 00:01:23.986223 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:23.986190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748" (OuterVolumeSpecName: "kube-api-access-28748") pod "a1cdbece-b4bb-471b-8a9a-f2e9c694eede" (UID: "a1cdbece-b4bb-471b-8a9a-f2e9c694eede"). InnerVolumeSpecName "kube-api-access-28748". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:24.084982 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.084931    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28748\" (UniqueName: \"kubernetes.io/projected/a1cdbece-b4bb-471b-8a9a-f2e9c694eede-kube-api-access-28748\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:24.761952 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.761905    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" containerID="9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0" exitCode=137
Sep 11 00:01:24.761952 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.761955    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:24.762430 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.762007    2581 scope.go:117] "RemoveContainer" containerID="9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0"
Sep 11 00:01:24.773172 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:24.773131    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7747-c6b5f1\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" pod="opendatahub/test-curl-7747-c6b5f1"
Sep 11 00:01:24.773794 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.773772    2581 scope.go:117] "RemoveContainer" containerID="9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0"
Sep 11 00:01:24.774231 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:24.774203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0\": container with ID starting with 9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0 not found: ID does not exist" containerID="9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0"
Sep 11 00:01:24.774302 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:24.774243    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0"} err="failed to get container status \"9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0\": rpc error: code = NotFound desc = could not find container \"9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0\": container with ID starting with 9f8fc71214f916decca620d76985793b79f1300148fbae1f07f4a07448c6a9b0 not found: ID does not exist"
Sep 11 00:01:25.450936 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:25.450893    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1cdbece-b4bb-471b-8a9a-f2e9c694eede" path="/var/lib/kubelet/pods/a1cdbece-b4bb-471b-8a9a-f2e9c694eede/volumes"
Sep 11 00:01:25.927234 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:25.927196    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:26.005202 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.005153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5pqk\" (UniqueName: \"kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk\") pod \"a6b8576d-bdca-499f-89f4-8b60f448b77b\" (UID: \"a6b8576d-bdca-499f-89f4-8b60f448b77b\") "
Sep 11 00:01:26.007951 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.007868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk" (OuterVolumeSpecName: "kube-api-access-c5pqk") pod "a6b8576d-bdca-499f-89f4-8b60f448b77b" (UID: "a6b8576d-bdca-499f-89f4-8b60f448b77b"). InnerVolumeSpecName "kube-api-access-c5pqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:26.106454 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.106395    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5pqk\" (UniqueName: \"kubernetes.io/projected/a6b8576d-bdca-499f-89f4-8b60f448b77b-kube-api-access-c5pqk\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:26.781107 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.781066    2581 generic.go:356] "Generic (PLEG): container finished" podID="a6b8576d-bdca-499f-89f4-8b60f448b77b" containerID="622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd" exitCode=137
Sep 11 00:01:26.781353 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.781119    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:26.781353 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.781140    2581 scope.go:117] "RemoveContainer" containerID="622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd"
Sep 11 00:01:26.791940 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:26.791893    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7747-d61511\" is forbidden: User \"system:node:ip-10-0-129-151.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-151.ec2.internal' and this object" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" pod="opendatahub/test-curl-7747-d61511"
Sep 11 00:01:26.793806 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.793782    2581 scope.go:117] "RemoveContainer" containerID="622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd"
Sep 11 00:01:26.794229 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:26.794198    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd\": container with ID starting with 622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd not found: ID does not exist" containerID="622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd"
Sep 11 00:01:26.794311 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:26.794240    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd"} err="failed to get container status \"622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd\": rpc error: code = NotFound desc = could not find container \"622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd\": container with ID starting with 622b12e9350358db13015cd7b450551a4fa947676fb2b8b5d9c2fdd12e700ccd not found: ID does not exist"
Sep 11 00:01:27.451117 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:27.451068    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" path="/var/lib/kubelet/pods/a6b8576d-bdca-499f-89f4-8b60f448b77b/volumes"
Sep 11 00:01:28.367422 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.367281    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 11 00:01:28.367696 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.367661    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" podUID="91e22c02-bd93-48db-aa42-30e0c997b3f8" containerName="maas-api" containerID="cri-o://86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2" gracePeriod=30
Sep 11 00:01:28.687185 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.687144    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 11 00:01:28.735542 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.735500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca\") pod \"91e22c02-bd93-48db-aa42-30e0c997b3f8\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") "
Sep 11 00:01:28.735542 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.735544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs\") pod \"91e22c02-bd93-48db-aa42-30e0c997b3f8\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") "
Sep 11 00:01:28.735542 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.735561    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls\") pod \"91e22c02-bd93-48db-aa42-30e0c997b3f8\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") "
Sep 11 00:01:28.735908 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.735611    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kfcd\" (UniqueName: \"kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd\") pod \"91e22c02-bd93-48db-aa42-30e0c997b3f8\" (UID: \"91e22c02-bd93-48db-aa42-30e0c997b3f8\") "
Sep 11 00:01:28.736035 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.736006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91e22c02-bd93-48db-aa42-30e0c997b3f8" (UID: "91e22c02-bd93-48db-aa42-30e0c997b3f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:28.738198 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.738118    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91e22c02-bd93-48db-aa42-30e0c997b3f8" (UID: "91e22c02-bd93-48db-aa42-30e0c997b3f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:28.738198 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.738137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91e22c02-bd93-48db-aa42-30e0c997b3f8" (UID: "91e22c02-bd93-48db-aa42-30e0c997b3f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:28.738198 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.738159    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd" (OuterVolumeSpecName: "kube-api-access-4kfcd") pod "91e22c02-bd93-48db-aa42-30e0c997b3f8" (UID: "91e22c02-bd93-48db-aa42-30e0c997b3f8"). InnerVolumeSpecName "kube-api-access-4kfcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:28.797802 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.797759    2581 generic.go:356] "Generic (PLEG): container finished" podID="91e22c02-bd93-48db-aa42-30e0c997b3f8" containerID="86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2" exitCode=0
Sep 11 00:01:28.798013 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.797810    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"
Sep 11 00:01:28.798013 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.797838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" event={"ID":"91e22c02-bd93-48db-aa42-30e0c997b3f8","Type":"ContainerDied","Data":"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"}
Sep 11 00:01:28.798013 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.797897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6" event={"ID":"91e22c02-bd93-48db-aa42-30e0c997b3f8","Type":"ContainerDied","Data":"e8e5ab49c06a9a0af0b596d411a5caf97fcee95a6945326fea1404e9990c2185"}
Sep 11 00:01:28.798013 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.797924    2581 scope.go:117] "RemoveContainer" containerID="86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"
Sep 11 00:01:28.812533 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.812509    2581 scope.go:117] "RemoveContainer" containerID="86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"
Sep 11 00:01:28.812924 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:28.812902    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2\": container with ID starting with 86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2 not found: ID does not exist" containerID="86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"
Sep 11 00:01:28.813031 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.812934    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2"} err="failed to get container status \"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2\": rpc error: code = NotFound desc = could not find container \"86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2\": container with ID starting with 86dc66f8b2f74af6c6c3f090dcec952b46776922e07b2335333793af15be71d2 not found: ID does not exist"
Sep 11 00:01:28.822888 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.822845    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 11 00:01:28.825768 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.825729    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-396319-c48c7b746-lgkb6"]
Sep 11 00:01:28.837595 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.837547    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kfcd\" (UniqueName: \"kubernetes.io/projected/91e22c02-bd93-48db-aa42-30e0c997b3f8-kube-api-access-4kfcd\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:28.837595 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.837586    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91e22c02-bd93-48db-aa42-30e0c997b3f8-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:28.837595 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.837598    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:28.837595 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:28.837607    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91e22c02-bd93-48db-aa42-30e0c997b3f8-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:29.450648 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:29.450600    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e22c02-bd93-48db-aa42-30e0c997b3f8" path="/var/lib/kubelet/pods/91e22c02-bd93-48db-aa42-30e0c997b3f8/volumes"
Sep 11 00:01:45.993137 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:45.993039    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 11 00:01:45.994091 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:45.994027    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" podUID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" containerName="maas-api" containerID="cri-o://b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d" gracePeriod=30
Sep 11 00:01:46.271742 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.271704    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 11 00:01:46.427578 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.427494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca\") pod \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") "
Sep 11 00:01:46.427874 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.427627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9pn\" (UniqueName: \"kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn\") pod \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") "
Sep 11 00:01:46.427874 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.427856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls\") pod \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") "
Sep 11 00:01:46.428020 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.427939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs\") pod \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\" (UID: \"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c\") "
Sep 11 00:01:46.428169 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.428127    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" (UID: "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:46.428558 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.428530    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:46.431072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.431019    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn" (OuterVolumeSpecName: "kube-api-access-kq9pn") pod "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" (UID: "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c"). InnerVolumeSpecName "kube-api-access-kq9pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:46.431400 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.431094    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" (UID: "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:46.431550 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.431457    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" (UID: "06f29d2b-b4d7-4fef-8fb8-490b73e70f1c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:01:46.530429 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.530313    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:46.530429 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.530354    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:46.530429 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.530367    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9pn\" (UniqueName: \"kubernetes.io/projected/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c-kube-api-access-kq9pn\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:46.930373 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.930318    2581 generic.go:356] "Generic (PLEG): container finished" podID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" containerID="b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d" exitCode=0
Sep 11 00:01:46.930582 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.930395    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"
Sep 11 00:01:46.930582 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.930402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" event={"ID":"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c","Type":"ContainerDied","Data":"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"}
Sep 11 00:01:46.930582 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.930482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8" event={"ID":"06f29d2b-b4d7-4fef-8fb8-490b73e70f1c","Type":"ContainerDied","Data":"e99ec7a2bcf8f7fa2393cfb09b74c5e9b06c5f7450b806c2f5681f6bbfbea7b7"}
Sep 11 00:01:46.930582 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.930522    2581 scope.go:117] "RemoveContainer" containerID="b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"
Sep 11 00:01:46.942761 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.942735    2581 scope.go:117] "RemoveContainer" containerID="b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"
Sep 11 00:01:46.943184 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:46.943161    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d\": container with ID starting with b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d not found: ID does not exist" containerID="b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"
Sep 11 00:01:46.943250 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.943196    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d"} err="failed to get container status \"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d\": rpc error: code = NotFound desc = could not find container \"b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d\": container with ID starting with b683f4892e59343696b9edfc6e53a88764c5f8cb34b3e68e0e8be9723313db1d not found: ID does not exist"
Sep 11 00:01:46.963769 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.963726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 11 00:01:46.967927 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:46.967889    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-16e45a-7f5c874c54-56nw8"]
Sep 11 00:01:47.451459 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:47.451410    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" path="/var/lib/kubelet/pods/06f29d2b-b4d7-4fef-8fb8-490b73e70f1c/volumes"
Sep 11 00:01:52.541270 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:52.541218    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 11 00:01:52.541827 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:52.541545    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy" containerID="cri-o://20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b" gracePeriod=30
Sep 11 00:01:57.823030 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.822935    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 11 00:01:57.853953 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.853906    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.853953 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.853957    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mks4r\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854108    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854144    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854229 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854213    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854597 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo\") pod \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\" (UID: \"c931ce3a-a20b-4d22-a9d8-4e0396a1b230\") "
Sep 11 00:01:57.854597 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data" (OuterVolumeSpecName: "istio-data") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:57.854597 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854553    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:57.854762 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854709    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-data\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.854762 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854733    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.854868 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854806    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:57.855004 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.854976    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:57.855203 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.855179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:01:57.857174 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.857130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token" (OuterVolumeSpecName: "istio-token") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:57.857398 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.857338    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:01:57.857994 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.857950    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 00:01:57.858491 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.858463    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r" (OuterVolumeSpecName: "kube-api-access-mks4r") pod "c931ce3a-a20b-4d22-a9d8-4e0396a1b230" (UID: "c931ce3a-a20b-4d22-a9d8-4e0396a1b230"). InnerVolumeSpecName "kube-api-access-mks4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956011    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mks4r\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-kube-api-access-mks4r\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956051    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-credential-socket\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956060    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istiod-ca-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956071    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-workload-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956079    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-podinfo\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956072 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956087    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-envoy\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:57.956491 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:57.956095    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c931ce3a-a20b-4d22-a9d8-4e0396a1b230-istio-token\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:01:58.011164 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.011124    2581 generic.go:356] "Generic (PLEG): container finished" podID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerID="20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b" exitCode=0
Sep 11 00:01:58.011402 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.011182    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"
Sep 11 00:01:58.011402 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.011206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerDied","Data":"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"}
Sep 11 00:01:58.011402 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.011267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch" event={"ID":"c931ce3a-a20b-4d22-a9d8-4e0396a1b230","Type":"ContainerDied","Data":"673542dde5424b11ef488fdb82324991b6bda357653fdfe01476dc3ddaab35c5"}
Sep 11 00:01:58.011402 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.011331    2581 scope.go:117] "RemoveContainer" containerID="20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"
Sep 11 00:01:58.024478 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.024453    2581 scope.go:117] "RemoveContainer" containerID="db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"
Sep 11 00:01:58.037208 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.037161    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 11 00:01:58.037775 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.037754    2581 scope.go:117] "RemoveContainer" containerID="20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"
Sep 11 00:01:58.038139 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:58.038118    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b\": container with ID starting with 20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b not found: ID does not exist" containerID="20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"
Sep 11 00:01:58.038220 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.038150    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b"} err="failed to get container status \"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b\": rpc error: code = NotFound desc = could not find container \"20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b\": container with ID starting with 20e00a3179b66a455953e6f399d2f75159d0a4ede351cbda698bdb236164a93b not found: ID does not exist"
Sep 11 00:01:58.038220 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.038168    2581 scope.go:117] "RemoveContainer" containerID="db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"
Sep 11 00:01:58.038543 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:01:58.038522    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70\": container with ID starting with db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70 not found: ID does not exist" containerID="db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"
Sep 11 00:01:58.038588 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.038546    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70"} err="failed to get container status \"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70\": rpc error: code = NotFound desc = could not find container \"db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70\": container with ID starting with db2953ebf07b45787e2ad2826e43a23788e70cce298dd74418f78385a62e9e70 not found: ID does not exist"
Sep 11 00:01:58.045403 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:58.045361    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-16e45a-openshift-default-86b7c8d584-psfch"]
Sep 11 00:01:59.450750 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:01:59.450695    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" path="/var/lib/kubelet/pods/c931ce3a-a20b-4d22-a9d8-4e0396a1b230/volumes"
Sep 11 00:03:20.857878 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.857759    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:03:20.858455 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858432    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e22c02-bd93-48db-aa42-30e0c997b3f8" containerName="maas-api"
Sep 11 00:03:20.858519 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858459    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e22c02-bd93-48db-aa42-30e0c997b3f8" containerName="maas-api"
Sep 11 00:03:20.858519 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858475    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" containerName="maas-api"
Sep 11 00:03:20.858519 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858483    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" containerName="maas-api"
Sep 11 00:03:20.858519 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858516    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858526    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858544    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858552    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858561    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" containerName="test-curl-7747-d61511"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" containerName="test-curl-7747-d61511"
Sep 11 00:03:20.858676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858673    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f29d2b-b4d7-4fef-8fb8-490b73e70f1c" containerName="maas-api"
Sep 11 00:03:20.859011 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858685    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6b8576d-bdca-499f-89f4-8b60f448b77b" containerName="test-curl-7747-d61511"
Sep 11 00:03:20.859011 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858695    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:20.859011 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.858706    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e22c02-bd93-48db-aa42-30e0c997b3f8" containerName="maas-api"
Sep 11 00:03:20.862665 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.862633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:20.865146 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.865099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7c3755-serving-cert\""
Sep 11 00:03:20.876178 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:20.876134    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:03:21.015915 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.015872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.016174 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.015947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4sr6\" (UniqueName: \"kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.016174 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.015978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.016174 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.016050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.116883 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.116783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.116883 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.116872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.117112 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.116911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4sr6\" (UniqueName: \"kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.117112 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.116933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.117783 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.117758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.120597 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.120558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.121060 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.121035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.126423 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.126385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4sr6\" (UniqueName: \"kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6\") pod \"maas-api-e2e-ipp-a-7c3755-988dbff97-5l566\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.180507 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.180464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:21.471046 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.471010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:03:21.473638 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:03:21.473606    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a7072f_19d1_4783_b405_a40b7b0c152e.slice/crio-894cab8e469f2e6f247ae0c27b2341f5ccaa52015c5f4621210d2e3bede02db8 WatchSource:0}: Error finding container 894cab8e469f2e6f247ae0c27b2341f5ccaa52015c5f4621210d2e3bede02db8: Status 404 returned error can't find the container with id 894cab8e469f2e6f247ae0c27b2341f5ccaa52015c5f4621210d2e3bede02db8
Sep 11 00:03:21.609348 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:21.609222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" event={"ID":"86a7072f-19d1-4783-b405-a40b7b0c152e","Type":"ContainerStarted","Data":"894cab8e469f2e6f247ae0c27b2341f5ccaa52015c5f4621210d2e3bede02db8"}
Sep 11 00:03:22.618240 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:22.618129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" event={"ID":"86a7072f-19d1-4783-b405-a40b7b0c152e","Type":"ContainerStarted","Data":"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"}
Sep 11 00:03:22.618240 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:22.618207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:22.637088 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:22.637010    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" podStartSLOduration=1.93400544 podStartE2EDuration="2.636987381s" totalImagesPullingTime="702.981941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:03:22.633587279 +0000 UTC m=+1619.733169382" watchObservedRunningTime="2026-09-11 00:03:22.636987381 +0000 UTC m=+1619.736569492"
Sep 11 00:03:28.631679 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:28.631646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:03:51.251199 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.251153    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:03:51.251804 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.251738    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c931ce3a-a20b-4d22-a9d8-4e0396a1b230" containerName="istio-proxy"
Sep 11 00:03:51.255676 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.255642    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.257796 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.257765    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-da6814-serving-cert\""
Sep 11 00:03:51.269019 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.268984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:03:51.332175 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.332131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.332424 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.332186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtr2\" (UniqueName: \"kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.332424 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.332249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.332424 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.332360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.433108 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.433065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtr2\" (UniqueName: \"kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.433375 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.433137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.433375 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.433163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.433375 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.433218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.433375 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:03:51.433344    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-serving-cert: secret "maas-api-e2e-ipp-b-da6814-serving-cert" not found
Sep 11 00:03:51.433611 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:03:51.433440    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls podName:72ad09a3-22e0-450b-ac53-7ed321daef20 nodeName:}" failed. No retries permitted until 2026-09-11 00:03:51.933416848 +0000 UTC m=+1649.032998933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls") pod "maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" (UID: "72ad09a3-22e0-450b-ac53-7ed321daef20") : secret "maas-api-e2e-ipp-b-da6814-serving-cert" not found
Sep 11 00:03:51.433993 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.433973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.435937 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.435918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.443513 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.443483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtr2\" (UniqueName: \"kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.939981 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.939926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:51.942973 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:51.942930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") pod \"maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:52.171015 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:52.170971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:52.457256 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:52.457223    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:03:52.460066 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:03:52.460033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ad09a3_22e0_450b_ac53_7ed321daef20.slice/crio-fcd80d651bd7060abdd3798eb5676da0eb9edc43a05277cd9075607d8053fb9c WatchSource:0}: Error finding container fcd80d651bd7060abdd3798eb5676da0eb9edc43a05277cd9075607d8053fb9c: Status 404 returned error can't find the container with id fcd80d651bd7060abdd3798eb5676da0eb9edc43a05277cd9075607d8053fb9c
Sep 11 00:03:52.824206 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:52.824155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" event={"ID":"72ad09a3-22e0-450b-ac53-7ed321daef20","Type":"ContainerStarted","Data":"fcd80d651bd7060abdd3798eb5676da0eb9edc43a05277cd9075607d8053fb9c"}
Sep 11 00:03:53.832655 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:53.832616    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" event={"ID":"72ad09a3-22e0-450b-ac53-7ed321daef20","Type":"ContainerStarted","Data":"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"}
Sep 11 00:03:53.833149 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:53.832704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:03:53.853043 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:53.852966    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" podStartSLOduration=2.390595695 podStartE2EDuration="2.852940294s" totalImagesPullingTime="462.344599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:03:53.849204401 +0000 UTC m=+1650.948786531" watchObservedRunningTime="2026-09-11 00:03:53.852940294 +0000 UTC m=+1650.952522397"
Sep 11 00:03:59.846201 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:03:59.846167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:04:18.443801 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:04:18.443743    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:04:59.297222 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:04:59.297117    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:05:06.960802 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:06.960755    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:06.964938 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:06.964908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:06.967230 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:06.967203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ef4657-serving-cert\""
Sep 11 00:05:06.980117 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:06.980080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:07.052214 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.052167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.052461 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.052261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.052461 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.052344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.052461 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.052382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tbfs\" (UniqueName: \"kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.153909 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.153860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.153909 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.153918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.154159 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.153939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.154159 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.153967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tbfs\" (UniqueName: \"kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.154885 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.154795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.157126 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.157084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.157323 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.157084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.165357 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.165323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tbfs\" (UniqueName: \"kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs\") pod \"maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.282502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.282405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:07.570970 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.570940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:07.572604 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:05:07.572569    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef35b6c_37eb_45cf_9695_eb65cefffb5a.slice/crio-b35d76a9cfbff818fabf657d41fba04caac7d7486ec54d0a9bc1b206ebbcaaf8 WatchSource:0}: Error finding container b35d76a9cfbff818fabf657d41fba04caac7d7486ec54d0a9bc1b206ebbcaaf8: Status 404 returned error can't find the container with id b35d76a9cfbff818fabf657d41fba04caac7d7486ec54d0a9bc1b206ebbcaaf8
Sep 11 00:05:07.574334 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:07.574260    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:05:08.346667 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:08.346614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" event={"ID":"5ef35b6c-37eb-45cf-9695-eb65cefffb5a","Type":"ContainerStarted","Data":"b35d76a9cfbff818fabf657d41fba04caac7d7486ec54d0a9bc1b206ebbcaaf8"}
Sep 11 00:05:09.355707 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:09.355667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" event={"ID":"5ef35b6c-37eb-45cf-9695-eb65cefffb5a","Type":"ContainerStarted","Data":"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"}
Sep 11 00:05:09.356140 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:09.355809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:09.373863 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:09.373787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" podStartSLOduration=2.530616614 podStartE2EDuration="3.373763309s" totalImagesPullingTime="843.146695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:05:09.371399617 +0000 UTC m=+1726.470981720" watchObservedRunningTime="2026-09-11 00:05:09.373763309 +0000 UTC m=+1726.473345410"
Sep 11 00:05:15.368701 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:15.368669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:45.184278 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.184233    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:45.185328 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.185264    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerName="maas-api" containerID="cri-o://45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94" gracePeriod=30
Sep 11 00:05:45.363876 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.363831    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.89:8443/health\": dial tcp 10.133.0.89:8443: connect: connection refused"
Sep 11 00:05:45.465331 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.465274    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:45.551963 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.551927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls\") pod \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") "
Sep 11 00:05:45.551963 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.551979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tbfs\" (UniqueName: \"kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs\") pod \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") "
Sep 11 00:05:45.552240 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.552002    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca\") pod \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") "
Sep 11 00:05:45.552240 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.552040    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs\") pod \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\" (UID: \"5ef35b6c-37eb-45cf-9695-eb65cefffb5a\") "
Sep 11 00:05:45.552580 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.552543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ef35b6c-37eb-45cf-9695-eb65cefffb5a" (UID: "5ef35b6c-37eb-45cf-9695-eb65cefffb5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:05:45.554867 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.554820    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ef35b6c-37eb-45cf-9695-eb65cefffb5a" (UID: "5ef35b6c-37eb-45cf-9695-eb65cefffb5a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:05:45.555032 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.554835    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs" (OuterVolumeSpecName: "kube-api-access-6tbfs") pod "5ef35b6c-37eb-45cf-9695-eb65cefffb5a" (UID: "5ef35b6c-37eb-45cf-9695-eb65cefffb5a"). InnerVolumeSpecName "kube-api-access-6tbfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:05:45.555032 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.554987    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ef35b6c-37eb-45cf-9695-eb65cefffb5a" (UID: "5ef35b6c-37eb-45cf-9695-eb65cefffb5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:05:45.611152 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.611112    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerID="45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94" exitCode=0
Sep 11 00:05:45.611382 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.611175    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"
Sep 11 00:05:45.611382 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.611198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" event={"ID":"5ef35b6c-37eb-45cf-9695-eb65cefffb5a","Type":"ContainerDied","Data":"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"}
Sep 11 00:05:45.611382 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.611266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs" event={"ID":"5ef35b6c-37eb-45cf-9695-eb65cefffb5a","Type":"ContainerDied","Data":"b35d76a9cfbff818fabf657d41fba04caac7d7486ec54d0a9bc1b206ebbcaaf8"}
Sep 11 00:05:45.611382 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.611316    2581 scope.go:117] "RemoveContainer" containerID="45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"
Sep 11 00:05:45.624143 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.624117    2581 scope.go:117] "RemoveContainer" containerID="45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"
Sep 11 00:05:45.624576 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:05:45.624546    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94\": container with ID starting with 45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94 not found: ID does not exist" containerID="45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"
Sep 11 00:05:45.624677 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.624587    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94"} err="failed to get container status \"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94\": rpc error: code = NotFound desc = could not find container \"45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94\": container with ID starting with 45d5c74c43d6d78ce70cc5336242e57f8cba6b57e2ab0d9ed7d7066a4b283f94 not found: ID does not exist"
Sep 11 00:05:45.634712 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.634669    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:45.638619 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.638578    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ef4657-84bd976c-6hqqs"]
Sep 11 00:05:45.653695 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.653658    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:05:45.653695 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.653692    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tbfs\" (UniqueName: \"kubernetes.io/projected/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-kube-api-access-6tbfs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:05:45.653852 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.653705    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:05:45.653852 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:45.653714    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ef35b6c-37eb-45cf-9695-eb65cefffb5a-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:05:47.451028 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:05:47.450974    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" path="/var/lib/kubelet/pods/5ef35b6c-37eb-45cf-9695-eb65cefffb5a/volumes"
Sep 11 00:06:11.324423 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.324371    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:06:11.327111 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.324649    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" podUID="86a7072f-19d1-4783-b405-a40b7b0c152e" containerName="maas-api" containerID="cri-o://0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753" gracePeriod=30
Sep 11 00:06:11.616248 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.616206    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:06:11.719698 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.719654    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls\") pod \"86a7072f-19d1-4783-b405-a40b7b0c152e\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") "
Sep 11 00:06:11.719698 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.719699    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs\") pod \"86a7072f-19d1-4783-b405-a40b7b0c152e\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") "
Sep 11 00:06:11.719992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.719736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4sr6\" (UniqueName: \"kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6\") pod \"86a7072f-19d1-4783-b405-a40b7b0c152e\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") "
Sep 11 00:06:11.719992 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.719790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca\") pod \"86a7072f-19d1-4783-b405-a40b7b0c152e\" (UID: \"86a7072f-19d1-4783-b405-a40b7b0c152e\") "
Sep 11 00:06:11.720210 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.720184    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86a7072f-19d1-4783-b405-a40b7b0c152e" (UID: "86a7072f-19d1-4783-b405-a40b7b0c152e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:06:11.722406 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.722364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6" (OuterVolumeSpecName: "kube-api-access-d4sr6") pod "86a7072f-19d1-4783-b405-a40b7b0c152e" (UID: "86a7072f-19d1-4783-b405-a40b7b0c152e"). InnerVolumeSpecName "kube-api-access-d4sr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:06:11.722406 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.722364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86a7072f-19d1-4783-b405-a40b7b0c152e" (UID: "86a7072f-19d1-4783-b405-a40b7b0c152e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:06:11.722614 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.722479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "86a7072f-19d1-4783-b405-a40b7b0c152e" (UID: "86a7072f-19d1-4783-b405-a40b7b0c152e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:06:11.799672 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.799627    2581 generic.go:356] "Generic (PLEG): container finished" podID="86a7072f-19d1-4783-b405-a40b7b0c152e" containerID="0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753" exitCode=0
Sep 11 00:06:11.799850 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.799681    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"
Sep 11 00:06:11.799850 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.799715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" event={"ID":"86a7072f-19d1-4783-b405-a40b7b0c152e","Type":"ContainerDied","Data":"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"}
Sep 11 00:06:11.799850 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.799789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566" event={"ID":"86a7072f-19d1-4783-b405-a40b7b0c152e","Type":"ContainerDied","Data":"894cab8e469f2e6f247ae0c27b2341f5ccaa52015c5f4621210d2e3bede02db8"}
Sep 11 00:06:11.799850 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.799807    2581 scope.go:117] "RemoveContainer" containerID="0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"
Sep 11 00:06:11.822070 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.822009    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7072f-19d1-4783-b405-a40b7b0c152e-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:06:11.822070 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.822063    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:06:11.822070 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.822077    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86a7072f-19d1-4783-b405-a40b7b0c152e-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:06:11.822426 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.822088    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4sr6\" (UniqueName: \"kubernetes.io/projected/86a7072f-19d1-4783-b405-a40b7b0c152e-kube-api-access-d4sr6\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:06:11.826919 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.826890    2581 scope.go:117] "RemoveContainer" containerID="0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"
Sep 11 00:06:11.827397 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:06:11.827367    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753\": container with ID starting with 0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753 not found: ID does not exist" containerID="0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"
Sep 11 00:06:11.827521 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.827403    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753"} err="failed to get container status \"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753\": rpc error: code = NotFound desc = could not find container \"0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753\": container with ID starting with 0cc6d5c638075733f8d7d2c71c129e9d8d26462e39596706fec6fa10342bc753 not found: ID does not exist"
Sep 11 00:06:11.831875 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.831832    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:06:11.835272 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:11.835224    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7c3755-988dbff97-5l566"]
Sep 11 00:06:13.449813 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:06:13.449770    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a7072f-19d1-4783-b405-a40b7b0c152e" path="/var/lib/kubelet/pods/86a7072f-19d1-4783-b405-a40b7b0c152e/volumes"
Sep 11 00:07:24.976606 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:24.976552    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:07:24.977324 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:24.976913    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" podUID="72ad09a3-22e0-450b-ac53-7ed321daef20" containerName="maas-api" containerID="cri-o://e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3" gracePeriod=30
Sep 11 00:07:25.265754 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.265707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:07:25.312895 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.312857    2581 generic.go:356] "Generic (PLEG): container finished" podID="72ad09a3-22e0-450b-ac53-7ed321daef20" containerID="e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3" exitCode=0
Sep 11 00:07:25.313121 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.312927    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"
Sep 11 00:07:25.313121 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.313020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" event={"ID":"72ad09a3-22e0-450b-ac53-7ed321daef20","Type":"ContainerDied","Data":"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"}
Sep 11 00:07:25.313121 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.313091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w" event={"ID":"72ad09a3-22e0-450b-ac53-7ed321daef20","Type":"ContainerDied","Data":"fcd80d651bd7060abdd3798eb5676da0eb9edc43a05277cd9075607d8053fb9c"}
Sep 11 00:07:25.313368 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.313126    2581 scope.go:117] "RemoveContainer" containerID="e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"
Sep 11 00:07:25.325989 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.325959    2581 scope.go:117] "RemoveContainer" containerID="e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"
Sep 11 00:07:25.326511 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:07:25.326485    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3\": container with ID starting with e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3 not found: ID does not exist" containerID="e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"
Sep 11 00:07:25.326638 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.326521    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3"} err="failed to get container status \"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3\": rpc error: code = NotFound desc = could not find container \"e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3\": container with ID starting with e9a67a622f65d0efdec2b89022b0442a3b77aaf32b619d008a486254474b8dd3 not found: ID does not exist"
Sep 11 00:07:25.384143 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.384091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrtr2\" (UniqueName: \"kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2\") pod \"72ad09a3-22e0-450b-ac53-7ed321daef20\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") "
Sep 11 00:07:25.384369 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.384233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs\") pod \"72ad09a3-22e0-450b-ac53-7ed321daef20\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") "
Sep 11 00:07:25.384369 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.384276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") pod \"72ad09a3-22e0-450b-ac53-7ed321daef20\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") "
Sep 11 00:07:25.384513 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.384417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca\") pod \"72ad09a3-22e0-450b-ac53-7ed321daef20\" (UID: \"72ad09a3-22e0-450b-ac53-7ed321daef20\") "
Sep 11 00:07:25.385277 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.385216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72ad09a3-22e0-450b-ac53-7ed321daef20" (UID: "72ad09a3-22e0-450b-ac53-7ed321daef20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:07:25.386949 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.386893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2" (OuterVolumeSpecName: "kube-api-access-wrtr2") pod "72ad09a3-22e0-450b-ac53-7ed321daef20" (UID: "72ad09a3-22e0-450b-ac53-7ed321daef20"). InnerVolumeSpecName "kube-api-access-wrtr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:25.387626 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.387583    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72ad09a3-22e0-450b-ac53-7ed321daef20" (UID: "72ad09a3-22e0-450b-ac53-7ed321daef20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:07:25.387626 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.387607    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "72ad09a3-22e0-450b-ac53-7ed321daef20" (UID: "72ad09a3-22e0-450b-ac53-7ed321daef20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:07:25.486068 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.485965    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.486068 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.486016    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72ad09a3-22e0-450b-ac53-7ed321daef20-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.486068 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.486033    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72ad09a3-22e0-450b-ac53-7ed321daef20-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.486068 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.486048    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrtr2\" (UniqueName: \"kubernetes.io/projected/72ad09a3-22e0-450b-ac53-7ed321daef20-kube-api-access-wrtr2\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:25.633000 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.632953    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:07:25.640281 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:25.640235    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-da6814-6b746b8dc4-fkl7w"]
Sep 11 00:07:27.450769 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:27.450720    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ad09a3-22e0-450b-ac53-7ed321daef20" path="/var/lib/kubelet/pods/72ad09a3-22e0-450b-ac53-7ed321daef20/volumes"
Sep 11 00:07:42.480434 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.479648    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 11 00:07:42.480434 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.479970    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerName="maas-api" containerID="cri-o://6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315" gracePeriod=30
Sep 11 00:07:42.759439 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.759398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 11 00:07:42.868385 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.868278    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls\") pod \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") "
Sep 11 00:07:42.868598 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.868419    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs\") pod \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") "
Sep 11 00:07:42.868598 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.868437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca\") pod \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") "
Sep 11 00:07:42.868598 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.868492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngsnr\" (UniqueName: \"kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr\") pod \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\" (UID: \"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba\") "
Sep 11 00:07:42.868873 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.868830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" (UID: "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:07:42.871002 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.870964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" (UID: "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:07:42.871002 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.870980    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr" (OuterVolumeSpecName: "kube-api-access-ngsnr") pod "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" (UID: "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba"). InnerVolumeSpecName "kube-api-access-ngsnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:07:42.871179 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.870988    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" (UID: "0d2751bf-4dd0-48fa-aeb4-a38669dca2ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:07:42.969934 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.969885    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:42.969934 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.969923    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:42.969934 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.969935    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:42.969934 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:42.969946    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngsnr\" (UniqueName: \"kubernetes.io/projected/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba-kube-api-access-ngsnr\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:07:43.440431 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.440387    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerID="6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315" exitCode=0
Sep 11 00:07:43.440622 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.440438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" event={"ID":"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba","Type":"ContainerDied","Data":"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"}
Sep 11 00:07:43.440622 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.440514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" event={"ID":"0d2751bf-4dd0-48fa-aeb4-a38669dca2ba","Type":"ContainerDied","Data":"63d06e099f4972cedeeb21db3aa2ca0bac3f2f6db5d7323d31f0f15c811b32c7"}
Sep 11 00:07:43.440622 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.440451    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"
Sep 11 00:07:43.440622 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.440540    2581 scope.go:117] "RemoveContainer" containerID="6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"
Sep 11 00:07:43.458659 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.458634    2581 scope.go:117] "RemoveContainer" containerID="6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"
Sep 11 00:07:43.459268 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:07:43.459237    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315\": container with ID starting with 6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315 not found: ID does not exist" containerID="6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"
Sep 11 00:07:43.459449 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.459279    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315"} err="failed to get container status \"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315\": rpc error: code = NotFound desc = could not find container \"6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315\": container with ID starting with 6f5422b35a91f618b7800ad87ffe00ea7e28158d3b8fb459cd7a1ef7d73e7315 not found: ID does not exist"
Sep 11 00:07:43.470557 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.470513    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 11 00:07:43.474014 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:43.473975    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh"]
Sep 11 00:07:45.451603 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:45.451503    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" path="/var/lib/kubelet/pods/0d2751bf-4dd0-48fa-aeb4-a38669dca2ba/volumes"
Sep 11 00:07:45.717444 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:07:45.717333    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-6fa41e-bdf8c46f5-z46dh" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.80:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 11 00:08:09.573350 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.573276    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 11 00:08:09.573879 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.573631    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" podUID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" containerName="manager" containerID="cri-o://90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4" gracePeriod=30
Sep 11 00:08:09.846658 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.846617    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 11 00:08:09.953952 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.953910    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") pod \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") "
Sep 11 00:08:09.954155 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.954020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert\") pod \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") "
Sep 11 00:08:09.954155 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.954048    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbd7x\" (UniqueName: \"kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x\") pod \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\" (UID: \"ebdecb0a-08a3-48f8-92d4-9461f14800dc\") "
Sep 11 00:08:09.956543 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.956496    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebdecb0a-08a3-48f8-92d4-9461f14800dc" (UID: "ebdecb0a-08a3-48f8-92d4-9461f14800dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:08:09.956543 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.956540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x" (OuterVolumeSpecName: "kube-api-access-dbd7x") pod "ebdecb0a-08a3-48f8-92d4-9461f14800dc" (UID: "ebdecb0a-08a3-48f8-92d4-9461f14800dc"). InnerVolumeSpecName "kube-api-access-dbd7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:08:09.956748 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:09.956515    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ebdecb0a-08a3-48f8-92d4-9461f14800dc" (UID: "ebdecb0a-08a3-48f8-92d4-9461f14800dc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:08:10.055455 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.055413    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:08:10.055455 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.055445    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdecb0a-08a3-48f8-92d4-9461f14800dc-webhook-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:08:10.055455 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.055460    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbd7x\" (UniqueName: \"kubernetes.io/projected/ebdecb0a-08a3-48f8-92d4-9461f14800dc-kube-api-access-dbd7x\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:08:10.627506 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.627466    2581 generic.go:356] "Generic (PLEG): container finished" podID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" containerID="90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4" exitCode=0
Sep 11 00:08:10.627974 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.627520    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm"
Sep 11 00:08:10.627974 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.627554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" event={"ID":"ebdecb0a-08a3-48f8-92d4-9461f14800dc","Type":"ContainerDied","Data":"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"}
Sep 11 00:08:10.627974 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.627619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-nwfnm" event={"ID":"ebdecb0a-08a3-48f8-92d4-9461f14800dc","Type":"ContainerDied","Data":"cd40456435cb035f89b86b606ce36a2d51ca29765c8afb56c3fc02177e6ceb99"}
Sep 11 00:08:10.627974 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.627652    2581 scope.go:117] "RemoveContainer" containerID="90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"
Sep 11 00:08:10.640789 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.640764    2581 scope.go:117] "RemoveContainer" containerID="90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"
Sep 11 00:08:10.641198 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:08:10.641173    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4\": container with ID starting with 90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4 not found: ID does not exist" containerID="90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"
Sep 11 00:08:10.641312 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.641208    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4"} err="failed to get container status \"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4\": rpc error: code = NotFound desc = could not find container \"90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4\": container with ID starting with 90d3fc6554718c721df55ba1f0675ddbe3be01334141d411c242ef49450b6aa4 not found: ID does not exist"
Sep 11 00:08:10.651669 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.651623    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 11 00:08:10.656532 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:10.656476    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-nwfnm"]
Sep 11 00:08:11.450610 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:08:11.450559    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" path="/var/lib/kubelet/pods/ebdecb0a-08a3-48f8-92d4-9461f14800dc/volumes"
Sep 11 00:09:11.454587 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.454551    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455035    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a7072f-19d1-4783-b405-a40b7b0c152e" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455050    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a7072f-19d1-4783-b405-a40b7b0c152e" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455068    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455075    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" containerName="manager"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" containerName="manager"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455113    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ad09a3-22e0-450b-ac53-7ed321daef20" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ad09a3-22e0-450b-ac53-7ed321daef20" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455124    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerName="maas-api"
Sep 11 00:09:11.455128 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455130    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerName="maas-api"
Sep 11 00:09:11.455501 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455189    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ad09a3-22e0-450b-ac53-7ed321daef20" containerName="maas-api"
Sep 11 00:09:11.455501 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455198    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef35b6c-37eb-45cf-9695-eb65cefffb5a" containerName="maas-api"
Sep 11 00:09:11.455501 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455204    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2751bf-4dd0-48fa-aeb4-a38669dca2ba" containerName="maas-api"
Sep 11 00:09:11.455501 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455210    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebdecb0a-08a3-48f8-92d4-9461f14800dc" containerName="manager"
Sep 11 00:09:11.455501 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.455216    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a7072f-19d1-4783-b405-a40b7b0c152e" containerName="maas-api"
Sep 11 00:09:11.458573 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.458545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.461750 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.461713    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 00:09:11.461953 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.461762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5htr\""
Sep 11 00:09:11.461953 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.461719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 00:09:11.461953 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.461714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 00:09:11.470386 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.470344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:11.567615 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.567558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.567828 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.567737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.567887 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.567864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhvp8\" (UniqueName: \"kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.668557 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.668508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.668747 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.668620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.668747 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.668686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhvp8\" (UniqueName: \"kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.671839 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.671807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.671997 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.671838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.678255 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.678208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhvp8\" (UniqueName: \"kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8\") pod \"maas-controller-6bb769cbf8-fc4mx\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") " pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:11.774363 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:11.774253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:12.055817 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:12.055777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:12.058501 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:09:12.058464    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9f9f99_ad4f_4d99_9433_9f65f78579aa.slice/crio-234bb7cbf2514f96a8f61e39aab8cb0ea6872c0fac339f0511a0e0ed87f32123 WatchSource:0}: Error finding container 234bb7cbf2514f96a8f61e39aab8cb0ea6872c0fac339f0511a0e0ed87f32123: Status 404 returned error can't find the container with id 234bb7cbf2514f96a8f61e39aab8cb0ea6872c0fac339f0511a0e0ed87f32123
Sep 11 00:09:13.049083 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:13.049046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" event={"ID":"3b9f9f99-ad4f-4d99-9433-9f65f78579aa","Type":"ContainerStarted","Data":"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"}
Sep 11 00:09:13.049649 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:13.049107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" event={"ID":"3b9f9f99-ad4f-4d99-9433-9f65f78579aa","Type":"ContainerStarted","Data":"234bb7cbf2514f96a8f61e39aab8cb0ea6872c0fac339f0511a0e0ed87f32123"}
Sep 11 00:09:13.049649 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:13.049149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:13.067355 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:13.067252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" podStartSLOduration=1.5092216550000002 podStartE2EDuration="2.067228712s" totalImagesPullingTime="558.007057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:09:13.064896096 +0000 UTC m=+1970.164478189" watchObservedRunningTime="2026-09-11 00:09:13.067228712 +0000 UTC m=+1970.166810849"
Sep 11 00:09:24.059256 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:24.059176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:33.366040 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.365986    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:33.366524 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.366266    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" podUID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" containerName="manager" containerID="cri-o://3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1" gracePeriod=30
Sep 11 00:09:33.645967 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.645929    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:33.807505 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.807455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert\") pod \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") "
Sep 11 00:09:33.807705 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.807535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs\") pod \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") "
Sep 11 00:09:33.807705 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.807645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhvp8\" (UniqueName: \"kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8\") pod \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\" (UID: \"3b9f9f99-ad4f-4d99-9433-9f65f78579aa\") "
Sep 11 00:09:33.810196 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.810149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3b9f9f99-ad4f-4d99-9433-9f65f78579aa" (UID: "3b9f9f99-ad4f-4d99-9433-9f65f78579aa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:09:33.810196 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.810194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b9f9f99-ad4f-4d99-9433-9f65f78579aa" (UID: "3b9f9f99-ad4f-4d99-9433-9f65f78579aa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:09:33.810439 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.810155    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8" (OuterVolumeSpecName: "kube-api-access-jhvp8") pod "3b9f9f99-ad4f-4d99-9433-9f65f78579aa" (UID: "3b9f9f99-ad4f-4d99-9433-9f65f78579aa"). InnerVolumeSpecName "kube-api-access-jhvp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:09:33.909594 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.909481    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhvp8\" (UniqueName: \"kubernetes.io/projected/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-kube-api-access-jhvp8\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:09:33.909594 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.909517    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-webhook-cert\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:09:33.909594 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:33.909527    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b9f9f99-ad4f-4d99-9433-9f65f78579aa-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:09:34.195593 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.195543    2581 generic.go:356] "Generic (PLEG): container finished" podID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" containerID="3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1" exitCode=0
Sep 11 00:09:34.195820 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.195610    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx"
Sep 11 00:09:34.195820 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.195634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" event={"ID":"3b9f9f99-ad4f-4d99-9433-9f65f78579aa","Type":"ContainerDied","Data":"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"}
Sep 11 00:09:34.195820 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.195713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-fc4mx" event={"ID":"3b9f9f99-ad4f-4d99-9433-9f65f78579aa","Type":"ContainerDied","Data":"234bb7cbf2514f96a8f61e39aab8cb0ea6872c0fac339f0511a0e0ed87f32123"}
Sep 11 00:09:34.195820 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.195748    2581 scope.go:117] "RemoveContainer" containerID="3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"
Sep 11 00:09:34.213790 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.213759    2581 scope.go:117] "RemoveContainer" containerID="3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"
Sep 11 00:09:34.214893 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:09:34.214858    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1\": container with ID starting with 3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1 not found: ID does not exist" containerID="3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"
Sep 11 00:09:34.215057 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.214906    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1"} err="failed to get container status \"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1\": rpc error: code = NotFound desc = could not find container \"3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1\": container with ID starting with 3bc880ba728db4c293c51044fb274c3fc3008634385727ea57d5f1f7479889d1 not found: ID does not exist"
Sep 11 00:09:34.230413 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.230359    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:34.233209 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.233160    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-fc4mx"]
Sep 11 00:09:34.998587 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.998545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-k9bv6"]
Sep 11 00:09:34.999057 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.999042    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" containerName="manager"
Sep 11 00:09:34.999104 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.999060    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" containerName="manager"
Sep 11 00:09:34.999151 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:34.999141    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" containerName="manager"
Sep 11 00:09:35.003811 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.003784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.007459 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.007412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5htr\""
Sep 11 00:09:35.007661 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.007460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 00:09:35.007661 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.007422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 00:09:35.007661 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.007581    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 00:09:35.011755 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.011720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-k9bv6"]
Sep 11 00:09:35.121161 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.121116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-webhook-cert\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.121398 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.121191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wv9\" (UniqueName: \"kubernetes.io/projected/f5d5df89-a820-472c-b841-84a3c828739d-kube-api-access-v5wv9\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.121398 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.121246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-metrics-certs\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.222500 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.222454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-webhook-cert\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.222698 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.222527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wv9\" (UniqueName: \"kubernetes.io/projected/f5d5df89-a820-472c-b841-84a3c828739d-kube-api-access-v5wv9\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.222698 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.222580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-metrics-certs\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.225680 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.225641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-metrics-certs\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.225680 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.225673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5d5df89-a820-472c-b841-84a3c828739d-webhook-cert\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.231874 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.231830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wv9\" (UniqueName: \"kubernetes.io/projected/f5d5df89-a820-472c-b841-84a3c828739d-kube-api-access-v5wv9\") pod \"maas-controller-6bb769cbf8-k9bv6\" (UID: \"f5d5df89-a820-472c-b841-84a3c828739d\") " pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.318912 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.318813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:35.454478 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.452018    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9f9f99-ad4f-4d99-9433-9f65f78579aa" path="/var/lib/kubelet/pods/3b9f9f99-ad4f-4d99-9433-9f65f78579aa/volumes"
Sep 11 00:09:35.599933 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:35.599898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb769cbf8-k9bv6"]
Sep 11 00:09:35.602235 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:09:35.602202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d5df89_a820_472c_b841_84a3c828739d.slice/crio-58f5a203a3ead00c8ceca391c1ecd524568ca471caf2c89745aed4d9b7894f1a WatchSource:0}: Error finding container 58f5a203a3ead00c8ceca391c1ecd524568ca471caf2c89745aed4d9b7894f1a: Status 404 returned error can't find the container with id 58f5a203a3ead00c8ceca391c1ecd524568ca471caf2c89745aed4d9b7894f1a
Sep 11 00:09:36.213445 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:36.213407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6" event={"ID":"f5d5df89-a820-472c-b841-84a3c828739d","Type":"ContainerStarted","Data":"aebe231907787af1f241214109fb2c6ab8092f6d99ff609c769a3e397db6bd90"}
Sep 11 00:09:36.213872 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:36.213466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6" event={"ID":"f5d5df89-a820-472c-b841-84a3c828739d","Type":"ContainerStarted","Data":"58f5a203a3ead00c8ceca391c1ecd524568ca471caf2c89745aed4d9b7894f1a"}
Sep 11 00:09:36.213872 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:36.213552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:09:36.231110 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:36.231021    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6" podStartSLOduration=1.832330182 podStartE2EDuration="2.230993587s" totalImagesPullingTime="398.663405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:09:36.228541756 +0000 UTC m=+1993.328123859" watchObservedRunningTime="2026-09-11 00:09:36.230993587 +0000 UTC m=+1993.330575690"
Sep 11 00:09:47.222986 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:09:47.222942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb769cbf8-k9bv6"
Sep 11 00:13:55.679944 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.679684    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-778c967957-hx4fv"]
Sep 11 00:13:55.684540 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.684506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.693377 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.693329    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-778c967957-hx4fv"]
Sep 11 00:13:55.781741 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.781698    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-maas-api-tls\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.781939 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.781796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31aa8868-f540-47de-af7d-f7be1b460fd4-openshift-service-ca\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.781939 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.781835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thts9\" (UniqueName: \"kubernetes.io/projected/31aa8868-f540-47de-af7d-f7be1b460fd4-kube-api-access-thts9\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.782040 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.781940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-metrics-certs\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.883325 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.883232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-maas-api-tls\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.883570 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.883367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31aa8868-f540-47de-af7d-f7be1b460fd4-openshift-service-ca\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.883570 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.883404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thts9\" (UniqueName: \"kubernetes.io/projected/31aa8868-f540-47de-af7d-f7be1b460fd4-kube-api-access-thts9\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.883570 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.883462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-metrics-certs\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.884319 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.884262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31aa8868-f540-47de-af7d-f7be1b460fd4-openshift-service-ca\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.887572 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.887529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-metrics-certs\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.888173 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.888141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31aa8868-f540-47de-af7d-f7be1b460fd4-maas-api-tls\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:55.893376 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:55.893328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thts9\" (UniqueName: \"kubernetes.io/projected/31aa8868-f540-47de-af7d-f7be1b460fd4-kube-api-access-thts9\") pod \"maas-api-778c967957-hx4fv\" (UID: \"31aa8868-f540-47de-af7d-f7be1b460fd4\") " pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:56.001633 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.001515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:56.292547 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.292493    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-778c967957-hx4fv"]
Sep 11 00:13:56.296168 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:13:56.296126    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31aa8868_f540_47de_af7d_f7be1b460fd4.slice/crio-f439da252eceaa021fb4f14951845b90939a26e73453a521e18bbf526de81b15 WatchSource:0}: Error finding container f439da252eceaa021fb4f14951845b90939a26e73453a521e18bbf526de81b15: Status 404 returned error can't find the container with id f439da252eceaa021fb4f14951845b90939a26e73453a521e18bbf526de81b15
Sep 11 00:13:56.298243 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.298208    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:13:56.981800 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.981746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv" event={"ID":"31aa8868-f540-47de-af7d-f7be1b460fd4","Type":"ContainerStarted","Data":"319b1432ffc53ea56e489689800243c61517b518c4ded4d9b107dd3096b05330"}
Sep 11 00:13:56.982282 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.981830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:13:56.982282 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.981854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv" event={"ID":"31aa8868-f540-47de-af7d-f7be1b460fd4","Type":"ContainerStarted","Data":"f439da252eceaa021fb4f14951845b90939a26e73453a521e18bbf526de81b15"}
Sep 11 00:13:56.999125 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:13:56.998983    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv" podStartSLOduration=1.554351142 podStartE2EDuration="1.998960737s" totalImagesPullingTime="444.609595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:13:56.998197043 +0000 UTC m=+2254.097779139" watchObservedRunningTime="2026-09-11 00:13:56.998960737 +0000 UTC m=+2254.098542842"
Sep 11 00:14:02.994450 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:02.994418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-778c967957-hx4fv"
Sep 11 00:14:03.044089 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:03.043929    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 11 00:14:03.044337 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:03.044188    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" podUID="7716a269-783d-4ed7-a264-cb685254d56f" containerName="maas-api" containerID="cri-o://4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb" gracePeriod=30
Sep 11 00:14:04.309995 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.309955    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 11 00:14:04.364046 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.363939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") pod \"7716a269-783d-4ed7-a264-cb685254d56f\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") "
Sep 11 00:14:04.364046 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.363985    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqbs5\" (UniqueName: \"kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5\") pod \"7716a269-783d-4ed7-a264-cb685254d56f\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") "
Sep 11 00:14:04.364328 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.364067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") pod \"7716a269-783d-4ed7-a264-cb685254d56f\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") "
Sep 11 00:14:04.364328 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.364182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca\") pod \"7716a269-783d-4ed7-a264-cb685254d56f\" (UID: \"7716a269-783d-4ed7-a264-cb685254d56f\") "
Sep 11 00:14:04.364650 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.364619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7716a269-783d-4ed7-a264-cb685254d56f" (UID: "7716a269-783d-4ed7-a264-cb685254d56f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:14:04.366732 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.366687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7716a269-783d-4ed7-a264-cb685254d56f" (UID: "7716a269-783d-4ed7-a264-cb685254d56f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:14:04.367185 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.367168    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7716a269-783d-4ed7-a264-cb685254d56f" (UID: "7716a269-783d-4ed7-a264-cb685254d56f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:14:04.367262 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.367213    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5" (OuterVolumeSpecName: "kube-api-access-dqbs5") pod "7716a269-783d-4ed7-a264-cb685254d56f" (UID: "7716a269-783d-4ed7-a264-cb685254d56f"). InnerVolumeSpecName "kube-api-access-dqbs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:14:04.466095 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.466048    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7716a269-783d-4ed7-a264-cb685254d56f-openshift-service-ca\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:14:04.466095 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.466080    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-maas-api-tls\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:14:04.466095 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.466093    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqbs5\" (UniqueName: \"kubernetes.io/projected/7716a269-783d-4ed7-a264-cb685254d56f-kube-api-access-dqbs5\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:14:04.466095 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:04.466102    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7716a269-783d-4ed7-a264-cb685254d56f-metrics-certs\") on node \"ip-10-0-129-151.ec2.internal\" DevicePath \"\""
Sep 11 00:14:05.037624 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.037584    2581 generic.go:356] "Generic (PLEG): container finished" podID="7716a269-783d-4ed7-a264-cb685254d56f" containerID="4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb" exitCode=0
Sep 11 00:14:05.037864 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.037666    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x"
Sep 11 00:14:05.037864 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.037674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" event={"ID":"7716a269-783d-4ed7-a264-cb685254d56f","Type":"ContainerDied","Data":"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"}
Sep 11 00:14:05.037864 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.037767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-577f88484f-lw28x" event={"ID":"7716a269-783d-4ed7-a264-cb685254d56f","Type":"ContainerDied","Data":"18a6c17d2a276035a0ac33f50d3fbf8cd368098d912dd134905772fbb9a60d8f"}
Sep 11 00:14:05.037864 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.037794    2581 scope.go:117] "RemoveContainer" containerID="4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"
Sep 11 00:14:05.050103 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.050079    2581 scope.go:117] "RemoveContainer" containerID="4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"
Sep 11 00:14:05.050562 ip-10-0-129-151 kubenswrapper[2581]: E0911 00:14:05.050530    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb\": container with ID starting with 4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb not found: ID does not exist" containerID="4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"
Sep 11 00:14:05.050675 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.050575    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb"} err="failed to get container status \"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb\": rpc error: code = NotFound desc = could not find container \"4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb\": container with ID starting with 4f90648304efb3c19c91d216aeff4dd983d4f6b764b7ad237abd9b14748f8cfb not found: ID does not exist"
Sep 11 00:14:05.062237 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.062197    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 11 00:14:05.065119 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.065080    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-577f88484f-lw28x"]
Sep 11 00:14:05.449935 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:05.449895    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7716a269-783d-4ed7-a264-cb685254d56f" path="/var/lib/kubelet/pods/7716a269-783d-4ed7-a264-cb685254d56f/volumes"
Sep 11 00:14:17.313443 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:17.313405    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8bd7f9f9-62fgm_700c91da-1230-472a-b960-8fd89ff1a085/authorino/0.log"
Sep 11 00:14:22.508236 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:22.508194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sztjt_86283742-6da6-44c2-b75a-aeb2eca2b674/manager/0.log"
Sep 11 00:14:22.621393 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:22.621356    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rnwhb_18fa3461-bf05-42ea-b5ae-25e19f7df4b9/manager/0.log"
Sep 11 00:14:22.733998 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:22.733962    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb769cbf8-k9bv6_f5d5df89-a820-472c-b841-84a3c828739d/manager/0.log"
Sep 11 00:14:22.970410 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:22.970379    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-59cqn_5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1/manager/0.log"
Sep 11 00:14:23.341451 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:23.341369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bb6f54779-q4nfr_dd3e35f7-11d7-495d-8c75-90e084240173/copy-manifests/0.log"
Sep 11 00:14:23.350737 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:23.350711    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bb6f54779-q4nfr_dd3e35f7-11d7-495d-8c75-90e084240173/manager/0.log"
Sep 11 00:14:23.772872 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:23.772839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-778c967957-hx4fv_31aa8868-f540-47de-af7d-f7be1b460fd4/maas-api/0.log"
Sep 11 00:14:23.995849 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:23.995814    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kt9cv_7d1f0563-37b0-4526-ba94-d95a6506902a/postgres/0.log"
Sep 11 00:14:24.783167 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:24.783125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8bd7f9f9-62fgm_700c91da-1230-472a-b960-8fd89ff1a085/authorino/0.log"
Sep 11 00:14:24.893857 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:24.893826    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-847s8_062cb76c-7ad9-4ede-abc1-438e81232d94/manager/0.log"
Sep 11 00:14:25.002796 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:25.002757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-btp57_31bdf3b0-7ddd-400e-9e65-e9f139367f9a/manager/0.log"
Sep 11 00:14:25.104582 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:25.104497    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-d6mqc_1ed876f7-30be-4067-8449-f798ceb413c2/kuadrant-console-plugin/0.log"
Sep 11 00:14:25.469249 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:25.469207    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vd4qv_a0b798d9-8935-4756-9618-4a6cadbd871a/manager/0.log"
Sep 11 00:14:26.125220 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:26.125190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547c6fc866-zr62v_6e7b66c6-28d9-427a-8984-de88d7ac71e6/kube-auth-proxy/0.log"
Sep 11 00:14:26.249280 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:26.249242    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/1.log"
Sep 11 00:14:26.363560 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:26.363522    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jdjzn_506ec22b-7cfb-4109-bcb8-b6a2915d20e7/payload-pre-processing/0.log"
Sep 11 00:14:26.471361 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:26.471311    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:14:26.910328 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:26.910278    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4ntww_2089cc60-484d-4edb-b07a-0fa1f1b3bc76/main/0.log"
Sep 11 00:14:27.122647 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:27.122614    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-sqhh7_40070092-1bbb-44eb-bca4-941d74a4ef37/main/0.log"
Sep 11 00:14:35.219342 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:35.219272    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gdztg_03373111-12a7-456f-9f0a-a7fcaac828d7/global-pull-secret-syncer/0.log"
Sep 11 00:14:35.342683 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:35.342647    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7kx7t_c37c471b-53ac-4eff-88ad-1a1b6863b3aa/konnectivity-agent/0.log"
Sep 11 00:14:35.423012 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:35.422977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-151.ec2.internal_3203e1487e60b01c3cea04380828f485/haproxy/0.log"
Sep 11 00:14:40.034131 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:40.034092    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f8bd7f9f9-62fgm_700c91da-1230-472a-b960-8fd89ff1a085/authorino/0.log"
Sep 11 00:14:40.080485 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:40.080454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-847s8_062cb76c-7ad9-4ede-abc1-438e81232d94/manager/0.log"
Sep 11 00:14:40.104362 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:40.104323    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-btp57_31bdf3b0-7ddd-400e-9e65-e9f139367f9a/manager/0.log"
Sep 11 00:14:40.126565 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:40.126539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-d6mqc_1ed876f7-30be-4067-8449-f798ceb413c2/kuadrant-console-plugin/0.log"
Sep 11 00:14:40.279004 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:40.278965    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-vd4qv_a0b798d9-8935-4756-9618-4a6cadbd871a/manager/0.log"
Sep 11 00:14:41.702044 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.702018    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/alertmanager/0.log"
Sep 11 00:14:41.723029 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.723001    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/config-reloader/0.log"
Sep 11 00:14:41.747375 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.747336    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/kube-rbac-proxy-web/0.log"
Sep 11 00:14:41.767926 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.767902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/kube-rbac-proxy/0.log"
Sep 11 00:14:41.788391 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.788362    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/kube-rbac-proxy-metric/0.log"
Sep 11 00:14:41.811402 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.811375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/prom-label-proxy/0.log"
Sep 11 00:14:41.830858 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.830832    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7ae6deff-4514-425f-b5fb-d79ae120ad71/init-config-reloader/0.log"
Sep 11 00:14:41.876976 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:41.876940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-srx7w_57dd2cd8-e733-4dbe-9fe3-299ad5317bf9/cluster-monitoring-operator/0.log"
Sep 11 00:14:42.184166 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.184120    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss46t_ab60083e-4528-46c4-a0ed-595cc315c457/node-exporter/0.log"
Sep 11 00:14:42.206018 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.205990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss46t_ab60083e-4528-46c4-a0ed-595cc315c457/kube-rbac-proxy/0.log"
Sep 11 00:14:42.225061 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.225038    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss46t_ab60083e-4528-46c4-a0ed-595cc315c457/init-textfile/0.log"
Sep 11 00:14:42.624343 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.624231    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf55599b-9kr7w_c77f151b-c865-49e8-8113-938b2e488d22/telemeter-client/0.log"
Sep 11 00:14:42.643342 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.643311    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf55599b-9kr7w_c77f151b-c865-49e8-8113-938b2e488d22/reload/0.log"
Sep 11 00:14:42.665332 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.665302    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67cf55599b-9kr7w_c77f151b-c865-49e8-8113-938b2e488d22/kube-rbac-proxy/0.log"
Sep 11 00:14:42.701571 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.701546    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/thanos-query/0.log"
Sep 11 00:14:42.733962 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.733935    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/kube-rbac-proxy-web/0.log"
Sep 11 00:14:42.760706 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.760679    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/kube-rbac-proxy/0.log"
Sep 11 00:14:42.791517 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.791488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/prom-label-proxy/0.log"
Sep 11 00:14:42.829225 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.829201    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/kube-rbac-proxy-rules/0.log"
Sep 11 00:14:42.850872 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:42.850838    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8c6b8d577-dmscz_054f93eb-820d-4dbe-ab16-0899eacc33ca/kube-rbac-proxy-metrics/0.log"
Sep 11 00:14:44.413915 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:44.413887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-w2sf2_f59fd2f6-afa2-4527-b311-db2040bd5f84/networking-console-plugin/0.log"
Sep 11 00:14:45.597330 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.597274    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d97c6c6d-rntrm_3575d104-5ef9-461d-82d9-524970ad7cfc/console/0.log"
Sep 11 00:14:45.691211 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.691172    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"]
Sep 11 00:14:45.691769 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.691751    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7716a269-783d-4ed7-a264-cb685254d56f" containerName="maas-api"
Sep 11 00:14:45.691838 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.691773    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7716a269-783d-4ed7-a264-cb685254d56f" containerName="maas-api"
Sep 11 00:14:45.691875 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.691845    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7716a269-783d-4ed7-a264-cb685254d56f" containerName="maas-api"
Sep 11 00:14:45.695380 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.695343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.697613 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.697590    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chw9w\"/\"openshift-service-ca.crt\""
Sep 11 00:14:45.697742 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.697591    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-chw9w\"/\"kube-root-ca.crt\""
Sep 11 00:14:45.698272 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.698253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-chw9w\"/\"default-dockercfg-w5c67\""
Sep 11 00:14:45.705451 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.705424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"]
Sep 11 00:14:45.796702 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.796665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr66v\" (UniqueName: \"kubernetes.io/projected/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-kube-api-access-fr66v\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.796702 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.796716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-podres\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.796977 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.796736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-lib-modules\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.796977 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.796805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-proc\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.796977 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.796828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-sys\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897642 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr66v\" (UniqueName: \"kubernetes.io/projected/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-kube-api-access-fr66v\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897642 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-podres\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897642 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-lib-modules\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-proc\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-sys\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-podres\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-proc\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-lib-modules\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.897882 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.897781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-sys\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:45.906627 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:45.906595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr66v\" (UniqueName: \"kubernetes.io/projected/3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f-kube-api-access-fr66v\") pod \"perf-node-gather-daemonset-sjpzv\" (UID: \"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f\") " pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:46.008124 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:46.008089    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:46.284919 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:46.284885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"]
Sep 11 00:14:46.285964 ip-10-0-129-151 kubenswrapper[2581]: W0911 00:14:46.285941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a2cf3a8_65b5_41bf_b21f_32b6c3e9aa0f.slice/crio-23d4e405c69317593bcf88dedd26a0621d1a8944027ba533690cee720cbfe64c WatchSource:0}: Error finding container 23d4e405c69317593bcf88dedd26a0621d1a8944027ba533690cee720cbfe64c: Status 404 returned error can't find the container with id 23d4e405c69317593bcf88dedd26a0621d1a8944027ba533690cee720cbfe64c
Sep 11 00:14:46.306495 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:46.306452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv" event={"ID":"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f","Type":"ContainerStarted","Data":"23d4e405c69317593bcf88dedd26a0621d1a8944027ba533690cee720cbfe64c"}
Sep 11 00:14:46.378816 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:46.378784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-q497z_aa91771d-a2a4-4be5-85df-717dcdff4929/volume-data-source-validator/0.log"
Sep 11 00:14:47.315187 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.315154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv" event={"ID":"3a2cf3a8-65b5-41bf-b21f-32b6c3e9aa0f","Type":"ContainerStarted","Data":"cca8a4e2bf2615343643c598350e302ec15ff777c56218f77b9a8031cea46aa4"}
Sep 11 00:14:47.315620 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.315220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:47.332228 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.332158    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv" podStartSLOduration=2.332138164 podStartE2EDuration="2.332138164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:14:47.329705053 +0000 UTC m=+2304.429287158" watchObservedRunningTime="2026-09-11 00:14:47.332138164 +0000 UTC m=+2304.431720267"
Sep 11 00:14:47.545468 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.545436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8scc_45321afd-03f6-46f3-95b2-fa5f7eb26b79/dns/0.log"
Sep 11 00:14:47.566157 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.566070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8scc_45321afd-03f6-46f3-95b2-fa5f7eb26b79/kube-rbac-proxy/0.log"
Sep 11 00:14:47.653414 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:47.653383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbgn5_af313ef3-846e-42ac-a5d3-fa795ec2f160/dns-node-resolver/0.log"
Sep 11 00:14:48.191432 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:48.191406    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29818080-hj8fk_52e92cb6-757f-44bb-ba81-0de3954c3cda/image-pruner/0.log"
Sep 11 00:14:48.257983 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:48.257948    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c59dfcd75-jxl6v_8547a827-386c-4da9-9a14-72e1ff25cfad/registry/0.log"
Sep 11 00:14:48.294761 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:48.294730    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-852dd_a58e43f0-f0ee-424c-a9d5-197585bab353/node-ca/0.log"
Sep 11 00:14:49.847924 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:49.847893    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547c6fc866-zr62v_6e7b66c6-28d9-427a-8984-de88d7ac71e6/kube-auth-proxy/0.log"
Sep 11 00:14:49.875212 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:49.875179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/0.log"
Sep 11 00:14:49.883489 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:49.883465    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/1.log"
Sep 11 00:14:49.917163 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:49.917135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jdjzn_506ec22b-7cfb-4109-bcb8-b6a2915d20e7/payload-pre-processing/0.log"
Sep 11 00:14:49.951529 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:49.951496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:14:50.819735 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:50.819704    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcbx9_f031016d-8254-488c-8211-fd3fa9bd76b2/serve-healthcheck-canary/0.log"
Sep 11 00:14:51.306194 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:51.306159    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-g2hbd_38313397-1470-43c1-a36c-58b21ac2d189/insights-operator/1.log"
Sep 11 00:14:51.306194 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:51.306185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-g2hbd_38313397-1470-43c1-a36c-58b21ac2d189/insights-operator/0.log"
Sep 11 00:14:51.451670 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:51.451638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lz4wj_e2d3c9fc-4dfc-4004-875b-db4ef15d936f/kube-rbac-proxy/0.log"
Sep 11 00:14:51.472256 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:51.472224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lz4wj_e2d3c9fc-4dfc-4004-875b-db4ef15d936f/exporter/0.log"
Sep 11 00:14:51.493809 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:51.493779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lz4wj_e2d3c9fc-4dfc-4004-875b-db4ef15d936f/extractor/0.log"
Sep 11 00:14:53.332368 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:53.332342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-chw9w/perf-node-gather-daemonset-sjpzv"
Sep 11 00:14:53.507347 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:53.507309    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sztjt_86283742-6da6-44c2-b75a-aeb2eca2b674/manager/0.log"
Sep 11 00:14:53.688712 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:53.688678    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rnwhb_18fa3461-bf05-42ea-b5ae-25e19f7df4b9/manager/0.log"
Sep 11 00:14:53.733077 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:53.733049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb769cbf8-k9bv6_f5d5df89-a820-472c-b841-84a3c828739d/manager/0.log"
Sep 11 00:14:53.824003 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:53.823971    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-59cqn_5c5dc3b9-77e4-41f7-bc98-63bcfd7c45c1/manager/0.log"
Sep 11 00:14:54.012176 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:54.012060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bb6f54779-q4nfr_dd3e35f7-11d7-495d-8c75-90e084240173/manager/0.log"
Sep 11 00:14:54.030274 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:54.030242    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bb6f54779-q4nfr_dd3e35f7-11d7-495d-8c75-90e084240173/copy-manifests/0.log"
Sep 11 00:14:56.361520 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:56.361483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547c6fc866-zr62v_6e7b66c6-28d9-427a-8984-de88d7ac71e6/kube-auth-proxy/0.log"
Sep 11 00:14:56.378925 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:56.378890    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/0.log"
Sep 11 00:14:56.386577 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:56.386549    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/1.log"
Sep 11 00:14:56.411740 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:56.411703    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jdjzn_506ec22b-7cfb-4109-bcb8-b6a2915d20e7/payload-pre-processing/0.log"
Sep 11 00:14:56.443827 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:56.443794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:14:58.654723 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:58.654693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547c6fc866-zr62v_6e7b66c6-28d9-427a-8984-de88d7ac71e6/kube-auth-proxy/0.log"
Sep 11 00:14:58.674033 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:58.673997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/0.log"
Sep 11 00:14:58.683221 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:58.683168    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pfjmc_0d972cc9-2a27-4208-9aec-d15b73532793/istio-proxy/1.log"
Sep 11 00:14:58.708986 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:58.708949    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jdjzn_506ec22b-7cfb-4109-bcb8-b6a2915d20e7/payload-pre-processing/0.log"
Sep 11 00:14:58.737463 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:14:58.737426    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-nbxtp_da5263d3-c157-48fe-aaa9-dff5f181f4d3/payload-processing/0.log"
Sep 11 00:15:00.816577 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:00.816539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7sfhn_1811caf3-5ec5-4618-b17f-8296b488f231/kube-storage-version-migrator-operator/1.log"
Sep 11 00:15:00.817502 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:00.817484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-7sfhn_1811caf3-5ec5-4618-b17f-8296b488f231/kube-storage-version-migrator-operator/0.log"
Sep 11 00:15:02.159746 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.159719    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/kube-multus-additional-cni-plugins/0.log"
Sep 11 00:15:02.178000 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.177967    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/egress-router-binary-copy/0.log"
Sep 11 00:15:02.195823 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.195797    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/cni-plugins/0.log"
Sep 11 00:15:02.213775 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.213740    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/bond-cni-plugin/0.log"
Sep 11 00:15:02.232215 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.232185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/routeoverride-cni/0.log"
Sep 11 00:15:02.250243 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.250216    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/whereabouts-cni-bincopy/0.log"
Sep 11 00:15:02.268000 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.267969    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x5pkt_c5015ed2-cebb-4e80-ba94-61b9eec7ffe0/whereabouts-cni/0.log"
Sep 11 00:15:02.309060 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.309030    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hlnpc_1ac28577-b61f-4b9f-afb0-316141947106/kube-multus/0.log"
Sep 11 00:15:02.421615 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.421538    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g465n_27274aa2-1585-40d5-8ff8-450894cde5d2/network-metrics-daemon/0.log"
Sep 11 00:15:02.440030 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:02.440002    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g465n_27274aa2-1585-40d5-8ff8-450894cde5d2/kube-rbac-proxy/0.log"
Sep 11 00:15:03.261458 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.261429    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/ovn-controller/0.log"
Sep 11 00:15:03.275899 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.275871    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/ovn-acl-logging/0.log"
Sep 11 00:15:03.297389 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.297362    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/kube-rbac-proxy-node/0.log"
Sep 11 00:15:03.315021 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.314940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/kube-rbac-proxy-ovn-metrics/0.log"
Sep 11 00:15:03.331552 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.331526    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/northd/0.log"
Sep 11 00:15:03.349071 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.349039    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/nbdb/0.log"
Sep 11 00:15:03.370806 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.370777    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/sbdb/0.log"
Sep 11 00:15:03.427590 ip-10-0-129-151 kubenswrapper[2581]: I0911 00:15:03.427555    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhnp9_55f86f66-b73f-4efb-95e2-bebee778f6fc/ovnkube-controller/0.log"