Sep 07 12:52:56.184076 ip-10-0-143-132 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 12:52:56.605029 ip-10-0-143-132 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:52:56.605029 ip-10-0-143-132 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 12:52:56.605029 ip-10-0-143-132 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:52:56.605029 ip-10-0-143-132 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 12:52:56.605029 ip-10-0-143-132 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:52:56.607084 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.607002    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 12:52:56.610291 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610275    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.610291 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610290    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610297    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610301    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610304    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610308    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610311    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610314    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610317    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610319    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610322    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610324    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610327    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610330    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610332    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610335    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610338    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610340    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610343    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610346    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610349    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.610403 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610351    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610354    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610357    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610360    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610362    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610366    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610369    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610372    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610375    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610378    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610380    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610384    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610386    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610389    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610392    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610394    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610397    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610400    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610403    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610406    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.610912 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610408    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610411    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610414    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610417    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610420    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610423    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610425    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610428    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610430    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610436    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610439    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610442    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610445    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610448    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610451    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610455    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610457    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610460    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610463    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.611400 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610465    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610468    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610471    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610473    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610477    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610480    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610482    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610485    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610488    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610490    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610493    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610496    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610499    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610501    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610504    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610507    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610510    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610512    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610515    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610518    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.611893 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610520    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610523    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610525    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610528    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610530    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610533    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610536    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610538    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610541    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610543    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610546    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610549    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610552    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610555    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610557    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610560    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610562    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610565    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.610568    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611306    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.612380 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611312    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611316    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611319    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611322    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611325    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611328    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611331    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611334    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611337    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611340    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611342    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611344    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611347    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611350    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611352    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611355    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611358    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611360    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611362    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611365    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.612886 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611368    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611371    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611374    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611377    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611379    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611382    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611385    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611387    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611390    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611394    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611397    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611400    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611404    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611407    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611410    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611412    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611415    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611418    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611421    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.613455 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611423    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611426    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611428    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611431    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611433    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611436    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611439    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611441    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611443    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611446    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611450    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611454    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611457    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611460    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611463    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611466    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611469    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611472    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611474    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611477    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.613940 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611480    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611482    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611484    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611487    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611489    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611492    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611494    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611497    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611499    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611502    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611504    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611507    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611511    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611514    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611517    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611520    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611522    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611525    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611527    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.614450 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611530    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611532    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611535    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611537    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611541    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611543    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611546    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611549    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611552    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611555    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611558    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611560    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611563    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611566    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611568    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611571    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611573    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611576    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611579    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.611582    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.614944 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612862    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612869    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612873    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612876    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612880    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612883    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612886    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612889    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612892    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612895    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612898    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612901    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612904    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612907    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612909    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612912    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612914    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612917    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612920    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.615443 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612923    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612926    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612929    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612931    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612934    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612936    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612939    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612942    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612944    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612947    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612950    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612952    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612955    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612957    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612960    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612962    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612965    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612968    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612971    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612974    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.615934 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612976    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612979    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612981    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612984    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612986    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612989    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612991    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612994    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612996    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.612999    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613001    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613004    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613006    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613009    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613011    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613014    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613016    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613019    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613021    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613024    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.616517 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613026    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613030    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613034    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613038    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613041    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613043    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613046    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613049    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613052    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613055    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613058    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613061    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613064    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613067    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613070    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613072    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613075    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613078    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613080    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.617032 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613083    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613086    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613088    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613091    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613094    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613096    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613099    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613101    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613105    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613108    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613111    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613114    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613116    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613119    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613121    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613124    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613126    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613129    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613131    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613133    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.617512 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613136    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613201    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613232    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613239    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613244    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613249    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613252    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613256    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613261    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613264    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613268    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613271    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613274    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613277    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613280    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613283    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613286    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613297    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613302    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613307    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613310    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613313    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613316    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613320    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 12:52:56.618006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613324    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613327    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613330    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613334    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613337    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613340    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613343    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613346    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613349    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613353    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613356    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613359    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613364    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613367    2570 flags.go:64] FLAG: --enable-server="true"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613371    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613375    2570 flags.go:64] FLAG: --event-burst="100"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613380    2570 flags.go:64] FLAG: --event-qps="50"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613383    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613386    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613389    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613392    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613395    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613398    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613401    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613404    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 12:52:56.618634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613407    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613411    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613413    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613416    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613419    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613422    2570 flags.go:64] FLAG: --feature-gates=""
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613426    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613429    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613432    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613435    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613438    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613441    2570 flags.go:64] FLAG: --help="false"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613444    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613447    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613450    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613453    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613456    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613460    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613463    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613467    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613470    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613473    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613476    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613481    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 12:52:56.619258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613484    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613487    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613490    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613493    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613496    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613498    2570 flags.go:64] FLAG: --lock-file=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613501    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613504    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613507    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613513    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613515    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613518    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613521    2570 flags.go:64] FLAG: --logging-format="text"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613524    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613527    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613530    2570 flags.go:64] FLAG: --manifest-url=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613533    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613540    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613543    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613547    2570 flags.go:64] FLAG: --max-pods="110"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613551    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613554    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613556    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613559    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613562    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 12:52:56.619873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613565    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613568    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613577    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613580    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613583    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613586    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613590    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613596    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613599    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613602    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613605    2570 flags.go:64] FLAG: --port="10250"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613608    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613611    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d1d6a6bb6c05b28"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613615    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613630    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613633    2570 flags.go:64] FLAG: --register-node="true"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613636    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613640    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613643    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613646    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613649    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613652    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613656    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613659    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613662    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 12:52:56.620490 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613665    2570 flags.go:64] FLAG: --runonce="false"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613668    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613672    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613675    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613678    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613681    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613684    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613687    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613690    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613693    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613697    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613700    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613703    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613708    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613711    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613714    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613719    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613722    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613725    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613730    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613732    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613735    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613738    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613741    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613744    2570 flags.go:64] FLAG: --v="2"
Sep 07 12:52:56.621119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613748    2570 flags.go:64] FLAG: --version="false"
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613752    2570 flags.go:64] FLAG: --vmodule=""
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613756    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.613759    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613891    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613895    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613898    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613902    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613904    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613907    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613910    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613913    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613916    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613919    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613921    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613924    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613927    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613932    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613935    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613938    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.621789 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613942    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613945    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613948    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613951    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613954    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613957    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613959    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613961    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613964    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613967    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613969    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613972    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613975    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613977    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613980    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613982    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613985    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613987    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613990    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613993    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.622305 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613996    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.613999    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614001    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614003    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614006    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614008    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614011    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614013    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614016    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614019    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614022    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614024    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614027    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614030    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614032    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614036    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614038    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614040    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614044    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.622815 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614047    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614050    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614052    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614054    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614057    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614059    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614062    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614065    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614067    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614069    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614072    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614074    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614077    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614079    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614082    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614084    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614087    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614089    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614092    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614094    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.623292 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614097    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614100    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614102    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614105    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614107    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614110    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614114    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614118    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614120    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614124    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614126    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614129    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614131    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614134    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614136    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614139    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614141    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614144    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614146    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.623819 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614149    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614152    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614154    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614158    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.614161    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.615066    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.622826    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.622841    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.623758    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.623767    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623825    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623830    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623834    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623837    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.624290 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623840    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623843    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623846    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623849    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623851    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623854    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623857    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623860    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623862    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623865    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623868    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623871    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623873    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623876    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623879    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623882    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623899    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623903    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623907    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.624772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623910    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623913    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623916    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623920    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623923    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623926    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623931    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623934    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623937    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623940    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623943    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623946    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623949    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623952    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623956    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623959    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623962    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623965    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623968    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.625570 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623971    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623973    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623976    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623979    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623981    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623984    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623987    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623990    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623992    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623995    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.623997    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624000    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624003    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624005    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624008    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624010    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624013    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624015    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624018    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624021    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.626125 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624024    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624027    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624029    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624032    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624035    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624037    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624040    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624042    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624045    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624048    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624050    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624053    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624055    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624057    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624060    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624062    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624065    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624067    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624070    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624072    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.626633 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624075    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624079    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624083    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624086    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624088    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624091    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624093    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624096    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624098    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624101    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624103    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624106    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624108    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624111    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624114    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624116    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.627134 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624119    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.624124    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624237    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624242    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624245    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624249    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624252    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624254    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624257    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624259    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624262    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624264    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624267    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624269    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624272    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:52:56.627529 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624274    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624277    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624280    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624282    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624285    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624287    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624290    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624292    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624295    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624297    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624300    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624303    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624305    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624308    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624310    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624315    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624318    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624321    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624323    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624326    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:52:56.628012 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624328    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624330    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624333    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624336    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624338    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624340    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624343    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624346    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624348    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624351    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624353    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624356    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624358    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624363    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624366    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624369    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624371    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624374    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624377    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624379    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:52:56.628505 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624382    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624384    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624386    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624389    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624391    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624394    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624396    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624398    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624401    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624404    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624406    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624409    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624411    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624414    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624416    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624419    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624421    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624424    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624426    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624428    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:52:56.629009 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624431    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624509    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624514    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624518    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624521    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624524    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624527    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624530    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624533    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624536    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624538    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624541    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624544    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624551    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624554    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624557    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624560    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624562    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624566    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:52:56.629511 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624570    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624573    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624586    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624589    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624592    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624596    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:56.624600    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.625915    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.626224    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.628671    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.629782    2570 server.go:1019] "Starting client certificate rotation"
Sep 07 12:52:56.629993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.629878    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 12:52:56.630713 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.630701    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 12:52:56.632780 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.632703    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 12:52:56.633968 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.633950    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 12:52:56.643445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.643428    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 07 12:52:56.646917 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.646898    2570 log.go:25] "Validated CRI v1 image API"
Sep 07 12:52:56.648679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.648665    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 12:52:56.653785 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.653764    2570 fs.go:135] Filesystem UUIDs: map[6cd9f502-7486-45ca-adbb-08c5098dffca:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad5b5a44-d33f-4b33-9068-68a721ae6288:/dev/nvme0n1p3]
Sep 07 12:52:56.653863 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.653784    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 12:52:56.659174 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.659056    2570 manager.go:216] Machine: {Timestamp:2026-09-07 12:52:56.658568511 +0000 UTC m=+0.365351434 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099812 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d919df71c578e3b2b9bc91901b9d SystemUUID:ec29d919-df71-c578-e3b2-b9bc91901b9d BootID:ba7e3afa-7a38-4fda-bf2d-44224171be9d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:92:01:60:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:92:01:60:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:9d:d2:f8:5f:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 12:52:56.659174 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.659171    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 12:52:56.659305 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.659293    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 12:52:56.662972 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.662945    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 12:52:56.663124 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.662977    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 12:52:56.663886 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.663875    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 12:52:56.663923 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.663888    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 12:52:56.663923 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.663896    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 12:52:56.665217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.665112    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 12:52:56.667026 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.667010    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 12:52:56.668187 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.668164    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 12:52:56.672315 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672298    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 12:52:56.672477 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672465    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 12:52:56.672514 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672503    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 12:52:56.672542 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672515    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 12:52:56.672542 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672527    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 12:52:56.672542 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672537    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 07 12:52:56.672652 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.672545    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 12:52:56.673015 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.673003    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 12:52:56.673069 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.673024    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 12:52:56.675557 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.675540    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 12:52:56.677809 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.677797    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 12:52:56.677855 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.677826    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 12:52:56.677998 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.677977    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 12:52:56.677998 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678000    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 12:52:56.678139 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678010    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 12:52:56.678139 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678020    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 12:52:56.678139 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678032    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 12:52:56.678139 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678041    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 12:52:56.678720 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678710    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 12:52:56.678720 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678720    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 12:52:56.678779 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678728    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 12:52:56.678779 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678739    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 12:52:56.678779 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678749    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 12:52:56.678779 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678756    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 12:52:56.678922 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678800    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 12:52:56.678922 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.678806    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 12:52:56.683671 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.683652    2570 server.go:1268] "Started kubelet"
Sep 07 12:52:56.683814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.683747    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 12:52:56.683814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.683776    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 12:52:56.683917 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.683846    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 12:52:56.684540 ip-10-0-143-132 systemd[1]: Started Kubernetes Kubelet.
Sep 07 12:52:56.685670 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.685451    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 12:52:56.685845 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.685827    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 12:52:56.685901 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.685841    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 12:52:56.685944 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.685892    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 12:52:56.686048 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.685963    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 12:52:56.688952 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.688905    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 12:52:56.690215 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.689075    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-132.ec2.internal.18d30b012d912b94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-132.ec2.internal,UID:ip-10-0-143-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-132.ec2.internal,},FirstTimestamp:2026-09-07 12:52:56.683580308 +0000 UTC m=+0.390363231,LastTimestamp:2026-09-07 12:52:56.683580308 +0000 UTC m=+0.390363231,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-132.ec2.internal,}"
Sep 07 12:52:56.691999 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.691981    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 12:52:56.692682 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.692666    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 12:52:56.692861 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.692840    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:56.693039 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.692980    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2z7l"
Sep 07 12:52:56.694556 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.694539    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 12:52:56.694706 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.694695    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 12:52:56.694775 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.694723    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 12:52:56.694859 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.694847    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 12:52:56.694859 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.694858    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 12:52:56.695584 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695560    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 12:52:56.695584 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695585    2570 factory.go:55] Registering systemd factory
Sep 07 12:52:56.695710 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695596    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 07 12:52:56.695948 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695932    2570 factory.go:153] Registering CRI-O factory
Sep 07 12:52:56.695948 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695949    2570 factory.go:223] Registration of the crio container factory successfully
Sep 07 12:52:56.696080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695965    2570 factory.go:103] Registering Raw factory
Sep 07 12:52:56.696080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.695977    2570 manager.go:1196] Started watching for new ooms in manager
Sep 07 12:52:56.696406 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.696392    2570 manager.go:349] Starting recovery of all containers
Sep 07 12:52:56.698225 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.698038    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 12:52:56.698225 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.698199    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 12:52:56.702567 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.700310    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2z7l"
Sep 07 12:52:56.706935 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.706912    2570 manager.go:354] Recovery completed
Sep 07 12:52:56.710132 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.710099    2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 07 12:52:56.713379 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.713358    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.715909 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.715893    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.715982 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.715925    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.715982 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.715940    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.716585 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.716571    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 12:52:56.716585 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.716573    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.716741 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.716586    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 12:52:56.716741 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.716606    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 12:52:56.717396 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.717381    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.717435 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.717410    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.717435 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.717421    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.718402 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.718319    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-132.ec2.internal.18d30b012f7e7501  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-132.ec2.internal,UID:ip-10-0-143-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-132.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-132.ec2.internal,},FirstTimestamp:2026-09-07 12:52:56.715908353 +0000 UTC m=+0.422691275,LastTimestamp:2026-09-07 12:52:56.715908353 +0000 UTC m=+0.422691275,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-132.ec2.internal,}"
Sep 07 12:52:56.718775 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.718759    2570 policy_none.go:49] "None policy: Start"
Sep 07 12:52:56.718775 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.718776    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 12:52:56.718900 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.718786    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 12:52:56.720806 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.720794    2570 policy_none.go:47] "Start"
Sep 07 12:52:56.767215 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767196    2570 manager.go:337] "Starting Device Plugin manager"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.767251    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767265    2570 server.go:87] "Starting device plugin registration server"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767538    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767552    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767652    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767741    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.767751    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.768357    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 12:52:56.786599 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.768401    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:56.806947 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.806904    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 12:52:56.808137 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.808122    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 12:52:56.808222 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.808180    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 12:52:56.808222 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.808213    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 12:52:56.808316 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.808266    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 12:52:56.810677 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.810659    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:52:56.867933 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.867819    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.868946 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.868929    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.869014 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.868959    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.869014 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.868996    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.869087 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.869031    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.878100 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.878084    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.878155 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.878109    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-132.ec2.internal\": node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:56.896816 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.896784    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:56.909087 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.909065    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"]
Sep 07 12:52:56.909141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.909132    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.910122 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.910102    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.910205 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.910133    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.910205 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.910144    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.912431 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.912419    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.912564 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.912536    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.912605 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.912572    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.913246 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913224    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.913357 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913217    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.913357 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913277    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.913357 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913293    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.913357 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913258    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.913357 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.913337    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.915743 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.915727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.915822 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.915766    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:52:56.916426 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.916408    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:52:56.916520 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.916438    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:52:56.916520 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:56.916451    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:52:56.938511 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.938494    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-132.ec2.internal\" not found" node="ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.943355 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.943336    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-132.ec2.internal\" not found" node="ip-10-0-143-132.ec2.internal"
Sep 07 12:52:56.997632 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:56.997600    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.096632 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.096603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.096723 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.096667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.096723 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.096707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7db37ffbd7e75f97328ea72fd34d53c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"a7db37ffbd7e75f97328ea72fd34d53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.097706 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.097685    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.197657 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.197657 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.197657 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7db37ffbd7e75f97328ea72fd34d53c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"a7db37ffbd7e75f97328ea72fd34d53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.197789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.197789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7db37ffbd7e75f97328ea72fd34d53c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"a7db37ffbd7e75f97328ea72fd34d53c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.197789 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.197725    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.197789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.197668    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71351fc077680266fe6e92bedaf6462e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"71351fc077680266fe6e92bedaf6462e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.244259 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.244222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.246428 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.246409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.298179 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.298143    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.399886 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.399829    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.500945 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.500834    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.601582 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.601549    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.630940 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.630917    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 12:52:57.631398 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.631131    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 12:52:57.701947 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.701917    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.705861 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.705817    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:47:57 +0000 UTC" deadline="2028-03-18 16:44:19.354133925 +0000 UTC"
Sep 07 12:52:57.705861 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.705854    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13395h51m21.648283483s"
Sep 07 12:52:57.802080 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:57.802004    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Sep 07 12:52:57.807708 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.807676    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:52:57.893718 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.893673    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.907621 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.907445    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 12:52:57.909551 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.909534    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Sep 07 12:52:57.919660 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.919638    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 12:52:57.958670 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.958626    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:52:57.993322 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:57.993291    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71351fc077680266fe6e92bedaf6462e.slice/crio-c481fffac25d4077543e414f35536fdd92a56271879dd446b725c8b7599fe2e3 WatchSource:0}: Error finding container c481fffac25d4077543e414f35536fdd92a56271879dd446b725c8b7599fe2e3: Status 404 returned error can't find the container with id c481fffac25d4077543e414f35536fdd92a56271879dd446b725c8b7599fe2e3
Sep 07 12:52:57.993743 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:57.993712    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7db37ffbd7e75f97328ea72fd34d53c.slice/crio-476ba4ef33be025f0faaf11f0e61083b92e6c98e7ee1536effcf462ffd7989e7 WatchSource:0}: Error finding container 476ba4ef33be025f0faaf11f0e61083b92e6c98e7ee1536effcf462ffd7989e7: Status 404 returned error can't find the container with id 476ba4ef33be025f0faaf11f0e61083b92e6c98e7ee1536effcf462ffd7989e7
Sep 07 12:52:57.998760 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:57.998745    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:52:58.064999 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.063460    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:52:58.569545 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.569510    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:52:58.675829 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.675792    2570 apiserver.go:52] "Watching apiserver"
Sep 07 12:52:58.684724 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.684698    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 12:52:58.687411 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.687331    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wq8zl","kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn","openshift-cluster-node-tuning-operator/tuned-wvpxd","openshift-dns/node-resolver-4qq82","openshift-image-registry/node-ca-2mpzz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal","openshift-multus/multus-79wct","kube-system/global-pull-secret-syncer-22pgn","openshift-multus/multus-additional-cni-plugins-klcd4","openshift-multus/network-metrics-daemon-l7xn2","openshift-network-diagnostics/network-check-target-dmwn8","openshift-network-operator/iptables-alerter-bhpj9","openshift-ovn-kubernetes/ovnkube-node-6thp5"]
Sep 07 12:52:58.690229 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.690203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.692830 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.692807    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.693522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693236    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 12:52:58.693522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693352    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 12:52:58.693522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693369    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 12:52:58.693522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693407    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fjwcw\""
Sep 07 12:52:58.693814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693538    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.693814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 12:52:58.693814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.693790    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.695971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.695944    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.695971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.695969    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.696503 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.696478    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.696631 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.696607    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4t7d6\""
Sep 07 12:52:58.696736 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.696719    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 12:52:58.697803 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.697514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.699227 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.698943    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 12:52:58.699227 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.699213    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.699227 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.699213    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.699453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.699273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4x5k\""
Sep 07 12:52:58.700249 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.700034    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.702475 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.702456    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.703632 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.703613    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.704047 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.704025    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wzwnr\""
Sep 07 12:52:58.704131 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.704076    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.704181 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.704032    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.704345 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.704317    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.704423 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.704374    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xrfs8\""
Sep 07 12:52:58.705040 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.705021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.705136 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.705100    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.705966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.706093    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.706193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.706856    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8qtfh\""
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.706981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnnt\" (UniqueName: \"kubernetes.io/projected/99b512fc-c3b0-4a78-82eb-795aa3e2576d-kube-api-access-lcnnt\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707109    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-registration-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-system-cni-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707287 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mqd\" (UniqueName: \"kubernetes.io/projected/d4d623df-b993-4763-a319-ca5100e6c226-kube-api-access-82mqd\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707339    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b512fc-c3b0-4a78-82eb-795aa3e2576d-host-slash\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-sys-fs\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9sd\" (UniqueName: \"kubernetes.io/projected/9ff243e6-064c-4925-ad5a-4781c721a45b-kube-api-access-4q9sd\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99b512fc-c3b0-4a78-82eb-795aa3e2576d-iptables-alerter-script\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707538    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-device-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-cnibin\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707600    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-binary-copy\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-socket-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.707833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.707772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.711661 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.711623    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.713022 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.712996    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 12:52:58.714402 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.714372    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.716187 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.716167    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wr69z\""
Sep 07 12:52:58.716187 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.716183    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 12:52:58.717014 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.716995    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.717558 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717536    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 12:52:58.717558 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717416    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 12:52:58.717766 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717617    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sqq26\""
Sep 07 12:52:58.717766 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717502    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 12:52:58.717883 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717540    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 12:52:58.717883 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717788    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 12:52:58.718025 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.717362    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 12:52:58.719781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.719759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.720011 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.719988    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:52:58.721798 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.721781    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-95wsq\""
Sep 07 12:52:58.722023 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.722008    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 12:52:58.722173 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.722158    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 12:52:58.722345 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.722323    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:52:58.722431 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.722401    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:52:58.742592 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.742566    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ss44j"
Sep 07 12:52:58.752505 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.752477    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ss44j"
Sep 07 12:52:58.796099 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.796069    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 12:52:58.808335 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-var-lib-kubelet\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqp9\" (UniqueName: \"kubernetes.io/projected/b0b65b81-dba1-4cd4-89f6-d8607316143a-kube-api-access-tlqp9\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-cni-binary-copy\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808502    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.808527 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-tmp\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17c6c58-0175-4877-a5d8-a1aaf9681d66-tmp-dir\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-multus\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mqd\" (UniqueName: \"kubernetes.io/projected/d4d623df-b993-4763-a319-ca5100e6c226-kube-api-access-82mqd\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-tuned\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0b65b81-dba1-4cd4-89f6-d8607316143a-host\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-bin\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.808903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-system-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-node-log\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-device-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.808995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-kubernetes\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l6rq\" (UniqueName: \"kubernetes.io/projected/e17c6c58-0175-4877-a5d8-a1aaf9681d66-kube-api-access-7l6rq\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-systemd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-ovn\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.809786 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809757    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.809929 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-env-overrides\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.809985 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.809985 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.809958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a82d087-5919-461e-aa24-f6604861f5a0-ovn-node-metrics-cert\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-device-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.810179 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-kubelet\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.810232 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-conf\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.810232 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.810334 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysconfig\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.810385 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810329    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-etc-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810385 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810364    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810480 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810480 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-socket-dir-parent\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.810480 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-multus-certs\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.810623 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-registration-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.810623 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-host\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.810623 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jml\" (UniqueName: \"kubernetes.io/projected/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-kube-api-access-f7jml\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.810623 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0b65b81-dba1-4cd4-89f6-d8607316143a-serviceca\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.810915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:52:58.810915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-var-lib-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-log-socket\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.810915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-registration-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.810915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-sys-fs\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9sd\" (UniqueName: \"kubernetes.io/projected/9ff243e6-064c-4925-ad5a-4781c721a45b-kube-api-access-4q9sd\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.810979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99b512fc-c3b0-4a78-82eb-795aa3e2576d-iptables-alerter-script\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811013    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e17c6c58-0175-4877-a5d8-a1aaf9681d66-hosts-file\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-netns\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-config\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-daemon-config\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-kubelet-config\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-socket-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnnt\" (UniqueName: \"kubernetes.io/projected/99b512fc-c3b0-4a78-82eb-795aa3e2576d-kube-api-access-lcnnt\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-slash\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-netd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811326    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-bin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811386    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-hostroot\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/759be7ca-493b-459c-961d-3ca2517f2807-konnectivity-ca\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.811468 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-system-cni-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghbd7\" (UniqueName: \"kubernetes.io/projected/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-kube-api-access-ghbd7\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-kubelet\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-systemd-units\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4kj\" (UniqueName: \"kubernetes.io/projected/d4e17033-4831-4988-b2b0-7416a4f435b5-kube-api-access-4t4kj\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-run\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811635    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-dbus\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-cnibin\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811675    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-socket-dir\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-binary-copy\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.811952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.811841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff243e6-064c-4925-ad5a-4781c721a45b-sys-fs\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.812418 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.812143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-system-cni-dir\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.812743 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.812718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99b512fc-c3b0-4a78-82eb-795aa3e2576d-iptables-alerter-script\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.812840 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.812777    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4d623df-b993-4763-a319-ca5100e6c226-cnibin\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.812958 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.812937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.813015 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.812980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkq8c\" (UniqueName: \"kubernetes.io/projected/3a82d087-5919-461e-aa24-f6604861f5a0-kube-api-access-wkq8c\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.813067 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/759be7ca-493b-459c-961d-3ca2517f2807-agent-certs\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.813119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-sys\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.813119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-lib-modules\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.813219 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.813219 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-etc-kubernetes\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.813219 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b512fc-c3b0-4a78-82eb-795aa3e2576d-host-slash\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-systemd\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-script-lib\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-cnibin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4d623df-b993-4763-a319-ca5100e6c226-cni-binary-copy\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-k8s-cni-cncf-io\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.813359 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-conf-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.813639 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-modprobe-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.813639 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813452    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b512fc-c3b0-4a78-82eb-795aa3e2576d-host-slash\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.813639 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.813459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-netns\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.816576 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.816512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" event={"ID":"a7db37ffbd7e75f97328ea72fd34d53c","Type":"ContainerStarted","Data":"476ba4ef33be025f0faaf11f0e61083b92e6c98e7ee1536effcf462ffd7989e7"}
Sep 07 12:52:58.818739 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.818705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"71351fc077680266fe6e92bedaf6462e","Type":"ContainerStarted","Data":"c481fffac25d4077543e414f35536fdd92a56271879dd446b725c8b7599fe2e3"}
Sep 07 12:52:58.819023 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.818999    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 12:52:58.824172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.824067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mqd\" (UniqueName: \"kubernetes.io/projected/d4d623df-b993-4763-a319-ca5100e6c226-kube-api-access-82mqd\") pod \"multus-additional-cni-plugins-klcd4\" (UID: \"d4d623df-b993-4763-a319-ca5100e6c226\") " pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:58.824172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.824105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnnt\" (UniqueName: \"kubernetes.io/projected/99b512fc-c3b0-4a78-82eb-795aa3e2576d-kube-api-access-lcnnt\") pod \"iptables-alerter-bhpj9\" (UID: \"99b512fc-c3b0-4a78-82eb-795aa3e2576d\") " pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:58.824172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.824136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9sd\" (UniqueName: \"kubernetes.io/projected/9ff243e6-064c-4925-ad5a-4781c721a45b-kube-api-access-4q9sd\") pod \"aws-ebs-csi-driver-node-q25sn\" (UID: \"9ff243e6-064c-4925-ad5a-4781c721a45b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:58.914052 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.913966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-socket-dir-parent\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.914052 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-multus-certs\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-host\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jml\" (UniqueName: \"kubernetes.io/projected/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-kube-api-access-f7jml\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0b65b81-dba1-4cd4-89f6-d8607316143a-serviceca\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-socket-dir-parent\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-multus-certs\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-host\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.914301 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-var-lib-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-log-socket\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914347    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-var-lib-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e17c6c58-0175-4877-a5d8-a1aaf9681d66-hosts-file\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-log-socket\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-netns\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-config\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-netns\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-daemon-config\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-kubelet-config\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-slash\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-kubelet-config\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914513    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e17c6c58-0175-4877-a5d8-a1aaf9681d66-hosts-file\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-netd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.914793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-slash\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-bin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-netd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-hostroot\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/759be7ca-493b-459c-961d-3ca2517f2807-konnectivity-ca\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0b65b81-dba1-4cd4-89f6-d8607316143a-serviceca\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914756    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-bin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghbd7\" (UniqueName: \"kubernetes.io/projected/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-kube-api-access-ghbd7\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-hostroot\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-kubelet\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-systemd-units\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4kj\" (UniqueName: \"kubernetes.io/projected/d4e17033-4831-4988-b2b0-7416a4f435b5-kube-api-access-4t4kj\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-run\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-dbus\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkq8c\" (UniqueName: \"kubernetes.io/projected/3a82d087-5919-461e-aa24-f6604861f5a0-kube-api-access-wkq8c\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.914994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/759be7ca-493b-459c-961d-3ca2517f2807-agent-certs\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.915401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-sys\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-lib-modules\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-run\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915110    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-kubelet\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915123    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-config\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-systemd-units\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-sys\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/759be7ca-493b-459c-961d-3ca2517f2807-konnectivity-ca\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67863efb-6457-47e6-9c0e-8c8946263e6e-dbus\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915321    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-lib-modules\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-etc-kubernetes\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.915380    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915386    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-systemd\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-script-lib\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.915473    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:52:59.4154324 +0000 UTC m=+3.122215333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-cnibin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.916391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-k8s-cni-cncf-io\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-conf-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-modprobe-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-netns\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-var-lib-kubelet\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqp9\" (UniqueName: \"kubernetes.io/projected/b0b65b81-dba1-4cd4-89f6-d8607316143a-kube-api-access-tlqp9\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-conf-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-cni-binary-copy\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-multus-daemon-config\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-tmp\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17c6c58-0175-4877-a5d8-a1aaf9681d66-tmp-dir\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915839    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-etc-kubernetes\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-multus\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915855    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-cnibin\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-tuned\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0b65b81-dba1-4cd4-89f6-d8607316143a-host\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915917    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-bin\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.915921    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:52:58.917273 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915924    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-systemd\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-system-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.915972    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:52:59.415955258 +0000 UTC m=+3.122738175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915986    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-netns\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.915996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-node-log\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916013    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-system-cni-dir\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916028    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-kubernetes\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l6rq\" (UniqueName: \"kubernetes.io/projected/e17c6c58-0175-4877-a5d8-a1aaf9681d66-kube-api-access-7l6rq\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-ovnkube-script-lib\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-modprobe-d\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-systemd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-var-lib-kubelet\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-ovn\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916171    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-env-overrides\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-ovn\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a82d087-5919-461e-aa24-f6604861f5a0-ovn-node-metrics-cert\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e17033-4831-4988-b2b0-7416a4f435b5-cni-binary-copy\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.917952 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-run-k8s-cni-cncf-io\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-kubelet\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-conf\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-kubelet\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916318    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysconfig\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-etc-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysctl-conf\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-node-log\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916515    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-kubernetes\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17c6c58-0175-4877-a5d8-a1aaf9681d66-tmp-dir\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916777    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-host-cni-bin\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e17033-4831-4988-b2b0-7416a4f435b5-host-var-lib-cni-multus\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-etc-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-openvswitch\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a82d087-5919-461e-aa24-f6604861f5a0-run-systemd\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.918628 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a82d087-5919-461e-aa24-f6604861f5a0-env-overrides\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.919445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916839    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0b65b81-dba1-4cd4-89f6-d8607316143a-host\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.919445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.916888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-sysconfig\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.919445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.919347    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-tmp\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.919445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.919360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a82d087-5919-461e-aa24-f6604861f5a0-ovn-node-metrics-cert\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.919445 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.919437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/759be7ca-493b-459c-961d-3ca2517f2807-agent-certs\") pod \"konnectivity-agent-wq8zl\" (UID: \"759be7ca-493b-459c-961d-3ca2517f2807\") " pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:58.919991 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.919966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-etc-tuned\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:58.935438 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.935385    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:52:58.935438 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.935420    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:52:58.935438 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.935437    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:52:58.935789 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:58.935513    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:52:59.435489636 +0000 UTC m=+3.142272551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:52:58.937119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.937087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghbd7\" (UniqueName: \"kubernetes.io/projected/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-kube-api-access-ghbd7\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:58.937285 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.937263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4kj\" (UniqueName: \"kubernetes.io/projected/d4e17033-4831-4988-b2b0-7416a4f435b5-kube-api-access-4t4kj\") pod \"multus-79wct\" (UID: \"d4e17033-4831-4988-b2b0-7416a4f435b5\") " pod="openshift-multus/multus-79wct"
Sep 07 12:52:58.948478 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.948440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l6rq\" (UniqueName: \"kubernetes.io/projected/e17c6c58-0175-4877-a5d8-a1aaf9681d66-kube-api-access-7l6rq\") pod \"node-resolver-4qq82\" (UID: \"e17c6c58-0175-4877-a5d8-a1aaf9681d66\") " pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:58.948619 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.948524    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqp9\" (UniqueName: \"kubernetes.io/projected/b0b65b81-dba1-4cd4-89f6-d8607316143a-kube-api-access-tlqp9\") pod \"node-ca-2mpzz\" (UID: \"b0b65b81-dba1-4cd4-89f6-d8607316143a\") " pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:58.950020 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.949978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkq8c\" (UniqueName: \"kubernetes.io/projected/3a82d087-5919-461e-aa24-f6604861f5a0-kube-api-access-wkq8c\") pod \"ovnkube-node-6thp5\" (UID: \"3a82d087-5919-461e-aa24-f6604861f5a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:58.950241 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:58.950222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jml\" (UniqueName: \"kubernetes.io/projected/bcbd9791-8390-49eb-93fc-07ed4cf48d2a-kube-api-access-f7jml\") pod \"tuned-wvpxd\" (UID: \"bcbd9791-8390-49eb-93fc-07ed4cf48d2a\") " pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:59.004289 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.004254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klcd4"
Sep 07 12:52:59.013755 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.013716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bhpj9"
Sep 07 12:52:59.028704 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.028673    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn"
Sep 07 12:52:59.032513 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.032485    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wvpxd"
Sep 07 12:52:59.040897 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.040864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qq82"
Sep 07 12:52:59.049888 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.049863    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mpzz"
Sep 07 12:52:59.057065 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.057043    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:52:59.065095 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.065060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-79wct"
Sep 07 12:52:59.073029 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.073003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:52:59.420663 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.420555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:52:59.420833 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.420679    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:59.420833 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.420816    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:52:59.420960 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.420886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:53:00.420865072 +0000 UTC m=+4.127648009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:52:59.421212 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.421169    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:52:59.421311 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.421248    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:53:00.421228024 +0000 UTC m=+4.128010957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:52:59.521830 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.521791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:52:59.522017 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.521954    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:52:59.522017 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.521978    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:52:59.522017 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.521991    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:52:59.522198 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.522052    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:53:00.522036187 +0000 UTC m=+4.228819125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:52:59.709221 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.709189    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d623df_b993_4763_a319_ca5100e6c226.slice/crio-05d769f74efa1bc11093478f4b74882ef2892680807f8d7d9679a10d9b2e6356 WatchSource:0}: Error finding container 05d769f74efa1bc11093478f4b74882ef2892680807f8d7d9679a10d9b2e6356: Status 404 returned error can't find the container with id 05d769f74efa1bc11093478f4b74882ef2892680807f8d7d9679a10d9b2e6356
Sep 07 12:52:59.719442 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.719414    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b65b81_dba1_4cd4_89f6_d8607316143a.slice/crio-b2f418eaa2947b0c85671d67f8e26505d70a60b43313d0074e329c0c39439113 WatchSource:0}: Error finding container b2f418eaa2947b0c85671d67f8e26505d70a60b43313d0074e329c0c39439113: Status 404 returned error can't find the container with id b2f418eaa2947b0c85671d67f8e26505d70a60b43313d0074e329c0c39439113
Sep 07 12:52:59.720084 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.720064    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e17033_4831_4988_b2b0_7416a4f435b5.slice/crio-b227e32d0af0efad0eb2eafe79a82b18e580dd1059220a037141e0d773dfdacd WatchSource:0}: Error finding container b227e32d0af0efad0eb2eafe79a82b18e580dd1059220a037141e0d773dfdacd: Status 404 returned error can't find the container with id b227e32d0af0efad0eb2eafe79a82b18e580dd1059220a037141e0d773dfdacd
Sep 07 12:52:59.721817 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.721745    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a82d087_5919_461e_aa24_f6604861f5a0.slice/crio-e0ae7b9a1c3b09e657178212f5c5e87a43ce2aa990b90ddbcced71b6067d218b WatchSource:0}: Error finding container e0ae7b9a1c3b09e657178212f5c5e87a43ce2aa990b90ddbcced71b6067d218b: Status 404 returned error can't find the container with id e0ae7b9a1c3b09e657178212f5c5e87a43ce2aa990b90ddbcced71b6067d218b
Sep 07 12:52:59.722601 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.722574    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17c6c58_0175_4877_a5d8_a1aaf9681d66.slice/crio-1a96f70faf60daa5d0c6abd975fd6f58a44423db9f9893e3848c9caea8f02645 WatchSource:0}: Error finding container 1a96f70faf60daa5d0c6abd975fd6f58a44423db9f9893e3848c9caea8f02645: Status 404 returned error can't find the container with id 1a96f70faf60daa5d0c6abd975fd6f58a44423db9f9893e3848c9caea8f02645
Sep 07 12:52:59.723414 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.723380    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff243e6_064c_4925_ad5a_4781c721a45b.slice/crio-ff61151eea5dd03d34076f79a45b2e86cfea865a73bf5464f79275247880c916 WatchSource:0}: Error finding container ff61151eea5dd03d34076f79a45b2e86cfea865a73bf5464f79275247880c916: Status 404 returned error can't find the container with id ff61151eea5dd03d34076f79a45b2e86cfea865a73bf5464f79275247880c916
Sep 07 12:52:59.726168 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.726071    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b512fc_c3b0_4a78_82eb_795aa3e2576d.slice/crio-bc7e08c5fc1d1cc453dcdd217c47b02acbfbe0e2efe1bb93f919270ee35a7184 WatchSource:0}: Error finding container bc7e08c5fc1d1cc453dcdd217c47b02acbfbe0e2efe1bb93f919270ee35a7184: Status 404 returned error can't find the container with id bc7e08c5fc1d1cc453dcdd217c47b02acbfbe0e2efe1bb93f919270ee35a7184
Sep 07 12:52:59.726276 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.726258    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759be7ca_493b_459c_961d_3ca2517f2807.slice/crio-9b5753d95e3423e76912bce818525d0a4a41186bef9230ce405645730c18d4ba WatchSource:0}: Error finding container 9b5753d95e3423e76912bce818525d0a4a41186bef9230ce405645730c18d4ba: Status 404 returned error can't find the container with id 9b5753d95e3423e76912bce818525d0a4a41186bef9230ce405645730c18d4ba
Sep 07 12:52:59.750254 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:52:59.750227    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbd9791_8390_49eb_93fc_07ed4cf48d2a.slice/crio-dc0aa0d19ed67d489a093ca664cd9f660e17c0a0346463e9db2b49fed22d6577 WatchSource:0}: Error finding container dc0aa0d19ed67d489a093ca664cd9f660e17c0a0346463e9db2b49fed22d6577: Status 404 returned error can't find the container with id dc0aa0d19ed67d489a093ca664cd9f660e17c0a0346463e9db2b49fed22d6577
Sep 07 12:52:59.756572 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.756524    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:47:59 +0000 UTC" deadline="2028-04-15 11:19:26.498553139 +0000 UTC"
Sep 07 12:52:59.756572 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.756570    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14062h26m26.741986243s"
Sep 07 12:52:59.808954 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.808926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:52:59.809081 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.808926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:52:59.809081 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.809047    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:52:59.809160 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:52:59.809110    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:52:59.822101 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.822067    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhpj9" event={"ID":"99b512fc-c3b0-4a78-82eb-795aa3e2576d","Type":"ContainerStarted","Data":"bc7e08c5fc1d1cc453dcdd217c47b02acbfbe0e2efe1bb93f919270ee35a7184"}
Sep 07 12:52:59.823322 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.823300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"e0ae7b9a1c3b09e657178212f5c5e87a43ce2aa990b90ddbcced71b6067d218b"}
Sep 07 12:52:59.824469 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.824446    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerStarted","Data":"05d769f74efa1bc11093478f4b74882ef2892680807f8d7d9679a10d9b2e6356"}
Sep 07 12:52:59.825540 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.825514    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wq8zl" event={"ID":"759be7ca-493b-459c-961d-3ca2517f2807","Type":"ContainerStarted","Data":"9b5753d95e3423e76912bce818525d0a4a41186bef9230ce405645730c18d4ba"}
Sep 07 12:52:59.826632 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.826611    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn" event={"ID":"9ff243e6-064c-4925-ad5a-4781c721a45b","Type":"ContainerStarted","Data":"ff61151eea5dd03d34076f79a45b2e86cfea865a73bf5464f79275247880c916"}
Sep 07 12:52:59.827721 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.827701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qq82" event={"ID":"e17c6c58-0175-4877-a5d8-a1aaf9681d66","Type":"ContainerStarted","Data":"1a96f70faf60daa5d0c6abd975fd6f58a44423db9f9893e3848c9caea8f02645"}
Sep 07 12:52:59.828882 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.828859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-79wct" event={"ID":"d4e17033-4831-4988-b2b0-7416a4f435b5","Type":"ContainerStarted","Data":"b227e32d0af0efad0eb2eafe79a82b18e580dd1059220a037141e0d773dfdacd"}
Sep 07 12:52:59.830311 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.829911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mpzz" event={"ID":"b0b65b81-dba1-4cd4-89f6-d8607316143a","Type":"ContainerStarted","Data":"b2f418eaa2947b0c85671d67f8e26505d70a60b43313d0074e329c0c39439113"}
Sep 07 12:52:59.831173 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:52:59.831149    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvpxd" event={"ID":"bcbd9791-8390-49eb-93fc-07ed4cf48d2a","Type":"ContainerStarted","Data":"dc0aa0d19ed67d489a093ca664cd9f660e17c0a0346463e9db2b49fed22d6577"}
Sep 07 12:53:00.429825 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.429772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:00.430027 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.429853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:00.430088 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.430049    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:00.430145 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.430121    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:53:02.430100551 +0000 UTC m=+6.136883478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:00.430687 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.430661    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:00.430872 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.430726    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:53:02.430710388 +0000 UTC m=+6.137493316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:00.530717 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.530668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:00.530917 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.530853    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:53:00.530917 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.530875    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:53:00.530917 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.530887    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:00.531065 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.530952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:53:02.530933016 +0000 UTC m=+6.237715951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:00.756937 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.756841    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:47:59 +0000 UTC" deadline="2028-06-14 06:01:09.827810074 +0000 UTC"
Sep 07 12:53:00.756937 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.756882    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15497h8m9.070933296s"
Sep 07 12:53:00.811804 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.811768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:00.811973 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:00.811926    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:00.845207 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:00.845170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" event={"ID":"a7db37ffbd7e75f97328ea72fd34d53c","Type":"ContainerStarted","Data":"7746a243505f97ac9319ddc53806abc986c127a74fa3fdb6f15b915e29fc9a00"}
Sep 07 12:53:01.808612 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:01.808521    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:01.809354 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:01.808686    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:01.809354 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:01.808520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:01.809354 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:01.808891    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:02.448216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:02.448314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.448463    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.448528    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:53:06.448508 +0000 UTC m=+10.155290915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.448992    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:02.449082 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.449051    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:53:06.449034106 +0000 UTC m=+10.155817021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:02.548737 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:02.548694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:02.548940 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.548867    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:53:02.548940 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.548893    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:53:02.548940 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.548906    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:02.549106 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.548967    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:53:06.548948128 +0000 UTC m=+10.255731057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:02.808609 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:02.808483    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:02.809077 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:02.808680    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:03.809749 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:03.809198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:03.809749 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:03.809352    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:03.809749 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:03.809198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:03.810378 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:03.809774    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:04.808841 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:04.808799    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:04.809040 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:04.808978    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:05.809231 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:05.809185    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:05.809231 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:05.809231    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:05.809878 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:05.809335    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:05.809878 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:05.809440    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:06.486348 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:06.486306    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:06.486546 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:06.486414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:06.486546 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.486537    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:06.486674 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.486602    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:53:14.486583158 +0000 UTC m=+18.193366082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:06.487122 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.487027    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:06.487122 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.487081    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:53:14.487064975 +0000 UTC m=+18.193847898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:06.587149 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:06.587114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:06.587330 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.587270    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:53:06.587330 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.587290    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:53:06.587330 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.587302    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:06.587494 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.587367    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:53:14.587349213 +0000 UTC m=+18.294132145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:06.809254 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:06.809171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:06.809782 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:06.809327    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:07.808963 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:07.808928    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:07.809170 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:07.809050    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:07.809440 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:07.809421    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:07.809863 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:07.809518    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:08.808522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:08.808488    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:08.808722 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:08.808645    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:09.809137 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:09.809101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:09.809560 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:09.809106    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:09.809560 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:09.809218    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:09.809560 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:09.809279    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:10.809154 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:10.809119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:10.809544 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:10.809252    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:11.808728 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:11.808690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:11.808728 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:11.808716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:11.808954 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:11.808816    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:11.808954 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:11.808924    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:12.809349 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:12.809311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:12.809840 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:12.809463    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:13.808492 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:13.808456    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:13.808492 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:13.808495    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:13.808803 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:13.808592    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:13.808803 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:13.808744    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:14.551391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:14.551358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:14.551798 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:14.551454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:14.551798 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.551531    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:14.551798 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.551602    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:53:30.55158348 +0000 UTC m=+34.258366405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:14.551798 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.551529    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:14.551992 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.551886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:53:30.551861621 +0000 UTC m=+34.258644546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:14.651825 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:14.651784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:14.651986 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.651928    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:53:14.651986 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.651957    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:53:14.651986 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.651970    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:14.652094 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.652037    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:53:30.652021613 +0000 UTC m=+34.358804539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:14.808970 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:14.808881    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:14.809139 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:14.809033    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:15.808987 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:15.808948    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:15.808987 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:15.808971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:15.809481 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:15.809069    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:15.809481 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:15.809189    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:16.809637 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:16.809593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:16.810056 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:16.809738    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:17.808353 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:17.808321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:17.808502 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:17.808326    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:17.808502 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:17.808440    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:17.808639 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:17.808494    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:18.809123 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.808874    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:18.809715 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:18.809241    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:18.886194 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.886158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-79wct" event={"ID":"d4e17033-4831-4988-b2b0-7416a4f435b5","Type":"ContainerStarted","Data":"ea305a1fb7992b10939fc98d7b12cf7597d75c2767d6a709f5b01183a5ffdced"}
Sep 07 12:53:18.887957 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.887931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mpzz" event={"ID":"b0b65b81-dba1-4cd4-89f6-d8607316143a","Type":"ContainerStarted","Data":"7617ca485d2d9bd80cfb62a3e2a986b00cb58b40a6e19b569f295a969cd55b31"}
Sep 07 12:53:18.889721 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.889690    2570 generic.go:356] "Generic (PLEG): container finished" podID="71351fc077680266fe6e92bedaf6462e" containerID="a8072a35dda53da850d85e11306a41b07efcb2bbe538ce9183aa2297f0cb4dca" exitCode=0
Sep 07 12:53:18.889819 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.889734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"71351fc077680266fe6e92bedaf6462e","Type":"ContainerDied","Data":"a8072a35dda53da850d85e11306a41b07efcb2bbe538ce9183aa2297f0cb4dca"}
Sep 07 12:53:18.891553 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.891529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wvpxd" event={"ID":"bcbd9791-8390-49eb-93fc-07ed4cf48d2a","Type":"ContainerStarted","Data":"4f1d505c07183fa333079a67490e1d6f3b6e454584743bcf54abac1f82edc0f9"}
Sep 07 12:53:18.895226 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"ddd0894ba110140222b2b7313abdd664c79a6456e6f21d0adf886813e6cb5d16"}
Sep 07 12:53:18.895344 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"e29e458eaef978a8b3bb07a8a61fca364e1f367e361be7a4cba8e3acdacfc492"}
Sep 07 12:53:18.895344 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"045dc86d0800a09fa9e826d19c5f8a17fee7ab052089ba328eba1d2d385695ae"}
Sep 07 12:53:18.895503 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"2d79554bd73119f6eb6abbccfff9ca91088222e6d422a13efbcd51b49daaa66c"}
Sep 07 12:53:18.895503 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"945317f13dee0d39956cc8499e2dac9c2834c8e950ddc890210d5696263912da"}
Sep 07 12:53:18.895503 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.895437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"62ce8a94f67be122408b341d4b70f44055eaf693c5d77a31829ae74518816068"}
Sep 07 12:53:18.897018 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.896994    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="ac193b34754292e4d5695e8c7084bbb63a6ee6691b59fc98b6c67980cca41239" exitCode=0
Sep 07 12:53:18.897110 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.897086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"ac193b34754292e4d5695e8c7084bbb63a6ee6691b59fc98b6c67980cca41239"}
Sep 07 12:53:18.899242 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.899211    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wq8zl" event={"ID":"759be7ca-493b-459c-961d-3ca2517f2807","Type":"ContainerStarted","Data":"72ac11fbfc85e2f3be354758628e102f4ac2e52a3b96d1b13aa09d141948923e"}
Sep 07 12:53:18.901578 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.901549    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn" event={"ID":"9ff243e6-064c-4925-ad5a-4781c721a45b","Type":"ContainerStarted","Data":"79ed822ca6228e61ad6ee1343bf59614dcade07fcf22501cdcfcb168f8449d30"}
Sep 07 12:53:18.908077 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.908052    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qq82" event={"ID":"e17c6c58-0175-4877-a5d8-a1aaf9681d66","Type":"ContainerStarted","Data":"e31fad6494b65d4a52d91858f57e8b90aab91789c61f41ee3beafe1047544a7c"}
Sep 07 12:53:18.914740 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.914684    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" podStartSLOduration=20.914666769 podStartE2EDuration="20.914666769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:00.865320412 +0000 UTC m=+4.572103349" watchObservedRunningTime="2026-09-07 12:53:18.914666769 +0000 UTC m=+22.621449729"
Sep 07 12:53:18.915106 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.915070    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-79wct" podStartSLOduration=3.777207018 podStartE2EDuration="21.915059787s" totalImagesPullingTime="18.137852769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:18.914183665 +0000 UTC m=+22.620966598" watchObservedRunningTime="2026-09-07 12:53:18.915059787 +0000 UTC m=+22.621842720"
Sep 07 12:53:18.935102 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.935049    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wq8zl" podStartSLOduration=10.960426565 podStartE2EDuration="21.935030489s" totalImagesPullingTime="10.974603924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:18.934978175 +0000 UTC m=+22.641761108" watchObservedRunningTime="2026-09-07 12:53:18.935030489 +0000 UTC m=+22.641813446"
Sep 07 12:53:18.999591 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:18.999539    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qq82" podStartSLOduration=12.881824072 podStartE2EDuration="21.999522806s" totalImagesPullingTime="9.117698734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:18.998754169 +0000 UTC m=+22.705537102" watchObservedRunningTime="2026-09-07 12:53:18.999522806 +0000 UTC m=+22.706305738"
Sep 07 12:53:19.036653 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.036592    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wvpxd" podStartSLOduration=3.9733501479999997 podStartE2EDuration="22.036575896s" totalImagesPullingTime="18.063225748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:19.036479401 +0000 UTC m=+22.743262358" watchObservedRunningTime="2026-09-07 12:53:19.036575896 +0000 UTC m=+22.743358829"
Sep 07 12:53:19.054394 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.054353    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2mpzz" podStartSLOduration=3.957880939 podStartE2EDuration="22.054339377s" totalImagesPullingTime="18.096458438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:19.053903362 +0000 UTC m=+22.760686295" watchObservedRunningTime="2026-09-07 12:53:19.054339377 +0000 UTC m=+22.761122319"
Sep 07 12:53:19.374028 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.373847    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 12:53:19.729595 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.729563    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:53:19.730299 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.730274    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:53:19.779563 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.779459    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:53:19.374021023Z","UUID":"c33adb2d-df8f-4451-bbcf-d21925668b82","Handler":null,"Name":"","Endpoint":""}
Sep 07 12:53:19.781020 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.780998    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 12:53:19.781115 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.781026    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 12:53:19.808854 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.808822    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:19.808854 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.808851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:19.809025 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:19.808918    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:19.809025 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:19.808969    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:19.912568 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.912530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn" event={"ID":"9ff243e6-064c-4925-ad5a-4781c721a45b","Type":"ContainerStarted","Data":"150daba1e6fa50b783b56eb5b758dcd7aac542506796148831c5475c8ac2d443"}
Sep 07 12:53:19.914988 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.914958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"71351fc077680266fe6e92bedaf6462e","Type":"ContainerStarted","Data":"cfffe6902134f360dfcd12239ad96e721600b98aa20befdac3c416c030af8c3d"}
Sep 07 12:53:19.916908 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.916880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bhpj9" event={"ID":"99b512fc-c3b0-4a78-82eb-795aa3e2576d","Type":"ContainerStarted","Data":"488fd99c185158683d07942607c82151c5f8675a70c5bc6104d62978185cc0fe"}
Sep 07 12:53:19.917524 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.917502    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:53:19.918114 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.918095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wq8zl"
Sep 07 12:53:19.934537 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.934485    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" podStartSLOduration=21.934462045 podStartE2EDuration="21.934462045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:19.933736369 +0000 UTC m=+23.640519300" watchObservedRunningTime="2026-09-07 12:53:19.934462045 +0000 UTC m=+23.641244978"
Sep 07 12:53:19.952638 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:19.952565    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bhpj9" podStartSLOduration=8.183114135 podStartE2EDuration="22.952546171s" totalImagesPullingTime="14.769432036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:19.951752333 +0000 UTC m=+23.658535291" watchObservedRunningTime="2026-09-07 12:53:19.952546171 +0000 UTC m=+23.659329107"
Sep 07 12:53:20.809246 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:20.809208    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:20.809422 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:20.809355    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:20.923080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:20.923039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"4ef3413c26e59a23807dbe1a29807ffc698e89ee2511c02449b0e3e2788b56a2"}
Sep 07 12:53:20.925478 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:20.925444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn" event={"ID":"9ff243e6-064c-4925-ad5a-4781c721a45b","Type":"ContainerStarted","Data":"3094c7cade9a7b8ad4a2a7aaa8ffda455cf3c6d554b505251c3267e3f57b0d0f"}
Sep 07 12:53:20.948427 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:20.948371    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q25sn" podStartSLOduration=3.877772884 podStartE2EDuration="23.948350471s" totalImagesPullingTime="20.070577587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:20.947431323 +0000 UTC m=+24.654214258" watchObservedRunningTime="2026-09-07 12:53:20.948350471 +0000 UTC m=+24.655133405"
Sep 07 12:53:21.809321 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:21.809283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:21.809321 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:21.809312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:21.809568 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:21.809411    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:21.809647 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:21.809537    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:22.808611 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:22.808577    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:22.809063 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:22.808728    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:23.808955 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.808721    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:23.809339 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.808769    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:23.809339 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:23.808977    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:23.809435 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:23.809281    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:23.937080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.937043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" event={"ID":"3a82d087-5919-461e-aa24-f6604861f5a0","Type":"ContainerStarted","Data":"c7dfde04ace08cce38dc2a2c53ec0adda1640c75f5a53a0840cdcd38f7ea38f6"}
Sep 07 12:53:23.937290 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.937273    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:23.941208 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.941180    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="8647b48177d371080408a530f49a4f6a8cacb002e90a81f67cb7aa6d1deac8c0" exitCode=0
Sep 07 12:53:23.941336 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.941233    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"8647b48177d371080408a530f49a4f6a8cacb002e90a81f67cb7aa6d1deac8c0"}
Sep 07 12:53:23.954465 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.954443    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:23.976069 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:23.976020    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5" podStartSLOduration=8.786844025 podStartE2EDuration="26.976004229s" totalImagesPullingTime="18.189160204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:23.975615566 +0000 UTC m=+27.682398509" watchObservedRunningTime="2026-09-07 12:53:23.976004229 +0000 UTC m=+27.682787160"
Sep 07 12:53:24.808484 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:24.808453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:24.808695 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:24.808571    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:24.944696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:24.944665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:24.945474 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:24.944762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:24.962807 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:24.962777    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:25.316954 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.316696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7xn2"]
Sep 07 12:53:25.317157 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.317125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:25.317284 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:25.317259    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:25.324936 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.324898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmwn8"]
Sep 07 12:53:25.325040 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.325032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:25.325166 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:25.325143    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:25.325730 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.325708    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22pgn"]
Sep 07 12:53:25.325824 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.325796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:25.325875 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:25.325862    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:25.948167 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.948112    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="4cddae70c6720358bb713e460d2df82d3ce88df26d679b096da4db5b7ef97422" exitCode=0
Sep 07 12:53:25.948766 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:25.948248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"4cddae70c6720358bb713e460d2df82d3ce88df26d679b096da4db5b7ef97422"}
Sep 07 12:53:26.809230 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:26.809200    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:26.809425 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:26.809317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:26.809425 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:26.809317    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:26.809425 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:26.809389    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:26.809425 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:26.809414    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:26.809682 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:26.809551    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:28.808636 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:28.808595    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:28.809057 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:28.808596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:28.809057 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:28.808719    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmwn8" podUID="1b9cb6cd-dca1-4112-ad42-705957ad1b2d"
Sep 07 12:53:28.809057 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:28.808596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:28.809057 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:28.808798    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22pgn" podUID="67863efb-6457-47e6-9c0e-8c8946263e6e"
Sep 07 12:53:28.809057 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:28.808893    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7xn2" podUID="c1f095db-c08f-4dcc-82d8-05eeeb68fdbd"
Sep 07 12:53:28.956877 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:28.956794    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="2b778d30d6abc563f48ed94360d1b48feace9dada5048a3b5edc6dfaf8c8b2fc" exitCode=0
Sep 07 12:53:28.956877 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:28.956833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"2b778d30d6abc563f48ed94360d1b48feace9dada5048a3b5edc6dfaf8c8b2fc"}
Sep 07 12:53:30.569068 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.569033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:30.569457 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.569092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:30.569457 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.569174    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:30.569457 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.569176    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:30.569457 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.569223    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret podName:67863efb-6457-47e6-9c0e-8c8946263e6e nodeName:}" failed. No retries permitted until 2026-09-07 12:54:02.569210805 +0000 UTC m=+66.275993728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret") pod "global-pull-secret-syncer-22pgn" (UID: "67863efb-6457-47e6-9c0e-8c8946263e6e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:53:30.569457 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.569235    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs podName:c1f095db-c08f-4dcc-82d8-05eeeb68fdbd nodeName:}" failed. No retries permitted until 2026-09-07 12:54:02.569229353 +0000 UTC m=+66.276012263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs") pod "network-metrics-daemon-l7xn2" (UID: "c1f095db-c08f-4dcc-82d8-05eeeb68fdbd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:53:30.623770 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.623704    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeReady"
Sep 07 12:53:30.623900 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.623816    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 12:53:30.669467 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.669423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:30.669615 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.669583    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:53:30.669615 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.669601    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:53:30.669615 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.669610    2570 projected.go:196] Error preparing data for projected volume kube-api-access-j5xpk for pod openshift-network-diagnostics/network-check-target-dmwn8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:30.669742 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.669698    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk podName:1b9cb6cd-dca1-4112-ad42-705957ad1b2d nodeName:}" failed. No retries permitted until 2026-09-07 12:54:02.669683766 +0000 UTC m=+66.376466677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5xpk" (UniqueName: "kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk") pod "network-check-target-dmwn8" (UID: "1b9cb6cd-dca1-4112-ad42-705957ad1b2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:53:30.672242 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.672216    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:53:30.693727 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.693699    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kf7tv"]
Sep 07 12:53:30.693895 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.693846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.700237 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.700091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 12:53:30.700237 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.700153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v9hr7\""
Sep 07 12:53:30.700434 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.700256    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 12:53:30.700779 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.700608    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 12:53:30.707774 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.707741    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 12:53:30.715895 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.715860    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8r85k"]
Sep 07 12:53:30.716034 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.716003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.718763 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.718736    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 12:53:30.719481 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.719456    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8c6z8\""
Sep 07 12:53:30.719635 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.719599    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 12:53:30.739485 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.739454    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:53:30.739699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.739504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kf7tv"]
Sep 07 12:53:30.739699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.739531    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8r85k"]
Sep 07 12:53:30.739699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.739552    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbkp9"]
Sep 07 12:53:30.739699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.739568    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.742590 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.742563    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 12:53:30.742719 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.742661    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 12:53:30.742719 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.742712    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j64n2\""
Sep 07 12:53:30.742791 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.742563    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 12:53:30.756073 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.756047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbkp9"]
Sep 07 12:53:30.756209 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.756131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.758825 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.758804    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 12:53:30.758932 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.758835    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 12:53:30.758932 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.758881    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 12:53:30.758932 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.758891    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 12:53:30.759215 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.759200    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6fwj5\""
Sep 07 12:53:30.770510 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770674 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770674 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770674 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktkgx\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770911 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.770961 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.770923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.812130 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.812101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:53:30.812313 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.812143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:53:30.812313 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.812142    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:53:30.815198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815049    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 12:53:30.815198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815058    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 12:53:30.815198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815112    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xfxxc\""
Sep 07 12:53:30.815198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815156    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 12:53:30.815198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815056    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 12:53:30.815488 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.815052    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnfpv\""
Sep 07 12:53:30.871567 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82773765-3fff-4079-b3cd-d5a3973942d2-cert\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1194d574-de67-4aa2-af13-d311c8385489-crio-socket\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75982892-57de-4ad8-8a45-07e6ed6c6835-tmp-dir\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgdn\" (UniqueName: \"kubernetes.io/projected/75982892-57de-4ad8-8a45-07e6ed6c6835-kube-api-access-zwgdn\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.871771 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktkgx\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1194d574-de67-4aa2-af13-d311c8385489-data-volume\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9c9v\" (UniqueName: \"kubernetes.io/projected/1194d574-de67-4aa2-af13-d311c8385489-kube-api-access-t9c9v\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.871890    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75982892-57de-4ad8-8a45-07e6ed6c6835-config-volume\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.872078 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872410 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872117    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.872410 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.872149    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 12:53:30.872410 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.872167    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b77d756-gjgkq: secret "image-registry-tls" not found
Sep 07 12:53:30.872410 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872410 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.872238    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls podName:e8c899f9-07e8-4c2e-9f2b-a9311461a83f nodeName:}" failed. No retries permitted until 2026-09-07 12:53:31.372216616 +0000 UTC m=+35.078999543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls") pod "image-registry-5f4b77d756-gjgkq" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f") : secret "image-registry-tls" not found
Sep 07 12:53:30.872680 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872680 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872680 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nh66\" (UniqueName: \"kubernetes.io/projected/82773765-3fff-4079-b3cd-d5a3973942d2-kube-api-access-2nh66\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.872680 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.872874 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.872874 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.872788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.877324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.877138    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.877324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.877165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.887190 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.887157    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.887335 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.887265    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktkgx\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:30.973052 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973016    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1194d574-de67-4aa2-af13-d311c8385489-data-volume\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973260 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973168    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:30.973260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9c9v\" (UniqueName: \"kubernetes.io/projected/1194d574-de67-4aa2-af13-d311c8385489-kube-api-access-t9c9v\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75982892-57de-4ad8-8a45-07e6ed6c6835-config-volume\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.973260 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973255    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:31.473235014 +0000 UTC m=+35.180017926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nh66\" (UniqueName: \"kubernetes.io/projected/82773765-3fff-4079-b3cd-d5a3973942d2-kube-api-access-2nh66\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973388    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1194d574-de67-4aa2-af13-d311c8385489-data-volume\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82773765-3fff-4079-b3cd-d5a3973942d2-cert\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1194d574-de67-4aa2-af13-d311c8385489-crio-socket\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75982892-57de-4ad8-8a45-07e6ed6c6835-tmp-dir\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.973543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgdn\" (UniqueName: \"kubernetes.io/projected/75982892-57de-4ad8-8a45-07e6ed6c6835-kube-api-access-zwgdn\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.974031 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973552    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 12:53:30.974031 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973601    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls podName:75982892-57de-4ad8-8a45-07e6ed6c6835 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:31.473589685 +0000 UTC m=+35.180372608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls") pod "dns-default-kf7tv" (UID: "75982892-57de-4ad8-8a45-07e6ed6c6835") : secret "dns-default-metrics-tls" not found
Sep 07 12:53:30.974031 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973772    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 12:53:30.974031 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:30.973821    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:31.473808036 +0000 UTC m=+35.180590947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : configmap "kube-rbac-proxy" not found
Sep 07 12:53:30.974031 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.973831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75982892-57de-4ad8-8a45-07e6ed6c6835-config-volume\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.974373 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.974044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75982892-57de-4ad8-8a45-07e6ed6c6835-tmp-dir\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.974373 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.974057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1194d574-de67-4aa2-af13-d311c8385489-crio-socket\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.976481 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.976460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82773765-3fff-4079-b3cd-d5a3973942d2-cert\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:30.984707 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.984677    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgdn\" (UniqueName: \"kubernetes.io/projected/75982892-57de-4ad8-8a45-07e6ed6c6835-kube-api-access-zwgdn\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:30.985025 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.985006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9c9v\" (UniqueName: \"kubernetes.io/projected/1194d574-de67-4aa2-af13-d311c8385489-kube-api-access-t9c9v\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:30.985292 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:30.985270    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nh66\" (UniqueName: \"kubernetes.io/projected/82773765-3fff-4079-b3cd-d5a3973942d2-kube-api-access-2nh66\") pod \"ingress-canary-8r85k\" (UID: \"82773765-3fff-4079-b3cd-d5a3973942d2\") " pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:31.050906 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.050865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8r85k"
Sep 07 12:53:31.377258 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.377226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:31.377445 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.377404    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 12:53:31.377445 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.377424    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b77d756-gjgkq: secret "image-registry-tls" not found
Sep 07 12:53:31.377540 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.377518    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls podName:e8c899f9-07e8-4c2e-9f2b-a9311461a83f nodeName:}" failed. No retries permitted until 2026-09-07 12:53:32.377489167 +0000 UTC m=+36.084272096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls") pod "image-registry-5f4b77d756-gjgkq" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f") : secret "image-registry-tls" not found
Sep 07 12:53:31.393176 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.393102    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8r85k"]
Sep 07 12:53:31.397814 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:31.397778    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82773765_3fff_4079_b3cd_d5a3973942d2.slice/crio-b0a8167aa93af6ae5d468e096eb5b0dbd458b728f29781d350e1ed2fce620aee WatchSource:0}: Error finding container b0a8167aa93af6ae5d468e096eb5b0dbd458b728f29781d350e1ed2fce620aee: Status 404 returned error can't find the container with id b0a8167aa93af6ae5d468e096eb5b0dbd458b728f29781d350e1ed2fce620aee
Sep 07 12:53:31.478196 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.478113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:31.478375 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478262    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 12:53:31.478375 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.478289    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:31.478375 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.478322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:31.478375 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478368    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:32.478354192 +0000 UTC m=+36.185137102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : configmap "kube-rbac-proxy" not found
Sep 07 12:53:31.478573 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478425    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:31.478573 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478435    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 12:53:31.478573 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478475    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:32.47846423 +0000 UTC m=+36.185247141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:31.478573 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:31.478489    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls podName:75982892-57de-4ad8-8a45-07e6ed6c6835 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:32.47848299 +0000 UTC m=+36.185265900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls") pod "dns-default-kf7tv" (UID: "75982892-57de-4ad8-8a45-07e6ed6c6835") : secret "dns-default-metrics-tls" not found
Sep 07 12:53:31.967329 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:31.967287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8r85k" event={"ID":"82773765-3fff-4079-b3cd-d5a3973942d2","Type":"ContainerStarted","Data":"b0a8167aa93af6ae5d468e096eb5b0dbd458b728f29781d350e1ed2fce620aee"}
Sep 07 12:53:32.168547 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.168515    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qq82_e17c6c58-0175-4877-a5d8-a1aaf9681d66/dns-node-resolver/0.log"
Sep 07 12:53:32.386315 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.386215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:32.386494 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.386381    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 12:53:32.386494 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.386403    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b77d756-gjgkq: secret "image-registry-tls" not found
Sep 07 12:53:32.386494 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.386457    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls podName:e8c899f9-07e8-4c2e-9f2b-a9311461a83f nodeName:}" failed. No retries permitted until 2026-09-07 12:53:34.38644121 +0000 UTC m=+38.093224132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls") pod "image-registry-5f4b77d756-gjgkq" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f") : secret "image-registry-tls" not found
Sep 07 12:53:32.403230 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.403197    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-sphdq"]
Sep 07 12:53:32.420576 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.420547    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.424759 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.424728    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-sphdq"]
Sep 07 12:53:32.427170 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.427147    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 07 12:53:32.427291 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.427196    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lpjp2\""
Sep 07 12:53:32.428363 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.428055    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 07 12:53:32.428363 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.428131    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 07 12:53:32.428953 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.428784    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 07 12:53:32.486945 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.486906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:32.486945 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.486955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.486984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-key\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.487033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.487070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfr7\" (UniqueName: \"kubernetes.io/projected/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-kube-api-access-gnfr7\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487102    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487136    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.487146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-cabundle\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487102    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 12:53:32.487177 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487174    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:34.487153016 +0000 UTC m=+38.193935940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:32.487534 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487203    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:34.487193317 +0000 UTC m=+38.193976232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : configmap "kube-rbac-proxy" not found
Sep 07 12:53:32.487534 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:32.487226    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls podName:75982892-57de-4ad8-8a45-07e6ed6c6835 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:34.487216957 +0000 UTC m=+38.193999873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls") pod "dns-default-kf7tv" (UID: "75982892-57de-4ad8-8a45-07e6ed6c6835") : secret "dns-default-metrics-tls" not found
Sep 07 12:53:32.587918 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.587871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfr7\" (UniqueName: \"kubernetes.io/projected/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-kube-api-access-gnfr7\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.588103 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.587953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-cabundle\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.588103 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.588018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-key\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.588859 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.588822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-cabundle\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.591330 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.591303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-signing-key\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.598144 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.598116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfr7\" (UniqueName: \"kubernetes.io/projected/3be67a2e-86c3-44ac-ae9b-8dd979643ea2-kube-api-access-gnfr7\") pod \"service-ca-75d99c484-sphdq\" (UID: \"3be67a2e-86c3-44ac-ae9b-8dd979643ea2\") " pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.733534 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.733495    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-sphdq"
Sep 07 12:53:32.947102 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:32.947071    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mpzz_b0b65b81-dba1-4cd4-89f6-d8607316143a/node-ca/0.log"
Sep 07 12:53:33.044095 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:33.044008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-sphdq"]
Sep 07 12:53:33.048299 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:33.048268    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be67a2e_86c3_44ac_ae9b_8dd979643ea2.slice/crio-c118444e7370e22fccc5648bd3bd1cfd11f5f0f6a6ad637deb57e197765952b6 WatchSource:0}: Error finding container c118444e7370e22fccc5648bd3bd1cfd11f5f0f6a6ad637deb57e197765952b6: Status 404 returned error can't find the container with id c118444e7370e22fccc5648bd3bd1cfd11f5f0f6a6ad637deb57e197765952b6
Sep 07 12:53:33.973748 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:33.973712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-sphdq" event={"ID":"3be67a2e-86c3-44ac-ae9b-8dd979643ea2","Type":"ContainerStarted","Data":"c118444e7370e22fccc5648bd3bd1cfd11f5f0f6a6ad637deb57e197765952b6"}
Sep 07 12:53:34.403580 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:34.403539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:34.403983 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.403751    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 12:53:34.403983 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.403776    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b77d756-gjgkq: secret "image-registry-tls" not found
Sep 07 12:53:34.403983 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.403846    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls podName:e8c899f9-07e8-4c2e-9f2b-a9311461a83f nodeName:}" failed. No retries permitted until 2026-09-07 12:53:38.403825528 +0000 UTC m=+42.110608446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls") pod "image-registry-5f4b77d756-gjgkq" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f") : secret "image-registry-tls" not found
Sep 07 12:53:34.504636 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:34.504581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:34.504809 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:34.504718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:34.504809 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:34.504747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:34.504809 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504753    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 12:53:34.504989 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504837    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:38.504814492 +0000 UTC m=+42.211597406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : configmap "kube-rbac-proxy" not found
Sep 07 12:53:34.504989 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504883    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 12:53:34.504989 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504938    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls podName:75982892-57de-4ad8-8a45-07e6ed6c6835 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:38.504922192 +0000 UTC m=+42.211705108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls") pod "dns-default-kf7tv" (UID: "75982892-57de-4ad8-8a45-07e6ed6c6835") : secret "dns-default-metrics-tls" not found
Sep 07 12:53:34.504989 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504885    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:34.504989 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:34.504983    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:38.504973227 +0000 UTC m=+42.211756152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:35.984102 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:35.983861    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerStarted","Data":"2857fa7768a7c7fc0427065c6b908103b9cadd12f7ae2a12fbd756aade9b5b09"}
Sep 07 12:53:35.986094 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:35.986050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8r85k" event={"ID":"82773765-3fff-4079-b3cd-d5a3973942d2","Type":"ContainerStarted","Data":"58a095aa90bcacff98da4937f780ce66711cfdc27e9f0468cedb6764228e9aec"}
Sep 07 12:53:36.004303 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:36.004058    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8r85k" podStartSLOduration=1.5836659640000001 podStartE2EDuration="6.004035982s" totalImagesPullingTime="4.420370018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:36.002941293 +0000 UTC m=+39.709724226" watchObservedRunningTime="2026-09-07 12:53:36.004035982 +0000 UTC m=+39.710818916"
Sep 07 12:53:36.991509 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:36.991468    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="2857fa7768a7c7fc0427065c6b908103b9cadd12f7ae2a12fbd756aade9b5b09" exitCode=0
Sep 07 12:53:36.991951 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:36.991555    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"2857fa7768a7c7fc0427065c6b908103b9cadd12f7ae2a12fbd756aade9b5b09"}
Sep 07 12:53:37.996997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:37.996962    2570 generic.go:356] "Generic (PLEG): container finished" podID="d4d623df-b993-4763-a319-ca5100e6c226" containerID="824566e62ce356e71120ef73bdfea2c0b3d6510b068f9ca8908a6971bf07fbc3" exitCode=0
Sep 07 12:53:37.997463 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:37.997048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerDied","Data":"824566e62ce356e71120ef73bdfea2c0b3d6510b068f9ca8908a6971bf07fbc3"}
Sep 07 12:53:37.998685 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:37.998657    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-sphdq" event={"ID":"3be67a2e-86c3-44ac-ae9b-8dd979643ea2","Type":"ContainerStarted","Data":"aa915c97031fd6f2fef95c822868883b88da9e4dbf3afb6eceb5ba852004b188"}
Sep 07 12:53:38.040634 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.040561    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-sphdq" podStartSLOduration=1.567928013 podStartE2EDuration="6.040537835s" totalImagesPullingTime="4.472609822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:38.038458633 +0000 UTC m=+41.745241565" watchObservedRunningTime="2026-09-07 12:53:38.040537835 +0000 UTC m=+41.747320768"
Sep 07 12:53:38.440255 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.440220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:38.440399 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.440372    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 12:53:38.440399 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.440389    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4b77d756-gjgkq: secret "image-registry-tls" not found
Sep 07 12:53:38.440488 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.440445    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls podName:e8c899f9-07e8-4c2e-9f2b-a9311461a83f nodeName:}" failed. No retries permitted until 2026-09-07 12:53:46.440428841 +0000 UTC m=+50.147211771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls") pod "image-registry-5f4b77d756-gjgkq" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f") : secret "image-registry-tls" not found
Sep 07 12:53:38.541079 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.541044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:38.541232 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.541085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:38.541232 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.541135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:38.541232 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.541200    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:38.541328 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.541261    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 12:53:38.541328 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.541273    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls podName:1194d574-de67-4aa2-af13-d311c8385489 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:46.541256977 +0000 UTC m=+50.248039887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbkp9" (UID: "1194d574-de67-4aa2-af13-d311c8385489") : secret "insights-runtime-extractor-tls" not found
Sep 07 12:53:38.541328 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:53:38.541310    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls podName:75982892-57de-4ad8-8a45-07e6ed6c6835 nodeName:}" failed. No retries permitted until 2026-09-07 12:53:46.54129707 +0000 UTC m=+50.248079984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls") pod "dns-default-kf7tv" (UID: "75982892-57de-4ad8-8a45-07e6ed6c6835") : secret "dns-default-metrics-tls" not found
Sep 07 12:53:38.541686 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:38.541671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1194d574-de67-4aa2-af13-d311c8385489-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:39.006398 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:39.006363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klcd4" event={"ID":"d4d623df-b993-4763-a319-ca5100e6c226","Type":"ContainerStarted","Data":"f1d79c7bad122239054ef4795808d07f26bc0826c0cd56f9207a0488517bca7e"}
Sep 07 12:53:39.036074 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:39.036011    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-klcd4" podStartSLOduration=9.016570912 podStartE2EDuration="42.035987938s" totalImagesPullingTime="33.019417026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:39.034768239 +0000 UTC m=+42.741551175" watchObservedRunningTime="2026-09-07 12:53:39.035987938 +0000 UTC m=+42.742770871"
Sep 07 12:53:46.507962 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.507913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:46.511033 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.511010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"image-registry-5f4b77d756-gjgkq\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") " pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:46.608949 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.608911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:46.608949 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.608952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:46.611284 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.611255    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1194d574-de67-4aa2-af13-d311c8385489-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbkp9\" (UID: \"1194d574-de67-4aa2-af13-d311c8385489\") " pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:46.611401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.611350    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75982892-57de-4ad8-8a45-07e6ed6c6835-metrics-tls\") pod \"dns-default-kf7tv\" (UID: \"75982892-57de-4ad8-8a45-07e6ed6c6835\") " pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:46.611401 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.611383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:46.626120 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.626004    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:46.666787 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.666715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbkp9"
Sep 07 12:53:46.891473 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.891396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:53:46.894215 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:46.894182    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c899f9_07e8_4c2e_9f2b_a9311461a83f.slice/crio-1b004ab4f422938ea25e2cd2e9454fd6d8f6509f90b4818add77611e79e3bad4 WatchSource:0}: Error finding container 1b004ab4f422938ea25e2cd2e9454fd6d8f6509f90b4818add77611e79e3bad4: Status 404 returned error can't find the container with id 1b004ab4f422938ea25e2cd2e9454fd6d8f6509f90b4818add77611e79e3bad4
Sep 07 12:53:46.907443 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.907414    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kf7tv"]
Sep 07 12:53:46.910316 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:46.910288    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75982892_57de_4ad8_8a45_07e6ed6c6835.slice/crio-d084a704a3284bc7a9282b1d841c82f7a430bca40ba40a2f1a11af16eb670f57 WatchSource:0}: Error finding container d084a704a3284bc7a9282b1d841c82f7a430bca40ba40a2f1a11af16eb670f57: Status 404 returned error can't find the container with id d084a704a3284bc7a9282b1d841c82f7a430bca40ba40a2f1a11af16eb670f57
Sep 07 12:53:46.958660 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:46.958613    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbkp9"]
Sep 07 12:53:46.962639 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:46.962601    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1194d574_de67_4aa2_af13_d311c8385489.slice/crio-da7402d26dcc272a182c6b7f21ef7a9c26490ddf99bec55b28f17ac2d3ea5515 WatchSource:0}: Error finding container da7402d26dcc272a182c6b7f21ef7a9c26490ddf99bec55b28f17ac2d3ea5515: Status 404 returned error can't find the container with id da7402d26dcc272a182c6b7f21ef7a9c26490ddf99bec55b28f17ac2d3ea5515
Sep 07 12:53:47.027704 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.027668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbkp9" event={"ID":"1194d574-de67-4aa2-af13-d311c8385489","Type":"ContainerStarted","Data":"4bbf34f6504afb37dc0c290133c2b8425ace97ee70e4f52a8bdeded0a0829ff3"}
Sep 07 12:53:47.027848 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.027731    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbkp9" event={"ID":"1194d574-de67-4aa2-af13-d311c8385489","Type":"ContainerStarted","Data":"da7402d26dcc272a182c6b7f21ef7a9c26490ddf99bec55b28f17ac2d3ea5515"}
Sep 07 12:53:47.029499 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.029469    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" event={"ID":"e8c899f9-07e8-4c2e-9f2b-a9311461a83f","Type":"ContainerStarted","Data":"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"}
Sep 07 12:53:47.029652 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.029520    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:53:47.029652 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.029542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" event={"ID":"e8c899f9-07e8-4c2e-9f2b-a9311461a83f","Type":"ContainerStarted","Data":"1b004ab4f422938ea25e2cd2e9454fd6d8f6509f90b4818add77611e79e3bad4"}
Sep 07 12:53:47.030800 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.030777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kf7tv" event={"ID":"75982892-57de-4ad8-8a45-07e6ed6c6835","Type":"ContainerStarted","Data":"d084a704a3284bc7a9282b1d841c82f7a430bca40ba40a2f1a11af16eb670f57"}
Sep 07 12:53:47.055692 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:47.055609    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" podStartSLOduration=33.055589939 podStartE2EDuration="33.055589939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:47.054955066 +0000 UTC m=+50.761737999" watchObservedRunningTime="2026-09-07 12:53:47.055589939 +0000 UTC m=+50.762372870"
Sep 07 12:53:48.036177 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:48.036095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbkp9" event={"ID":"1194d574-de67-4aa2-af13-d311c8385489","Type":"ContainerStarted","Data":"d742451b3141211180bfc0bcba1d1980f5a44ca9ae008d192a5b14fb472dd31d"}
Sep 07 12:53:50.043808 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.043773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kf7tv" event={"ID":"75982892-57de-4ad8-8a45-07e6ed6c6835","Type":"ContainerStarted","Data":"ec613e12df772db60589d5ef17b6cb3d9c8042292843e14ae4e4245b3ca29051"}
Sep 07 12:53:50.044236 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.043836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kf7tv" event={"ID":"75982892-57de-4ad8-8a45-07e6ed6c6835","Type":"ContainerStarted","Data":"4248a7737d4ce11d58bed6332a30fb50411813b41a434b931b90312168f83f1b"}
Sep 07 12:53:50.044236 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.043874    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:53:50.045933 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.045906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbkp9" event={"ID":"1194d574-de67-4aa2-af13-d311c8385489","Type":"ContainerStarted","Data":"2bd35ba209b1829278f46f012774f28c79d6ca05a20e94c57d3b10cb9c4cdd6a"}
Sep 07 12:53:50.068655 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.068585    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kf7tv" podStartSLOduration=17.875047739 podStartE2EDuration="20.068570118s" totalImagesPullingTime="2.193522379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:50.067330231 +0000 UTC m=+53.774113164" watchObservedRunningTime="2026-09-07 12:53:50.068570118 +0000 UTC m=+53.775353097"
Sep 07 12:53:50.087915 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:50.087869    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbkp9" podStartSLOduration=18.073460795 podStartE2EDuration="20.087855644s" totalImagesPullingTime="2.014394849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:53:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:50.087438364 +0000 UTC m=+53.794221297" watchObservedRunningTime="2026-09-07 12:53:50.087855644 +0000 UTC m=+53.794638575"
Sep 07 12:53:54.197562 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.197530    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"]
Sep 07 12:53:54.202700 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.202673    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"]
Sep 07 12:53:54.202836 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.202803    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.206169 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.206147    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.206811 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.206789    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 07 12:53:54.206811 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.206808    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 12:53:54.206990 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.206860    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 12:53:54.206990 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.206807    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2kfck\""
Sep 07 12:53:54.207083 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.207005    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 12:53:54.208421 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.208399    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 07 12:53:54.208819 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.208799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 07 12:53:54.209157 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.209132    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 07 12:53:54.209261 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.209180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 07 12:53:54.223332 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.223307    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"]
Sep 07 12:53:54.224274 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.224249    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:53:54.225320 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.225302    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"]
Sep 07 12:53:54.270391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db04cfd6-f293-4463-861d-47208946f464-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270602    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5x4\" (UniqueName: \"kubernetes.io/projected/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-kube-api-access-8l5x4\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.270654 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.270649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tgx\" (UniqueName: \"kubernetes.io/projected/db04cfd6-f293-4463-861d-47208946f464-kube-api-access-25tgx\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.283265 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.283236    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54bf76d9cd-j462c"]
Sep 07 12:53:54.286539 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.286515    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.301521 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.301479    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bf76d9cd-j462c"]
Sep 07 12:53:54.371448 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pbk8\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-kube-api-access-8pbk8\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df15b7c8-35cf-43db-bde9-65bfa488e1a8-ca-trust-extracted\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-installation-pull-secrets\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371537    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db04cfd6-f293-4463-861d-47208946f464-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5x4\" (UniqueName: \"kubernetes.io/projected/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-kube-api-access-8l5x4\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.371679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25tgx\" (UniqueName: \"kubernetes.io/projected/db04cfd6-f293-4463-861d-47208946f464-kube-api-access-25tgx\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-tls\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-certificates\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-trusted-ca\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-image-registry-private-configuration\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.371979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.372050 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.372036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-bound-sa-token\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.372382 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.372074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.372382 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.372117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.373065 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.373029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.374487 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.374460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.374571 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.374495    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-ca\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.374571 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.374468    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.374571 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.374556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-hub\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.374739 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.374718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db04cfd6-f293-4463-861d-47208946f464-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.384472 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.384449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tgx\" (UniqueName: \"kubernetes.io/projected/db04cfd6-f293-4463-861d-47208946f464-kube-api-access-25tgx\") pod \"managed-serviceaccount-addon-agent-6879974f5d-sv2l2\" (UID: \"db04cfd6-f293-4463-861d-47208946f464\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.384947 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.384928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5x4\" (UniqueName: \"kubernetes.io/projected/eb696dfa-dddf-4c27-85bb-dde9c9d3a22a-kube-api-access-8l5x4\") pod \"cluster-proxy-proxy-agent-7568cc9644-c5vtt\" (UID: \"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.473393 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-trusted-ca\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473393 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-image-registry-private-configuration\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473393 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-bound-sa-token\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pbk8\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-kube-api-access-8pbk8\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df15b7c8-35cf-43db-bde9-65bfa488e1a8-ca-trust-extracted\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-installation-pull-secrets\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-tls\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473696 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-certificates\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.473951 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.473923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df15b7c8-35cf-43db-bde9-65bfa488e1a8-ca-trust-extracted\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.474345 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.474309    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-trusted-ca\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.474517 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.474492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-certificates\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.476021 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.475993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-image-registry-private-configuration\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.476125 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.476112    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-registry-tls\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.476186 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.476166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df15b7c8-35cf-43db-bde9-65bfa488e1a8-installation-pull-secrets\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.482532 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.482502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-bound-sa-token\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.482690 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.482672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pbk8\" (UniqueName: \"kubernetes.io/projected/df15b7c8-35cf-43db-bde9-65bfa488e1a8-kube-api-access-8pbk8\") pod \"image-registry-54bf76d9cd-j462c\" (UID: \"df15b7c8-35cf-43db-bde9-65bfa488e1a8\") " pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.526555 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.526522    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"
Sep 07 12:53:54.533210 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.533187    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"
Sep 07 12:53:54.606448 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.606419    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:54.803965 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.803892    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2"]
Sep 07 12:53:54.807070 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.807044    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt"]
Sep 07 12:53:54.807389 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:54.807352    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb04cfd6_f293_4463_861d_47208946f464.slice/crio-672428039b05cda1b8d5c24f5cb7854066dd5999d032a3ec19f1de5180e7a790 WatchSource:0}: Error finding container 672428039b05cda1b8d5c24f5cb7854066dd5999d032a3ec19f1de5180e7a790: Status 404 returned error can't find the container with id 672428039b05cda1b8d5c24f5cb7854066dd5999d032a3ec19f1de5180e7a790
Sep 07 12:53:54.810755 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:54.810723    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb696dfa_dddf_4c27_85bb_dde9c9d3a22a.slice/crio-5221c49d5f9c6d47fbcd2117f1e40d969fcab9d933c999b75a2155659502767c WatchSource:0}: Error finding container 5221c49d5f9c6d47fbcd2117f1e40d969fcab9d933c999b75a2155659502767c: Status 404 returned error can't find the container with id 5221c49d5f9c6d47fbcd2117f1e40d969fcab9d933c999b75a2155659502767c
Sep 07 12:53:54.879955 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:54.879915    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bf76d9cd-j462c"]
Sep 07 12:53:54.884135 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:53:54.884112    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf15b7c8_35cf_43db_bde9_65bfa488e1a8.slice/crio-7cd87b4711f11761bfffb0ae325c145b96b234f687c6f6dc3855c4f30d00d90a WatchSource:0}: Error finding container 7cd87b4711f11761bfffb0ae325c145b96b234f687c6f6dc3855c4f30d00d90a: Status 404 returned error can't find the container with id 7cd87b4711f11761bfffb0ae325c145b96b234f687c6f6dc3855c4f30d00d90a
Sep 07 12:53:55.065993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.065905    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c" event={"ID":"df15b7c8-35cf-43db-bde9-65bfa488e1a8","Type":"ContainerStarted","Data":"78ac0aad1b996f01e42202a13d71c682dcb9d001b7165eb68f3f682b6c84605d"}
Sep 07 12:53:55.065993 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.065985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c" event={"ID":"df15b7c8-35cf-43db-bde9-65bfa488e1a8","Type":"ContainerStarted","Data":"7cd87b4711f11761bfffb0ae325c145b96b234f687c6f6dc3855c4f30d00d90a"}
Sep 07 12:53:55.066189 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.066029    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:53:55.067375 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.067301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt" event={"ID":"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a","Type":"ContainerStarted","Data":"5221c49d5f9c6d47fbcd2117f1e40d969fcab9d933c999b75a2155659502767c"}
Sep 07 12:53:55.068547 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.068524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2" event={"ID":"db04cfd6-f293-4463-861d-47208946f464","Type":"ContainerStarted","Data":"672428039b05cda1b8d5c24f5cb7854066dd5999d032a3ec19f1de5180e7a790"}
Sep 07 12:53:55.089077 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:55.089028    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c" podStartSLOduration=1.089013936 podStartE2EDuration="1.089013936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:55.08874122 +0000 UTC m=+58.795524164" watchObservedRunningTime="2026-09-07 12:53:55.089013936 +0000 UTC m=+58.795796868"
Sep 07 12:53:56.970802 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:56.970769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6thp5"
Sep 07 12:53:59.085840 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.085804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt" event={"ID":"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a","Type":"ContainerStarted","Data":"a349c471d6a55f59f402bc5edea46a0723b582da22a5f8e1c02ff56aa9325d3d"}
Sep 07 12:53:59.086453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.085856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt" event={"ID":"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a","Type":"ContainerStarted","Data":"ff294e845aed6228359a99c674f032ae9e326a9035cb0c4cb1abd6e89c9d9ffe"}
Sep 07 12:53:59.086453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.085870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt" event={"ID":"eb696dfa-dddf-4c27-85bb-dde9c9d3a22a","Type":"ContainerStarted","Data":"2c9c0262263cdbc0836ce0269a7fcabaa04f2fec0bf8de2f2eca7ef10fe18535"}
Sep 07 12:53:59.087307 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.087282    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2" event={"ID":"db04cfd6-f293-4463-861d-47208946f464","Type":"ContainerStarted","Data":"45848769fa823c3be8dc01f18f0648d79e5c29cb302cfe3f2bd21a6f87d364b0"}
Sep 07 12:53:59.112381 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.112334    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7568cc9644-c5vtt" podStartSLOduration=1.302623807 podStartE2EDuration="5.11231873s" totalImagesPullingTime="3.809694923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:59.110304174 +0000 UTC m=+62.817087107" watchObservedRunningTime="2026-09-07 12:53:59.11231873 +0000 UTC m=+62.819101709"
Sep 07 12:53:59.127286 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:53:59.127237    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6879974f5d-sv2l2" podStartSLOduration=1.3265370380000001 podStartE2EDuration="5.127218708s" totalImagesPullingTime="3.80068167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:59.126832377 +0000 UTC m=+62.833615310" watchObservedRunningTime="2026-09-07 12:53:59.127218708 +0000 UTC m=+62.834001640"
Sep 07 12:54:00.051062 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:00.051026    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kf7tv"
Sep 07 12:54:02.642928 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.642875    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:54:02.643325 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.642950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:54:02.645650 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.645608    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 12:54:02.646594 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.646578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 12:54:02.655715 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.655681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67863efb-6457-47e6-9c0e-8c8946263e6e-original-pull-secret\") pod \"global-pull-secret-syncer-22pgn\" (UID: \"67863efb-6457-47e6-9c0e-8c8946263e6e\") " pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:54:02.655715 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.655696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1f095db-c08f-4dcc-82d8-05eeeb68fdbd-metrics-certs\") pod \"network-metrics-daemon-l7xn2\" (UID: \"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd\") " pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:54:02.743925 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.743889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:54:02.746615 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.746598    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 12:54:02.757375 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.757354    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 12:54:02.768234 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.768207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5xpk\" (UniqueName: \"kubernetes.io/projected/1b9cb6cd-dca1-4112-ad42-705957ad1b2d-kube-api-access-j5xpk\") pod \"network-check-target-dmwn8\" (UID: \"1b9cb6cd-dca1-4112-ad42-705957ad1b2d\") " pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:54:02.926748 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.926719    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnfpv\""
Sep 07 12:54:02.932865 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.932842    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xfxxc\""
Sep 07 12:54:02.934923 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.934905    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7xn2"
Sep 07 12:54:02.936222 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.936204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22pgn"
Sep 07 12:54:02.941253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:02.941239    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:54:03.214710 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:03.214643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7xn2"]
Sep 07 12:54:03.217840 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:03.217803    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f095db_c08f_4dcc_82d8_05eeeb68fdbd.slice/crio-afea2692d365b5aac6ad4f36389131cab40f9a46a39c512d237c52ced3d95a03 WatchSource:0}: Error finding container afea2692d365b5aac6ad4f36389131cab40f9a46a39c512d237c52ced3d95a03: Status 404 returned error can't find the container with id afea2692d365b5aac6ad4f36389131cab40f9a46a39c512d237c52ced3d95a03
Sep 07 12:54:03.220735 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:03.220715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmwn8"]
Sep 07 12:54:03.223257 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:03.223064    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22pgn"]
Sep 07 12:54:03.224344 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:03.224323    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9cb6cd_dca1_4112_ad42_705957ad1b2d.slice/crio-8c54345d13dd7610f0f10dfabbec23e5aab853c5b368fa020e11cc85c695f9f3 WatchSource:0}: Error finding container 8c54345d13dd7610f0f10dfabbec23e5aab853c5b368fa020e11cc85c695f9f3: Status 404 returned error can't find the container with id 8c54345d13dd7610f0f10dfabbec23e5aab853c5b368fa020e11cc85c695f9f3
Sep 07 12:54:03.227646 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:03.227605    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67863efb_6457_47e6_9c0e_8c8946263e6e.slice/crio-0455a900fa488248e62cf33e29115df83b8d77d80e8f81aaccdc73cf0e01a7e2 WatchSource:0}: Error finding container 0455a900fa488248e62cf33e29115df83b8d77d80e8f81aaccdc73cf0e01a7e2: Status 404 returned error can't find the container with id 0455a900fa488248e62cf33e29115df83b8d77d80e8f81aaccdc73cf0e01a7e2
Sep 07 12:54:04.106950 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:04.106913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmwn8" event={"ID":"1b9cb6cd-dca1-4112-ad42-705957ad1b2d","Type":"ContainerStarted","Data":"8c54345d13dd7610f0f10dfabbec23e5aab853c5b368fa020e11cc85c695f9f3"}
Sep 07 12:54:04.108382 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:04.108333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22pgn" event={"ID":"67863efb-6457-47e6-9c0e-8c8946263e6e","Type":"ContainerStarted","Data":"0455a900fa488248e62cf33e29115df83b8d77d80e8f81aaccdc73cf0e01a7e2"}
Sep 07 12:54:04.110096 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:04.110032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7xn2" event={"ID":"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd","Type":"ContainerStarted","Data":"afea2692d365b5aac6ad4f36389131cab40f9a46a39c512d237c52ced3d95a03"}
Sep 07 12:54:04.232493 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:04.232450    2570 patch_prober.go:28] interesting pod/image-registry-5f4b77d756-gjgkq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 12:54:04.232687 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:04.232518    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 12:54:05.115992 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:05.115950    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7xn2" event={"ID":"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd","Type":"ContainerStarted","Data":"37d7affaa80416952add2df0d1e729fcdcc11583307aed101a16c47c1e32c206"}
Sep 07 12:54:05.116456 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:05.116421    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7xn2" event={"ID":"c1f095db-c08f-4dcc-82d8-05eeeb68fdbd","Type":"ContainerStarted","Data":"0835eec579bed418ff82d54f1881fba8187dff4bcb4c7ac8242fb13c7846a75c"}
Sep 07 12:54:09.074333 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.074271    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l7xn2" podStartSLOduration=70.655192369 podStartE2EDuration="1m12.074246675s" totalImagesPullingTime="1.419054306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:05.14032136 +0000 UTC m=+68.847104319" watchObservedRunningTime="2026-09-07 12:54:09.074246675 +0000 UTC m=+72.781029608"
Sep 07 12:54:09.075389 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.075370    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sgstf"]
Sep 07 12:54:09.097724 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.097695    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.106514 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.106365    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l5rwz\""
Sep 07 12:54:09.111099 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111073    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 12:54:09.111217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111151    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 12:54:09.111217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111167    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 12:54:09.111318 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111251    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 12:54:09.111318 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111293    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 12:54:09.111318 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.111307    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 12:54:09.133334 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.133305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmwn8" event={"ID":"1b9cb6cd-dca1-4112-ad42-705957ad1b2d","Type":"ContainerStarted","Data":"5180ecea0aec28a3cafb464bc69e2e80c3d9555428e0e246fc0c0f52e801bf5d"}
Sep 07 12:54:09.133489 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.133392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:54:09.135077 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.135047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22pgn" event={"ID":"67863efb-6457-47e6-9c0e-8c8946263e6e","Type":"ContainerStarted","Data":"bde36883bda311e788468b1136a9f8b61c05f9e5d4579a6bbd0627f0dd46011b"}
Sep 07 12:54:09.154498 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.154453    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dmwn8" podStartSLOduration=66.987281966 podStartE2EDuration="1m12.154439235s" totalImagesPullingTime="5.167157269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:09.153859974 +0000 UTC m=+72.860642908" watchObservedRunningTime="2026-09-07 12:54:09.154439235 +0000 UTC m=+72.861222178"
Sep 07 12:54:09.176989 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.176932    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22pgn" podStartSLOduration=67.000669954 podStartE2EDuration="1m12.17691475s" totalImagesPullingTime="5.176244796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:09.176717349 +0000 UTC m=+72.883500282" watchObservedRunningTime="2026-09-07 12:54:09.17691475 +0000 UTC m=+72.883697683"
Sep 07 12:54:09.198022 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.197994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198030    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-metrics-client-ca\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-textfile\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-wtmp\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-root\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198470 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198470 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198227    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpsg\" (UniqueName: \"kubernetes.io/projected/d8744e60-d4dd-4dab-9335-c6759640ee54-kube-api-access-4fpsg\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.198470 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.198256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-sys\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299464 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-metrics-client-ca\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-textfile\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-wtmp\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-root\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299703 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299663    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-root\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299992 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpsg\" (UniqueName: \"kubernetes.io/projected/d8744e60-d4dd-4dab-9335-c6759640ee54-kube-api-access-4fpsg\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299992 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-sys\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299992 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:54:09.299766    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 12:54:09.299992 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.299794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.299992 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:54:09.299834    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls podName:d8744e60-d4dd-4dab-9335-c6759640ee54 nodeName:}" failed. No retries permitted until 2026-09-07 12:54:09.799813593 +0000 UTC m=+73.506596529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls") pod "node-exporter-sgstf" (UID: "d8744e60-d4dd-4dab-9335-c6759640ee54") : secret "node-exporter-tls" not found
Sep 07 12:54:09.300221 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.300048    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-textfile\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.300221 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.300086    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-wtmp\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.300221 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.300117    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8744e60-d4dd-4dab-9335-c6759640ee54-sys\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.300221 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.300159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-metrics-client-ca\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.300383 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.300286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.302149 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.302125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.310385 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.310349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpsg\" (UniqueName: \"kubernetes.io/projected/d8744e60-d4dd-4dab-9335-c6759640ee54-kube-api-access-4fpsg\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.804604 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.804567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:09.806882 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:09.806858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8744e60-d4dd-4dab-9335-c6759640ee54-node-exporter-tls\") pod \"node-exporter-sgstf\" (UID: \"d8744e60-d4dd-4dab-9335-c6759640ee54\") " pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:10.013138 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:10.013100    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgstf"
Sep 07 12:54:10.045037 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:10.045003    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8744e60_d4dd_4dab_9335_c6759640ee54.slice/crio-7f1b671e102da7feea9d4f4f323dd409ec64f2adb4284717e3ee6d6661f5a50b WatchSource:0}: Error finding container 7f1b671e102da7feea9d4f4f323dd409ec64f2adb4284717e3ee6d6661f5a50b: Status 404 returned error can't find the container with id 7f1b671e102da7feea9d4f4f323dd409ec64f2adb4284717e3ee6d6661f5a50b
Sep 07 12:54:10.140356 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:10.140269    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgstf" event={"ID":"d8744e60-d4dd-4dab-9335-c6759640ee54","Type":"ContainerStarted","Data":"7f1b671e102da7feea9d4f4f323dd409ec64f2adb4284717e3ee6d6661f5a50b"}
Sep 07 12:54:12.149635 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:12.149578    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8744e60-d4dd-4dab-9335-c6759640ee54" containerID="da6ddb6111182705580c287257a0892e51af7c4477a845e4974bdf4a07800ad1" exitCode=0
Sep 07 12:54:12.150065 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:12.149668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgstf" event={"ID":"d8744e60-d4dd-4dab-9335-c6759640ee54","Type":"ContainerDied","Data":"da6ddb6111182705580c287257a0892e51af7c4477a845e4974bdf4a07800ad1"}
Sep 07 12:54:13.155518 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:13.155481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgstf" event={"ID":"d8744e60-d4dd-4dab-9335-c6759640ee54","Type":"ContainerStarted","Data":"7f6bf4befc5688a670ad7961f771e7c73887c4288f5307e5a6c7cda4db4cd580"}
Sep 07 12:54:13.155912 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:13.155535    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgstf" event={"ID":"d8744e60-d4dd-4dab-9335-c6759640ee54","Type":"ContainerStarted","Data":"c307a60304edc15e5e361c4a01bd9c7e85f076026935638872ba3d1e0faf68f5"}
Sep 07 12:54:13.183172 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:13.183121    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sgstf" podStartSLOduration=2.549424263 podStartE2EDuration="4.183105992s" totalImagesPullingTime="1.572197863s" totalInitContainerRuntime="61.483866ms" isStatefulPod=true podCreationTimestamp="2026-09-07 12:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:13.181669174 +0000 UTC m=+76.888452101" watchObservedRunningTime="2026-09-07 12:54:13.183105992 +0000 UTC m=+76.889888918"
Sep 07 12:54:14.229033 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:14.229006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:54:16.079566 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.079538    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54bf76d9cd-j462c"
Sep 07 12:54:16.626709 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.626674    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-54htw"]
Sep 07 12:54:16.629834 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.629820    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:16.632592 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.632564    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b4s6s\""
Sep 07 12:54:16.632762 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.632702    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 12:54:16.632884 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.632869    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 12:54:16.641305 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.641279    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-54htw"]
Sep 07 12:54:16.760690 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.760597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv95r\" (UniqueName: \"kubernetes.io/projected/41617925-30ec-472d-b4be-d5a80c0b5e53-kube-api-access-mv95r\") pod \"downloads-85d98c998f-54htw\" (UID: \"41617925-30ec-472d-b4be-d5a80c0b5e53\") " pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:16.861854 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.861811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv95r\" (UniqueName: \"kubernetes.io/projected/41617925-30ec-472d-b4be-d5a80c0b5e53-kube-api-access-mv95r\") pod \"downloads-85d98c998f-54htw\" (UID: \"41617925-30ec-472d-b4be-d5a80c0b5e53\") " pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:16.875440 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.875397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv95r\" (UniqueName: \"kubernetes.io/projected/41617925-30ec-472d-b4be-d5a80c0b5e53-kube-api-access-mv95r\") pod \"downloads-85d98c998f-54htw\" (UID: \"41617925-30ec-472d-b4be-d5a80c0b5e53\") " pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:16.938209 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:16.938171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:17.217661 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:17.217561    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-54htw"]
Sep 07 12:54:17.220275 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:17.220247    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41617925_30ec_472d_b4be_d5a80c0b5e53.slice/crio-242d01fe1c0b2687ff2ff6efd2b20f989d62fd662a0de7e1d0e9595df1ff6130 WatchSource:0}: Error finding container 242d01fe1c0b2687ff2ff6efd2b20f989d62fd662a0de7e1d0e9595df1ff6130: Status 404 returned error can't find the container with id 242d01fe1c0b2687ff2ff6efd2b20f989d62fd662a0de7e1d0e9595df1ff6130
Sep 07 12:54:18.175462 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:18.175430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-54htw" event={"ID":"41617925-30ec-472d-b4be-d5a80c0b5e53","Type":"ContainerStarted","Data":"242d01fe1c0b2687ff2ff6efd2b20f989d62fd662a0de7e1d0e9595df1ff6130"}
Sep 07 12:54:19.245941 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.245499    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerName="registry" containerID="cri-o://416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86" gracePeriod=30
Sep 07 12:54:19.510525 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.510458    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:54:19.583038 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583008    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktkgx\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583056    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583097    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583478 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583224    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.583478 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.583261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") pod \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\" (UID: \"e8c899f9-07e8-4c2e-9f2b-a9311461a83f\") "
Sep 07 12:54:19.584113 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.584075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:54:19.584309 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.584284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:54:19.586104 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.586075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:54:19.586216 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.586140    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx" (OuterVolumeSpecName: "kube-api-access-ktkgx") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "kube-api-access-ktkgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:54:19.586366 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.586303    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:54:19.586832 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.586765    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:54:19.587170 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.587141    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:54:19.593583 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.593545    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e8c899f9-07e8-4c2e-9f2b-a9311461a83f" (UID: "e8c899f9-07e8-4c2e-9f2b-a9311461a83f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:54:19.683810 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683772    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.683810 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683805    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktkgx\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-kube-api-access-ktkgx\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.683810 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683815    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-ca-trust-extracted\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.684054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683825    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-registry-certificates\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.684054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683833    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-installation-pull-secrets\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.684054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683842    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-trusted-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.684054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683851    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-image-registry-private-configuration\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:19.684054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:19.683860    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c899f9-07e8-4c2e-9f2b-a9311461a83f-bound-sa-token\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:54:20.185248 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.185212    2570 generic.go:356] "Generic (PLEG): container finished" podID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerID="416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86" exitCode=0
Sep 07 12:54:20.185427 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.185267    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq"
Sep 07 12:54:20.185427 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.185302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" event={"ID":"e8c899f9-07e8-4c2e-9f2b-a9311461a83f","Type":"ContainerDied","Data":"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"}
Sep 07 12:54:20.185427 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.185365    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4b77d756-gjgkq" event={"ID":"e8c899f9-07e8-4c2e-9f2b-a9311461a83f","Type":"ContainerDied","Data":"1b004ab4f422938ea25e2cd2e9454fd6d8f6509f90b4818add77611e79e3bad4"}
Sep 07 12:54:20.185427 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.185386    2570 scope.go:117] "RemoveContainer" containerID="416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"
Sep 07 12:54:20.195158 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.195137    2570 scope.go:117] "RemoveContainer" containerID="416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"
Sep 07 12:54:20.195485 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:54:20.195448    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86\": container with ID starting with 416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86 not found: ID does not exist" containerID="416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"
Sep 07 12:54:20.195593 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.195491    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86"} err="failed to get container status \"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86\": rpc error: code = NotFound desc = could not find container \"416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86\": container with ID starting with 416095f4c4c5e99733bb841849a1abf59048101ccf87e0a68accefb253a4bb86 not found: ID does not exist"
Sep 07 12:54:20.209127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.209098    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:54:20.214145 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.214123    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f4b77d756-gjgkq"]
Sep 07 12:54:20.815342 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:20.815305    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" path="/var/lib/kubelet/pods/e8c899f9-07e8-4c2e-9f2b-a9311461a83f/volumes"
Sep 07 12:54:27.312548 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.312505    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:54:27.313081 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.312879    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerName="registry"
Sep 07 12:54:27.313081 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.312898    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerName="registry"
Sep 07 12:54:27.313081 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.312943    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c899f9-07e8-4c2e-9f2b-a9311461a83f" containerName="registry"
Sep 07 12:54:27.316792 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.316752    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.319185 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.319146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 12:54:27.319391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.319370    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 12:54:27.320326 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.320296    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9qsfk\""
Sep 07 12:54:27.320454 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.320338    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 12:54:27.320574 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.320555    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 12:54:27.320665 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.320586    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 12:54:27.325489 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.325045    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:54:27.452057 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.452260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.452260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79zd\" (UniqueName: \"kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.452260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452145    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.452260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.452260 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.452199    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553069 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553133    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v79zd\" (UniqueName: \"kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.553253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.553210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.554031 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.554004    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.554144 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.554029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.554144 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.554004    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.556031 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.556007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.556268 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.556247    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.564057 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.563978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79zd\" (UniqueName: \"kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd\") pod \"console-685c46fb59-jjnmv\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") " pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:27.628793 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:27.628750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:33.104554 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.104339    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:54:33.107465 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:33.107430    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0d45be_976d_4d66_9015_1fbb72c89122.slice/crio-7d8fafd8c168eeeeaa1ac696f80380b270b3aadcefcf4b1bdd7eb0df868db98d WatchSource:0}: Error finding container 7d8fafd8c168eeeeaa1ac696f80380b270b3aadcefcf4b1bdd7eb0df868db98d: Status 404 returned error can't find the container with id 7d8fafd8c168eeeeaa1ac696f80380b270b3aadcefcf4b1bdd7eb0df868db98d
Sep 07 12:54:33.237199 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.237152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c46fb59-jjnmv" event={"ID":"8c0d45be-976d-4d66-9015-1fbb72c89122","Type":"ContainerStarted","Data":"7d8fafd8c168eeeeaa1ac696f80380b270b3aadcefcf4b1bdd7eb0df868db98d"}
Sep 07 12:54:33.239009 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.238977    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-54htw" event={"ID":"41617925-30ec-472d-b4be-d5a80c0b5e53","Type":"ContainerStarted","Data":"23a55d2afd7cc48885b8ceb280f3366098dc6f4c83967336025e280679559304"}
Sep 07 12:54:33.239269 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.239241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:33.253184 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.253162    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-54htw"
Sep 07 12:54:33.257640 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:33.257568    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-54htw" podStartSLOduration=1.548473408 podStartE2EDuration="17.257549005s" totalImagesPullingTime="15.709075597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:33.255896136 +0000 UTC m=+96.962679116" watchObservedRunningTime="2026-09-07 12:54:33.257549005 +0000 UTC m=+96.964331938"
Sep 07 12:54:36.726027 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.725991    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:54:36.743748 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.743717    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:54:36.743903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.743829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.753547 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.753292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 12:54:36.837496 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837509    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837699 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.837960 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.837701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckcp\" (UniqueName: \"kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.938809 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938774    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.938938 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938821    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.938938 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckcp\" (UniqueName: \"kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.938938 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.938938 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.939140 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.939140 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.938997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.939683 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.939658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.939829 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.939739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.939829 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.939765    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.940394 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.940370    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.941814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.941791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.941977 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.941955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:36.948909 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:36.948883    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckcp\" (UniqueName: \"kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp\") pod \"console-645cb55bbf-p5f2n\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") " pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:37.057173 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.057131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:37.262091 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.262004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c46fb59-jjnmv" event={"ID":"8c0d45be-976d-4d66-9015-1fbb72c89122","Type":"ContainerStarted","Data":"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"}
Sep 07 12:54:37.282585 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.282532    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-685c46fb59-jjnmv" podStartSLOduration=6.509805827 podStartE2EDuration="10.282514909s" totalImagesPullingTime="3.772709082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:37.2814832 +0000 UTC m=+100.988266134" watchObservedRunningTime="2026-09-07 12:54:37.282514909 +0000 UTC m=+100.989297842"
Sep 07 12:54:37.364101 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.363954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:54:37.367008 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:54:37.366965    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a8ef9f_d48e_4065_babb_42ea9822072c.slice/crio-6be2629c509ec0e75b58cc31404783142c2b44ce6a8b0cae65268568574e7d02 WatchSource:0}: Error finding container 6be2629c509ec0e75b58cc31404783142c2b44ce6a8b0cae65268568574e7d02: Status 404 returned error can't find the container with id 6be2629c509ec0e75b58cc31404783142c2b44ce6a8b0cae65268568574e7d02
Sep 07 12:54:37.629412 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.629331    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:37.629583 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.629506    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:37.635038 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:37.635006    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:38.267898 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:38.267859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645cb55bbf-p5f2n" event={"ID":"44a8ef9f-d48e-4065-babb-42ea9822072c","Type":"ContainerStarted","Data":"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"}
Sep 07 12:54:38.268382 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:38.267955    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645cb55bbf-p5f2n" event={"ID":"44a8ef9f-d48e-4065-babb-42ea9822072c","Type":"ContainerStarted","Data":"6be2629c509ec0e75b58cc31404783142c2b44ce6a8b0cae65268568574e7d02"}
Sep 07 12:54:38.272243 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:38.272215    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:54:38.290246 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:38.290180    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-645cb55bbf-p5f2n" podStartSLOduration=2.290158112 podStartE2EDuration="2.290158112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:54:38.288810153 +0000 UTC m=+101.995593090" watchObservedRunningTime="2026-09-07 12:54:38.290158112 +0000 UTC m=+101.996941043"
Sep 07 12:54:40.143641 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:40.143584    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dmwn8"
Sep 07 12:54:47.058207 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:47.058158    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:47.058712 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:47.058225    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:47.063122 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:47.063099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:47.303509 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:47.303479    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:54:47.371866 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:54:47.371787    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:55:12.391649 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.391564    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-685c46fb59-jjnmv" podUID="8c0d45be-976d-4d66-9015-1fbb72c89122" containerName="console" containerID="cri-o://3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e" gracePeriod=15
Sep 07 12:55:12.654336 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.654314    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:55:12.731052 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731060    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v79zd\" (UniqueName: \"kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731096    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731127    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731172    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731197    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert\") pod \"8c0d45be-976d-4d66-9015-1fbb72c89122\" (UID: \"8c0d45be-976d-4d66-9015-1fbb72c89122\") "
Sep 07 12:55:12.731543 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731510    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:55:12.731639 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731588    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config" (OuterVolumeSpecName: "console-config") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:55:12.731692 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.731603    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:55:12.733328 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.733304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:55:12.733413 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.733324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:55:12.733413 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.733382    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd" (OuterVolumeSpecName: "kube-api-access-v79zd") pod "8c0d45be-976d-4d66-9015-1fbb72c89122" (UID: "8c0d45be-976d-4d66-9015-1fbb72c89122"). InnerVolumeSpecName "kube-api-access-v79zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:55:12.831971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.831942    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:12.831971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.831966    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c0d45be-976d-4d66-9015-1fbb72c89122-console-oauth-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:12.831971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.831976    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v79zd\" (UniqueName: \"kubernetes.io/projected/8c0d45be-976d-4d66-9015-1fbb72c89122-kube-api-access-v79zd\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:12.832155 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.831985    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-oauth-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:12.832155 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.831993    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:12.832155 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:12.832001    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c0d45be-976d-4d66-9015-1fbb72c89122-console-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:55:13.385863 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.385827    2570 generic.go:356] "Generic (PLEG): container finished" podID="8c0d45be-976d-4d66-9015-1fbb72c89122" containerID="3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e" exitCode=0
Sep 07 12:55:13.386034 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.385877    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685c46fb59-jjnmv"
Sep 07 12:55:13.386034 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.385901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c46fb59-jjnmv" event={"ID":"8c0d45be-976d-4d66-9015-1fbb72c89122","Type":"ContainerDied","Data":"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"}
Sep 07 12:55:13.386034 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.385939    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685c46fb59-jjnmv" event={"ID":"8c0d45be-976d-4d66-9015-1fbb72c89122","Type":"ContainerDied","Data":"7d8fafd8c168eeeeaa1ac696f80380b270b3aadcefcf4b1bdd7eb0df868db98d"}
Sep 07 12:55:13.386034 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.385958    2570 scope.go:117] "RemoveContainer" containerID="3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"
Sep 07 12:55:13.393412 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.393244    2570 scope.go:117] "RemoveContainer" containerID="3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"
Sep 07 12:55:13.393640 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:55:13.393451    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e\": container with ID starting with 3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e not found: ID does not exist" containerID="3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"
Sep 07 12:55:13.393640 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.393473    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e"} err="failed to get container status \"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e\": rpc error: code = NotFound desc = could not find container \"3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e\": container with ID starting with 3873b89c6ed7dbe0753604111fc950a6f56440001cf82f39d9249b2af044e93e not found: ID does not exist"
Sep 07 12:55:13.408898 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.408876    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:55:13.413899 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:13.413878    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-685c46fb59-jjnmv"]
Sep 07 12:55:14.813149 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:14.813117    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c0d45be-976d-4d66-9015-1fbb72c89122" path="/var/lib/kubelet/pods/8c0d45be-976d-4d66-9015-1fbb72c89122/volumes"
Sep 07 12:55:37.347037 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.346997    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:55:37.347553 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.347332    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0d45be-976d-4d66-9015-1fbb72c89122" containerName="console"
Sep 07 12:55:37.347553 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.347350    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0d45be-976d-4d66-9015-1fbb72c89122" containerName="console"
Sep 07 12:55:37.347553 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.347411    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0d45be-976d-4d66-9015-1fbb72c89122" containerName="console"
Sep 07 12:55:37.351203 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.351182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.363942 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.363918    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:55:37.422075 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422036    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422272 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422272 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422119    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rkcl\" (UniqueName: \"kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422272 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422272 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422461 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.422461 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.422328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523751 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523751 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rkcl\" (UniqueName: \"kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.523997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.523883    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.524739 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.524708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.524869 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.524779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.524869 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.524777    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.524869 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.524832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.526304 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.526281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.526391 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.526364    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.533569 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.533550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rkcl\" (UniqueName: \"kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl\") pod \"console-5bf97c94b9-n8gdm\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") " pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.660080 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.660043    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:37.949006 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:37.948915    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:55:37.952966 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:55:37.952938    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7e9e83_5fc6_40d3_8f62_e0761aa5387c.slice/crio-1cef7e5769284b4a6def8696f4ee173863ef6a6b823e10b712970ff177b5ed23 WatchSource:0}: Error finding container 1cef7e5769284b4a6def8696f4ee173863ef6a6b823e10b712970ff177b5ed23: Status 404 returned error can't find the container with id 1cef7e5769284b4a6def8696f4ee173863ef6a6b823e10b712970ff177b5ed23
Sep 07 12:55:38.483214 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:38.483177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf97c94b9-n8gdm" event={"ID":"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c","Type":"ContainerStarted","Data":"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"}
Sep 07 12:55:38.483591 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:38.483227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf97c94b9-n8gdm" event={"ID":"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c","Type":"ContainerStarted","Data":"1cef7e5769284b4a6def8696f4ee173863ef6a6b823e10b712970ff177b5ed23"}
Sep 07 12:55:38.505680 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:38.505633    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bf97c94b9-n8gdm" podStartSLOduration=1.5056010949999998 podStartE2EDuration="1.505601095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:55:38.504195903 +0000 UTC m=+162.210978856" watchObservedRunningTime="2026-09-07 12:55:38.505601095 +0000 UTC m=+162.212384026"
Sep 07 12:55:47.660631 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:47.660585    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:47.661109 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:47.660677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:47.665154 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:47.665133    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:48.525555 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:48.525526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:55:48.599013 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:55:48.598978    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:56:13.618565 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:13.618521    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-645cb55bbf-p5f2n" podUID="44a8ef9f-d48e-4065-babb-42ea9822072c" containerName="console" containerID="cri-o://0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2" gracePeriod=15
Sep 07 12:56:13.855481 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:13.855455    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:56:14.015443 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015414    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015443 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015458    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015691 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015483    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015691 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015511    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015691 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015556    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015691 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015580    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckcp\" (UniqueName: \"kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015691 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015599    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca\") pod \"44a8ef9f-d48e-4065-babb-42ea9822072c\" (UID: \"44a8ef9f-d48e-4065-babb-42ea9822072c\") "
Sep 07 12:56:14.015969 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015930    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config" (OuterVolumeSpecName: "console-config") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:56:14.016049 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015938    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:56:14.016104 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.015983    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:56:14.016236 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.016208    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca" (OuterVolumeSpecName: "service-ca") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:56:14.017849 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.017819    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:56:14.017947 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.017895    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp" (OuterVolumeSpecName: "kube-api-access-8ckcp") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "kube-api-access-8ckcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:56:14.017947 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.017912    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44a8ef9f-d48e-4065-babb-42ea9822072c" (UID: "44a8ef9f-d48e-4065-babb-42ea9822072c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:56:14.116453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116404    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-oauth-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116447    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckcp\" (UniqueName: \"kubernetes.io/projected/44a8ef9f-d48e-4065-babb-42ea9822072c-kube-api-access-8ckcp\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116459    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116453 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116468    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116751 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116476    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-console-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116751 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116484    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44a8ef9f-d48e-4065-babb-42ea9822072c-trusted-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.116751 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.116493    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44a8ef9f-d48e-4065-babb-42ea9822072c-console-oauth-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:56:14.619176 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.619136    2570 generic.go:356] "Generic (PLEG): container finished" podID="44a8ef9f-d48e-4065-babb-42ea9822072c" containerID="0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2" exitCode=0
Sep 07 12:56:14.619605 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.619185    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645cb55bbf-p5f2n"
Sep 07 12:56:14.619605 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.619217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645cb55bbf-p5f2n" event={"ID":"44a8ef9f-d48e-4065-babb-42ea9822072c","Type":"ContainerDied","Data":"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"}
Sep 07 12:56:14.619605 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.619274    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645cb55bbf-p5f2n" event={"ID":"44a8ef9f-d48e-4065-babb-42ea9822072c","Type":"ContainerDied","Data":"6be2629c509ec0e75b58cc31404783142c2b44ce6a8b0cae65268568574e7d02"}
Sep 07 12:56:14.619605 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.619295    2570 scope.go:117] "RemoveContainer" containerID="0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"
Sep 07 12:56:14.627551 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.627531    2570 scope.go:117] "RemoveContainer" containerID="0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"
Sep 07 12:56:14.627846 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:56:14.627825    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2\": container with ID starting with 0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2 not found: ID does not exist" containerID="0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"
Sep 07 12:56:14.627934 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.627852    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2"} err="failed to get container status \"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2\": rpc error: code = NotFound desc = could not find container \"0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2\": container with ID starting with 0063d3dce28bb01ea6cda6ee7fcd796fbc87a057390c888ce9721bc91c641ae2 not found: ID does not exist"
Sep 07 12:56:14.647843 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.647815    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:56:14.653903 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.653880    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-645cb55bbf-p5f2n"]
Sep 07 12:56:14.813756 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:56:14.813723    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a8ef9f-d48e-4065-babb-42ea9822072c" path="/var/lib/kubelet/pods/44a8ef9f-d48e-4065-babb-42ea9822072c/volumes"
Sep 07 12:57:02.285038 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.285003    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 12:57:02.285495 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.285234    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a8ef9f-d48e-4065-babb-42ea9822072c" containerName="console"
Sep 07 12:57:02.285495 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.285245    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a8ef9f-d48e-4065-babb-42ea9822072c" containerName="console"
Sep 07 12:57:02.285495 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.285308    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a8ef9f-d48e-4065-babb-42ea9822072c" containerName="console"
Sep 07 12:57:02.289044 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.289028    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.316744 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.316711    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 12:57:02.354340 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rl6\" (UniqueName: \"kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354340 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354563 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354364    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354563 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354563 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354563 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.354761 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.354593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.455733 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.455733 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.455892 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rl6\" (UniqueName: \"kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.455943 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.455943 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455923    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456041 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.455973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456041 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.456007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456647 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.456596    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456770 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.456602    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456770 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.456665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.456888 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.456776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.458294 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.458268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.458429 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.458407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.470180 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.470156    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rl6\" (UniqueName: \"kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6\") pod \"console-6b8dc4964b-86v92\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") " pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.597992 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.597904    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:02.872829 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:02.872756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 12:57:02.875772 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:57:02.875742    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee4ba42_9b19_4266_9f79_ddfb3ccce4aa.slice/crio-fce451d4df89382475c63eecf87b3e244033ed68fd0750dfea1cd1b68f562a74 WatchSource:0}: Error finding container fce451d4df89382475c63eecf87b3e244033ed68fd0750dfea1cd1b68f562a74: Status 404 returned error can't find the container with id fce451d4df89382475c63eecf87b3e244033ed68fd0750dfea1cd1b68f562a74
Sep 07 12:57:03.788093 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:03.788057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dc4964b-86v92" event={"ID":"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa","Type":"ContainerStarted","Data":"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"}
Sep 07 12:57:03.788542 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:03.788115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dc4964b-86v92" event={"ID":"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa","Type":"ContainerStarted","Data":"fce451d4df89382475c63eecf87b3e244033ed68fd0750dfea1cd1b68f562a74"}
Sep 07 12:57:03.809195 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:03.809133    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b8dc4964b-86v92" podStartSLOduration=1.809114423 podStartE2EDuration="1.809114423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:57:03.808869144 +0000 UTC m=+247.515652077" watchObservedRunningTime="2026-09-07 12:57:03.809114423 +0000 UTC m=+247.515897370"
Sep 07 12:57:12.598789 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:12.598750    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:12.599264 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:12.598834    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:12.603769 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:12.603749    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:12.824452 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:12.824424    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 12:57:12.877582 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:12.877490    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:57:37.901762 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:37.901699    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bf97c94b9-n8gdm" podUID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" containerName="console" containerID="cri-o://acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173" gracePeriod=15
Sep 07 12:57:38.139443 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.139412    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:57:38.205679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205563    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205612    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rkcl\" (UniqueName: \"kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205679 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205959 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205689    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205959 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205959 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205771    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.205959 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.205804    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config\") pod \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\" (UID: \"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c\") "
Sep 07 12:57:38.206150 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.206111    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:57:38.206150 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.206120    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:57:38.206380 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.206228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config" (OuterVolumeSpecName: "console-config") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:57:38.206464 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.206416    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 12:57:38.208009 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.207986    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:57:38.208096 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.208011    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 12:57:38.208096 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.208023    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl" (OuterVolumeSpecName: "kube-api-access-2rkcl") pod "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" (UID: "5f7e9e83-5fc6-40d3-8f62-e0761aa5387c"). InnerVolumeSpecName "kube-api-access-2rkcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:57:38.306309 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306264    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306309 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306301    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306309 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306314    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306545 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306326    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-oauth-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306545 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306339    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-console-oauth-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306545 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306351    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-trusted-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.306545 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.306361    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rkcl\" (UniqueName: \"kubernetes.io/projected/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c-kube-api-access-2rkcl\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:57:38.903811 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.903781    2570 generic.go:356] "Generic (PLEG): container finished" podID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" containerID="acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173" exitCode=0
Sep 07 12:57:38.904188 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.903824    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf97c94b9-n8gdm"
Sep 07 12:57:38.904188 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.903874    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf97c94b9-n8gdm" event={"ID":"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c","Type":"ContainerDied","Data":"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"}
Sep 07 12:57:38.904188 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.903929    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf97c94b9-n8gdm" event={"ID":"5f7e9e83-5fc6-40d3-8f62-e0761aa5387c","Type":"ContainerDied","Data":"1cef7e5769284b4a6def8696f4ee173863ef6a6b823e10b712970ff177b5ed23"}
Sep 07 12:57:38.904188 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.903953    2570 scope.go:117] "RemoveContainer" containerID="acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"
Sep 07 12:57:38.912067 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.912049    2570 scope.go:117] "RemoveContainer" containerID="acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"
Sep 07 12:57:38.912349 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:57:38.912333    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173\": container with ID starting with acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173 not found: ID does not exist" containerID="acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"
Sep 07 12:57:38.912418 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.912356    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173"} err="failed to get container status \"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173\": rpc error: code = NotFound desc = could not find container \"acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173\": container with ID starting with acfb90e11c24400868da2e9074383ef13df18bc89bdee6108682c774fe4e6173 not found: ID does not exist"
Sep 07 12:57:38.922361 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.922338    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:57:38.928255 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:38.928234    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bf97c94b9-n8gdm"]
Sep 07 12:57:40.813932 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:40.813890    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" path="/var/lib/kubelet/pods/5f7e9e83-5fc6-40d3-8f62-e0761aa5387c/volumes"
Sep 07 12:57:56.709068 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:56.709037    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 12:57:57.551996 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.551960    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"]
Sep 07 12:57:57.554196 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.552195    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" containerName="console"
Sep 07 12:57:57.554196 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.552206    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" containerName="console"
Sep 07 12:57:57.554196 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.552256    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7e9e83-5fc6-40d3-8f62-e0761aa5387c" containerName="console"
Sep 07 12:57:57.555140 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.555124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.557936 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.557913    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfcv5\""
Sep 07 12:57:57.558149 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.558132    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 12:57:57.558920 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.558903    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 12:57:57.568084 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.568055    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"]
Sep 07 12:57:57.644253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.644220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.644253 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.644253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.644480 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.644283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfzk4\" (UniqueName: \"kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.745240 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.745194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.745240 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.745239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.745796 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.745288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfzk4\" (UniqueName: \"kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.745796 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.745592    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.745796 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.745668    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.755907 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.755876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfzk4\" (UniqueName: \"kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:57.864395 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:57.864303    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:57:58.147607 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:58.147525    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"]
Sep 07 12:57:58.150484 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:57:58.150460    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf809681_5219_411e_90c4_4ed1acaa534d.slice/crio-102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e WatchSource:0}: Error finding container 102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e: Status 404 returned error can't find the container with id 102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e
Sep 07 12:57:58.152484 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:58.152468    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:57:58.974074 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:57:58.974036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4" event={"ID":"df809681-5219-411e-90c4-4ed1acaa534d","Type":"ContainerStarted","Data":"102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e"}
Sep 07 12:58:03.994202 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:03.994160    2570 generic.go:356] "Generic (PLEG): container finished" podID="df809681-5219-411e-90c4-4ed1acaa534d" containerID="83aa1f71902b21a81d83a0669426e71f0d22ca666d3df9a9a0667a8b6011a6db" exitCode=0
Sep 07 12:58:03.994596 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:03.994222    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4" event={"ID":"df809681-5219-411e-90c4-4ed1acaa534d","Type":"ContainerDied","Data":"83aa1f71902b21a81d83a0669426e71f0d22ca666d3df9a9a0667a8b6011a6db"}
Sep 07 12:58:07.007241 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:07.007159    2570 generic.go:356] "Generic (PLEG): container finished" podID="df809681-5219-411e-90c4-4ed1acaa534d" containerID="08dc386dfc53fc1188446e17ab9a8f68f6198a66417329904a21426627a955de" exitCode=0
Sep 07 12:58:07.007579 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:07.007242    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4" event={"ID":"df809681-5219-411e-90c4-4ed1acaa534d","Type":"ContainerDied","Data":"08dc386dfc53fc1188446e17ab9a8f68f6198a66417329904a21426627a955de"}
Sep 07 12:58:14.037752 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:14.037715    2570 generic.go:356] "Generic (PLEG): container finished" podID="df809681-5219-411e-90c4-4ed1acaa534d" containerID="026bcaa73860c55e76f765914824b9f4aa6961b885c1163c681d9fdb90f74175" exitCode=0
Sep 07 12:58:14.038142 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:14.037778    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4" event={"ID":"df809681-5219-411e-90c4-4ed1acaa534d","Type":"ContainerDied","Data":"026bcaa73860c55e76f765914824b9f4aa6961b885c1163c681d9fdb90f74175"}
Sep 07 12:58:15.163807 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.163778    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:58:15.306220 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.306132    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfzk4\" (UniqueName: \"kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4\") pod \"df809681-5219-411e-90c4-4ed1acaa534d\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") "
Sep 07 12:58:15.306393 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.306225    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle\") pod \"df809681-5219-411e-90c4-4ed1acaa534d\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") "
Sep 07 12:58:15.306393 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.306331    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util\") pod \"df809681-5219-411e-90c4-4ed1acaa534d\" (UID: \"df809681-5219-411e-90c4-4ed1acaa534d\") "
Sep 07 12:58:15.306889 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.306866    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle" (OuterVolumeSpecName: "bundle") pod "df809681-5219-411e-90c4-4ed1acaa534d" (UID: "df809681-5219-411e-90c4-4ed1acaa534d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:58:15.308478 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.308454    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4" (OuterVolumeSpecName: "kube-api-access-qfzk4") pod "df809681-5219-411e-90c4-4ed1acaa534d" (UID: "df809681-5219-411e-90c4-4ed1acaa534d"). InnerVolumeSpecName "kube-api-access-qfzk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:58:15.310143 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.310122    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util" (OuterVolumeSpecName: "util") pod "df809681-5219-411e-90c4-4ed1acaa534d" (UID: "df809681-5219-411e-90c4-4ed1acaa534d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:58:15.407029 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.406988    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfzk4\" (UniqueName: \"kubernetes.io/projected/df809681-5219-411e-90c4-4ed1acaa534d-kube-api-access-qfzk4\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:58:15.407197 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.407048    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:58:15.407197 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:15.407058    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df809681-5219-411e-90c4-4ed1acaa534d-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:58:16.046378 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:16.046340    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4" event={"ID":"df809681-5219-411e-90c4-4ed1acaa534d","Type":"ContainerDied","Data":"102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e"}
Sep 07 12:58:16.046583 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:16.046387    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbvf4"
Sep 07 12:58:16.046583 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:16.046394    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="102e7d78381b7c7e7ad4311a61acb091b4418956d5c06afddd0e45cd0ef9f72e"
Sep 07 12:58:20.741958 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.741922    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"]
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742164    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="pull"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742175    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="pull"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742183    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="extract"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742189    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="extract"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742198    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="util"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742203    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="util"
Sep 07 12:58:20.742324 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.742252    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df809681-5219-411e-90c4-4ed1acaa534d" containerName="extract"
Sep 07 12:58:20.755395 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.755372    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.758485 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.758454    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zw7bp\""
Sep 07 12:58:20.758759 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.758737    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 12:58:20.758866 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.758742    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 12:58:20.760002 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.759977    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"]
Sep 07 12:58:20.854714 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.854679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad6d42-0c86-4c90-b8b6-99a693063ea8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.854894 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.854728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndfw\" (UniqueName: \"kubernetes.io/projected/66ad6d42-0c86-4c90-b8b6-99a693063ea8-kube-api-access-lndfw\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.955864 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.955828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad6d42-0c86-4c90-b8b6-99a693063ea8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.956039 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.955898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndfw\" (UniqueName: \"kubernetes.io/projected/66ad6d42-0c86-4c90-b8b6-99a693063ea8-kube-api-access-lndfw\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.956220 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.956197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad6d42-0c86-4c90-b8b6-99a693063ea8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:20.969096 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:20.969076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndfw\" (UniqueName: \"kubernetes.io/projected/66ad6d42-0c86-4c90-b8b6-99a693063ea8-kube-api-access-lndfw\") pod \"cert-manager-operator-controller-manager-55c444bf86-8bh46\" (UID: \"66ad6d42-0c86-4c90-b8b6-99a693063ea8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:21.065846 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:21.065766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"
Sep 07 12:58:21.366511 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:21.366428    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46"]
Sep 07 12:58:21.369909 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:58:21.369883    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ad6d42_0c86_4c90_b8b6_99a693063ea8.slice/crio-942177ee92423b9792523de90afd47bdaa414b463151570090a7930b9adf353c WatchSource:0}: Error finding container 942177ee92423b9792523de90afd47bdaa414b463151570090a7930b9adf353c: Status 404 returned error can't find the container with id 942177ee92423b9792523de90afd47bdaa414b463151570090a7930b9adf353c
Sep 07 12:58:22.068997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:22.068962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46" event={"ID":"66ad6d42-0c86-4c90-b8b6-99a693063ea8","Type":"ContainerStarted","Data":"942177ee92423b9792523de90afd47bdaa414b463151570090a7930b9adf353c"}
Sep 07 12:58:23.074125 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:23.074092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46" event={"ID":"66ad6d42-0c86-4c90-b8b6-99a693063ea8","Type":"ContainerStarted","Data":"ff48075aa08327428dbc6a0340d1dfe26b0550ee9082ae0aa0c7541045631f3d"}
Sep 07 12:58:23.099548 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:58:23.099492    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8bh46" podStartSLOduration=1.551748221 podStartE2EDuration="3.099474854s" totalImagesPullingTime="1.547726633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:58:23.097662978 +0000 UTC m=+326.804445912" watchObservedRunningTime="2026-09-07 12:58:23.099474854 +0000 UTC m=+326.806257786"
Sep 07 12:59:09.769248 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.769214    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"]
Sep 07 12:59:09.773367 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.773349    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:09.775949 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.775925    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 12:59:09.777114 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.777091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfcv5\""
Sep 07 12:59:09.777207 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.777121    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 12:59:09.781763 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.781740    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"]
Sep 07 12:59:09.924933 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.924895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zcnv\" (UniqueName: \"kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:09.925094 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.924967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:09.925094 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:09.925018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.026399 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.026298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.026399 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.026378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zcnv\" (UniqueName: \"kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.026661 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.026432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.026749 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.026723    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.026814 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.026788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.035801 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.035766    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zcnv\" (UniqueName: \"kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.082217 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.082180    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:10.356447 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:10.356367    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"]
Sep 07 12:59:10.359408 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:10.359381    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c110769_4803_4e8d_94d5_5cb28731d5e1.slice/crio-66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec WatchSource:0}: Error finding container 66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec: Status 404 returned error can't find the container with id 66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec
Sep 07 12:59:11.243382 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:11.243344    2570 generic.go:356] "Generic (PLEG): container finished" podID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerID="1265d1b3c9bf9446a0853138ef1bcce0c045d05d895774edcd94197711597933" exitCode=0
Sep 07 12:59:11.243778 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:11.243397    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v" event={"ID":"7c110769-4803-4e8d-94d5-5cb28731d5e1","Type":"ContainerDied","Data":"1265d1b3c9bf9446a0853138ef1bcce0c045d05d895774edcd94197711597933"}
Sep 07 12:59:11.243778 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:11.243434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v" event={"ID":"7c110769-4803-4e8d-94d5-5cb28731d5e1","Type":"ContainerStarted","Data":"66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec"}
Sep 07 12:59:12.249441 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:12.249397    2570 generic.go:356] "Generic (PLEG): container finished" podID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerID="547e02216bcbcc520039e5afb94f93b9ba35fb11ef8660d7f98ac70738a0f7fe" exitCode=0
Sep 07 12:59:12.249912 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:12.249472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v" event={"ID":"7c110769-4803-4e8d-94d5-5cb28731d5e1","Type":"ContainerDied","Data":"547e02216bcbcc520039e5afb94f93b9ba35fb11ef8660d7f98ac70738a0f7fe"}
Sep 07 12:59:13.259450 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:13.259411    2570 generic.go:356] "Generic (PLEG): container finished" podID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerID="53dc5988a449fd4e82f44c86ac2245eaca053b30861023db8ddf422934ce1433" exitCode=0
Sep 07 12:59:13.259847 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:13.259470    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v" event={"ID":"7c110769-4803-4e8d-94d5-5cb28731d5e1","Type":"ContainerDied","Data":"53dc5988a449fd4e82f44c86ac2245eaca053b30861023db8ddf422934ce1433"}
Sep 07 12:59:14.383537 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.383511    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:14.464038 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.463993    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zcnv\" (UniqueName: \"kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv\") pod \"7c110769-4803-4e8d-94d5-5cb28731d5e1\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") "
Sep 07 12:59:14.464038 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.464042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util\") pod \"7c110769-4803-4e8d-94d5-5cb28731d5e1\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") "
Sep 07 12:59:14.464270 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.464073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle\") pod \"7c110769-4803-4e8d-94d5-5cb28731d5e1\" (UID: \"7c110769-4803-4e8d-94d5-5cb28731d5e1\") "
Sep 07 12:59:14.464895 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.464859    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle" (OuterVolumeSpecName: "bundle") pod "7c110769-4803-4e8d-94d5-5cb28731d5e1" (UID: "7c110769-4803-4e8d-94d5-5cb28731d5e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:59:14.466086 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.466063    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv" (OuterVolumeSpecName: "kube-api-access-7zcnv") pod "7c110769-4803-4e8d-94d5-5cb28731d5e1" (UID: "7c110769-4803-4e8d-94d5-5cb28731d5e1"). InnerVolumeSpecName "kube-api-access-7zcnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:59:14.469416 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.469389    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util" (OuterVolumeSpecName: "util") pod "7c110769-4803-4e8d-94d5-5cb28731d5e1" (UID: "7c110769-4803-4e8d-94d5-5cb28731d5e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:59:14.565534 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.565437    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zcnv\" (UniqueName: \"kubernetes.io/projected/7c110769-4803-4e8d-94d5-5cb28731d5e1-kube-api-access-7zcnv\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:14.565534 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.565469    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:14.565534 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:14.565482    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c110769-4803-4e8d-94d5-5cb28731d5e1-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:15.269520 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:15.269477    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v" event={"ID":"7c110769-4803-4e8d-94d5-5cb28731d5e1","Type":"ContainerDied","Data":"66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec"}
Sep 07 12:59:15.269782 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:15.269533    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66090311fdfff3c7f393faa03fdb4b58ffce8dab19fc24be1e22f87df82eedec"
Sep 07 12:59:15.269782 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:15.269487    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2rv4v"
Sep 07 12:59:19.383383 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383348    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"]
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383599    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="pull"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383610    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="pull"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383633    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="util"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383639    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="util"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383645    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="extract"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383651    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="extract"
Sep 07 12:59:19.383781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.383694    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c110769-4803-4e8d-94d5-5cb28731d5e1" containerName="extract"
Sep 07 12:59:19.386917 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.386901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.389374 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.389356    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 12:59:19.389462 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.389393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 12:59:19.390589 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.390575    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfcv5\""
Sep 07 12:59:19.395673 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.395648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"]
Sep 07 12:59:19.507084 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.507043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnbz\" (UniqueName: \"kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.507267 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.507101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.507267 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.507183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.608054 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.608013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.608201 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.608084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnbz\" (UniqueName: \"kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.608201 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.608132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.608550 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.608529    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.608550 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.608539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.621650 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.621603    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnbz\" (UniqueName: \"kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.696907 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.696852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:19.971674 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:19.971492    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"]
Sep 07 12:59:19.974349 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:19.974323    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4f3add_38bb_4a52_9df3_ddffc8f0e711.slice/crio-4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7 WatchSource:0}: Error finding container 4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7: Status 404 returned error can't find the container with id 4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7
Sep 07 12:59:20.290229 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:20.290135    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerID="5879cb3e2da17d62ee7e608f89f8f9e3b34b34cd4b548b671646e97ff209a797" exitCode=0
Sep 07 12:59:20.290229 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:20.290208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf" event={"ID":"aa4f3add-38bb-4a52-9df3-ddffc8f0e711","Type":"ContainerDied","Data":"5879cb3e2da17d62ee7e608f89f8f9e3b34b34cd4b548b671646e97ff209a797"}
Sep 07 12:59:20.290456 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:20.290244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf" event={"ID":"aa4f3add-38bb-4a52-9df3-ddffc8f0e711","Type":"ContainerStarted","Data":"4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7"}
Sep 07 12:59:21.110670 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.110634    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"]
Sep 07 12:59:21.113877 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.113837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.116846 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.116823    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 12:59:21.116975 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.116936    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 12:59:21.116975 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.116956    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hz4rq\""
Sep 07 12:59:21.117084 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.117002    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 12:59:21.117180 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.117162    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 12:59:21.125327 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.125306    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"]
Sep 07 12:59:21.223279 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.223244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.223466 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.223305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-manifests\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.223466 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.223384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-tmp\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.223466 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.223433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.223587 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.223482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2s56\" (UniqueName: \"kubernetes.io/projected/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-kube-api-access-p2s56\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.295804 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.295768    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerID="d77e1f11bb0c0aca0466fb56f980e56afcd9caad39afa4979f345220f15b7a11" exitCode=0
Sep 07 12:59:21.295971 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.295857    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf" event={"ID":"aa4f3add-38bb-4a52-9df3-ddffc8f0e711","Type":"ContainerDied","Data":"d77e1f11bb0c0aca0466fb56f980e56afcd9caad39afa4979f345220f15b7a11"}
Sep 07 12:59:21.324109 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2s56\" (UniqueName: \"kubernetes.io/projected/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-kube-api-access-p2s56\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.324218 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.324218 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-manifests\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.324218 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-tmp\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.324336 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.324522 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.324502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-manifests\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.326781 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.326755    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-tmp\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.326878 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.326849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.326943 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.326920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.337692 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.337658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2s56\" (UniqueName: \"kubernetes.io/projected/47ecd7ab-b18e-4dec-a2c0-d89a226a4c14-kube-api-access-p2s56\") pod \"opendatahub-operator-controller-manager-cc4b9478f-tmqd7\" (UID: \"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14\") " pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.424093 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.424057    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:21.705456 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:21.705433    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"]
Sep 07 12:59:21.707796 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:21.707768    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ecd7ab_b18e_4dec_a2c0_d89a226a4c14.slice/crio-6291aafda36ef2bf4381d5f0646c1a2f89e54859503c9833c3825efd6b6d6c73 WatchSource:0}: Error finding container 6291aafda36ef2bf4381d5f0646c1a2f89e54859503c9833c3825efd6b6d6c73: Status 404 returned error can't find the container with id 6291aafda36ef2bf4381d5f0646c1a2f89e54859503c9833c3825efd6b6d6c73
Sep 07 12:59:22.302225 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:22.302186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7" event={"ID":"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14","Type":"ContainerStarted","Data":"6291aafda36ef2bf4381d5f0646c1a2f89e54859503c9833c3825efd6b6d6c73"}
Sep 07 12:59:22.304756 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:22.304725    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerID="e4d785c0f08d53889a9676068e812fefc3237422c4bced3b5cbbc9eea8b2c7f2" exitCode=0
Sep 07 12:59:22.304957 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:22.304803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf" event={"ID":"aa4f3add-38bb-4a52-9df3-ddffc8f0e711","Type":"ContainerDied","Data":"e4d785c0f08d53889a9676068e812fefc3237422c4bced3b5cbbc9eea8b2c7f2"}
Sep 07 12:59:23.744957 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.744926    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:23.846541 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.846494    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle\") pod \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") "
Sep 07 12:59:23.846738 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.846550    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvnbz\" (UniqueName: \"kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz\") pod \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") "
Sep 07 12:59:23.846738 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.846658    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util\") pod \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\" (UID: \"aa4f3add-38bb-4a52-9df3-ddffc8f0e711\") "
Sep 07 12:59:23.847488 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.847433    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle" (OuterVolumeSpecName: "bundle") pod "aa4f3add-38bb-4a52-9df3-ddffc8f0e711" (UID: "aa4f3add-38bb-4a52-9df3-ddffc8f0e711"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:59:23.849151 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.849125    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz" (OuterVolumeSpecName: "kube-api-access-bvnbz") pod "aa4f3add-38bb-4a52-9df3-ddffc8f0e711" (UID: "aa4f3add-38bb-4a52-9df3-ddffc8f0e711"). InnerVolumeSpecName "kube-api-access-bvnbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 12:59:23.852344 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.852320    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util" (OuterVolumeSpecName: "util") pod "aa4f3add-38bb-4a52-9df3-ddffc8f0e711" (UID: "aa4f3add-38bb-4a52-9df3-ddffc8f0e711"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 12:59:23.948119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.948087    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:23.948119 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.948121    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvnbz\" (UniqueName: \"kubernetes.io/projected/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-kube-api-access-bvnbz\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:23.948316 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:23.948138    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4f3add-38bb-4a52-9df3-ddffc8f0e711-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 12:59:24.317968 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:24.317916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf" event={"ID":"aa4f3add-38bb-4a52-9df3-ddffc8f0e711","Type":"ContainerDied","Data":"4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7"}
Sep 07 12:59:24.317968 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:24.317963    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0l46kf"
Sep 07 12:59:24.317968 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:24.317975    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b5eaa011b0e38f35902a68f232d6260cd14d4f5b00de2395ff4378abc96abf7"
Sep 07 12:59:25.323828 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:25.323793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7" event={"ID":"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14","Type":"ContainerStarted","Data":"61ef05d624d7890719414990f2c7e9f730804b37f08d392c54b26379197906cb"}
Sep 07 12:59:26.329363 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:26.329325    2570 generic.go:356] "Generic (PLEG): container finished" podID="47ecd7ab-b18e-4dec-a2c0-d89a226a4c14" containerID="61ef05d624d7890719414990f2c7e9f730804b37f08d392c54b26379197906cb" exitCode=0
Sep 07 12:59:26.329858 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:26.329408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7" event={"ID":"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14","Type":"ContainerDied","Data":"61ef05d624d7890719414990f2c7e9f730804b37f08d392c54b26379197906cb"}
Sep 07 12:59:27.335598 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:27.335563    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7" event={"ID":"47ecd7ab-b18e-4dec-a2c0-d89a226a4c14","Type":"ContainerStarted","Data":"1ab4284dd4afcbc2f576f01dcedc117400b2db17c8392ee4a53e5c5ee6da13c0"}
Sep 07 12:59:27.336089 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:27.335671    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:27.363985 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:27.363937    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7" podStartSLOduration=1.986929817 podStartE2EDuration="6.363921576s" totalImagesPullingTime="3.277041561s" totalInitContainerRuntime="1.099950198s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:27.362218138 +0000 UTC m=+391.069001070" watchObservedRunningTime="2026-09-07 12:59:27.363921576 +0000 UTC m=+391.070704508"
Sep 07 12:59:35.642760 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.642723    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76575d89bb-49k4s"]
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643014    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="util"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643026    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="util"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643033    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="pull"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643038    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="pull"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643044    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="extract"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643050    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="extract"
Sep 07 12:59:35.643127 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.643101    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4f3add-38bb-4a52-9df3-ddffc8f0e711" containerName="extract"
Sep 07 12:59:35.653158 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.653134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.656775 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.656743    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76575d89bb-49k4s"]
Sep 07 12:59:35.729730 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-trusted-ca-bundle\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729730 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mtk\" (UniqueName: \"kubernetes.io/projected/9c04511b-c8e7-47eb-b697-57921e5caf2a-kube-api-access-58mtk\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729930 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-oauth-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729930 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729930 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729833    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729930 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-service-ca\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.729930 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.729909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-oauth-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.830773 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-oauth-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.830773 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830775    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831011 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831011 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-service-ca\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831011 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-oauth-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831011 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-trusted-ca-bundle\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831204 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.830998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mtk\" (UniqueName: \"kubernetes.io/projected/9c04511b-c8e7-47eb-b697-57921e5caf2a-kube-api-access-58mtk\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831614 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.831583    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-oauth-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831790 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.831598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831790 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.831700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-service-ca\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.831997 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.831978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c04511b-c8e7-47eb-b697-57921e5caf2a-trusted-ca-bundle\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.833368 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.833349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-serving-cert\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.833457 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.833377    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c04511b-c8e7-47eb-b697-57921e5caf2a-console-oauth-config\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.842758 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.842738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mtk\" (UniqueName: \"kubernetes.io/projected/9c04511b-c8e7-47eb-b697-57921e5caf2a-kube-api-access-58mtk\") pod \"console-76575d89bb-49k4s\" (UID: \"9c04511b-c8e7-47eb-b697-57921e5caf2a\") " pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:35.963138 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:35.963094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:36.258840 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:36.258812    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76575d89bb-49k4s"]
Sep 07 12:59:36.260516 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:36.260494    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c04511b_c8e7_47eb_b697_57921e5caf2a.slice/crio-d1e15a7deebba15f04353806d74c062f0e693688452a6b4e27c1a3a7f85227ab WatchSource:0}: Error finding container d1e15a7deebba15f04353806d74c062f0e693688452a6b4e27c1a3a7f85227ab: Status 404 returned error can't find the container with id d1e15a7deebba15f04353806d74c062f0e693688452a6b4e27c1a3a7f85227ab
Sep 07 12:59:36.373569 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:36.373538    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76575d89bb-49k4s" event={"ID":"9c04511b-c8e7-47eb-b697-57921e5caf2a","Type":"ContainerStarted","Data":"d1e15a7deebba15f04353806d74c062f0e693688452a6b4e27c1a3a7f85227ab"}
Sep 07 12:59:37.379298 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:37.379257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76575d89bb-49k4s" event={"ID":"9c04511b-c8e7-47eb-b697-57921e5caf2a","Type":"ContainerStarted","Data":"e5b5945c91063a48d232bd8132fa7ffeff5b26b776e7617c28ce2e1b94325f24"}
Sep 07 12:59:37.399550 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:37.399492    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76575d89bb-49k4s" podStartSLOduration=2.399470779 podStartE2EDuration="2.399470779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:37.398341441 +0000 UTC m=+401.105124406" watchObservedRunningTime="2026-09-07 12:59:37.399470779 +0000 UTC m=+401.106253712"
Sep 07 12:59:38.342012 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:38.341980    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cc4b9478f-tmqd7"
Sep 07 12:59:42.356783 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.356747    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"]
Sep 07 12:59:42.360165 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.360139    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.363849 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.363826    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 12:59:42.363974 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.363928    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4wctm\""
Sep 07 12:59:42.364040 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.363974    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 12:59:42.364040 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.363981    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 12:59:42.364040 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.364030    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 12:59:42.374530 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.374504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"]
Sep 07 12:59:42.384198 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.384172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2zs\" (UniqueName: \"kubernetes.io/projected/f28fb77a-c190-44ef-9b41-da3758e10623-kube-api-access-8t2zs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.384329 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.384213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28fb77a-c190-44ef-9b41-da3758e10623-tls-certs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.384329 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.384241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28fb77a-c190-44ef-9b41-da3758e10623-tmp\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.485671 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.485613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2zs\" (UniqueName: \"kubernetes.io/projected/f28fb77a-c190-44ef-9b41-da3758e10623-kube-api-access-8t2zs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.485853 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.485687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28fb77a-c190-44ef-9b41-da3758e10623-tls-certs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.485853 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.485711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28fb77a-c190-44ef-9b41-da3758e10623-tmp\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.488022 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.487989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28fb77a-c190-44ef-9b41-da3758e10623-tmp\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.488218 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.488200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28fb77a-c190-44ef-9b41-da3758e10623-tls-certs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.495656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.495606    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2zs\" (UniqueName: \"kubernetes.io/projected/f28fb77a-c190-44ef-9b41-da3758e10623-kube-api-access-8t2zs\") pod \"kube-auth-proxy-558c85b7d6-fl4x5\" (UID: \"f28fb77a-c190-44ef-9b41-da3758e10623\") " pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.670087 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.670058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"
Sep 07 12:59:42.944423 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:42.944394    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5"]
Sep 07 12:59:42.947050 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:42.947023    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28fb77a_c190_44ef_9b41_da3758e10623.slice/crio-9956df7ec0fbd54b9763a71988e55364861f51343cb9fc2768bb3e6ceda89f6c WatchSource:0}: Error finding container 9956df7ec0fbd54b9763a71988e55364861f51343cb9fc2768bb3e6ceda89f6c: Status 404 returned error can't find the container with id 9956df7ec0fbd54b9763a71988e55364861f51343cb9fc2768bb3e6ceda89f6c
Sep 07 12:59:43.407412 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.407378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5" event={"ID":"f28fb77a-c190-44ef-9b41-da3758e10623","Type":"ContainerStarted","Data":"9956df7ec0fbd54b9763a71988e55364861f51343cb9fc2768bb3e6ceda89f6c"}
Sep 07 12:59:43.589493 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.589459    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 12:59:43.593815 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.593793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.596535 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.596507    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 12:59:43.596535 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.596528    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6pc4q\""
Sep 07 12:59:43.596741 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.596511    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 12:59:43.596741 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.596531    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 12:59:43.596741 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.596511    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 12:59:43.610377 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.610356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 12:59:43.696313 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696217    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696313 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696269    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gs7x\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696313 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696595 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696595 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696595 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696398    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.696595 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.696437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gs7x\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797484    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.797656 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.798175 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.797685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.798882 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.798782    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.800576 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.800529    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.800907 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.800878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.801141 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.801116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.801212 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.801189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.808565 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.808534    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gs7x\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.808742 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.808578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-9qhf5\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:43.903863 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:43.903816    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:44.200840 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:44.200810    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 12:59:44.202813 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:44.202787    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d3abb0_0045_4e76_a318_89b4f3aa088d.slice/crio-cbefd08b9fd81ba98ac1d2d5865c1182387ec1561083af8811b922e121cb75c0 WatchSource:0}: Error finding container cbefd08b9fd81ba98ac1d2d5865c1182387ec1561083af8811b922e121cb75c0: Status 404 returned error can't find the container with id cbefd08b9fd81ba98ac1d2d5865c1182387ec1561083af8811b922e121cb75c0
Sep 07 12:59:44.414661 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:44.414598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" event={"ID":"18d3abb0-0045-4e76-a318-89b4f3aa088d","Type":"ContainerStarted","Data":"cbefd08b9fd81ba98ac1d2d5865c1182387ec1561083af8811b922e121cb75c0"}
Sep 07 12:59:45.963495 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:45.963208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:45.963495 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:45.963272    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:45.969360 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:45.969333    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:46.425873 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:46.425829    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5" event={"ID":"f28fb77a-c190-44ef-9b41-da3758e10623","Type":"ContainerStarted","Data":"c4ccf12534b57babe37464492579614ead8be44a40f86b12415023c789bdd100"}
Sep 07 12:59:46.430350 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:46.430323    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76575d89bb-49k4s"
Sep 07 12:59:46.447355 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:46.447294    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-558c85b7d6-fl4x5" podStartSLOduration=1.639970066 podStartE2EDuration="4.447271233s" totalImagesPullingTime="2.807301167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:46.445646291 +0000 UTC m=+410.152429224" watchObservedRunningTime="2026-09-07 12:59:46.447271233 +0000 UTC m=+410.154054166"
Sep 07 12:59:46.497824 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:46.497791    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 12:59:47.544088 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:47.544052    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 12:59:47.544351 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:47.544122    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 12:59:48.435926 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:48.435887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" event={"ID":"18d3abb0-0045-4e76-a318-89b4f3aa088d","Type":"ContainerStarted","Data":"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"}
Sep 07 12:59:48.436151 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:48.436079    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:48.437763 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:48.437738    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-9qhf5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 12:59:48.437869 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:48.437794    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 12:59:48.468363 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:48.468305    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" podStartSLOduration=2.129800626 podStartE2EDuration="5.468288107s" totalImagesPullingTime="3.338487481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:48.467028265 +0000 UTC m=+412.173811198" watchObservedRunningTime="2026-09-07 12:59:48.468288107 +0000 UTC m=+412.175071037"
Sep 07 12:59:49.443940 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:49.443912    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 12:59:52.977455 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:52.977417    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pf6sb"]
Sep 07 12:59:52.980476 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:52.980456    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:52.983954 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:52.983932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c8cwb\""
Sep 07 12:59:52.985137 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:52.985119    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 12:59:52.996856 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:52.996829    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pf6sb"]
Sep 07 12:59:53.079649 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.079600    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.079649 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.079649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dqbt\" (UniqueName: \"kubernetes.io/projected/430164e9-3193-466f-904c-f2f542957ebd-kube-api-access-4dqbt\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.180941 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.180899    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.180941 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.180942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dqbt\" (UniqueName: \"kubernetes.io/projected/430164e9-3193-466f-904c-f2f542957ebd-kube-api-access-4dqbt\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.181217 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:59:53.181070    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 07 12:59:53.181217 ip-10-0-143-132 kubenswrapper[2570]: E0907 12:59:53.181151    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert podName:430164e9-3193-466f-904c-f2f542957ebd nodeName:}" failed. No retries permitted until 2026-09-07 12:59:53.681129381 +0000 UTC m=+417.387912313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert") pod "odh-model-controller-7998c67dc4-pf6sb" (UID: "430164e9-3193-466f-904c-f2f542957ebd") : secret "odh-model-controller-webhook-cert" not found
Sep 07 12:59:53.191058 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.191028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dqbt\" (UniqueName: \"kubernetes.io/projected/430164e9-3193-466f-904c-f2f542957ebd-kube-api-access-4dqbt\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.686207 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.686161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.688566 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.688537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/430164e9-3193-466f-904c-f2f542957ebd-cert\") pod \"odh-model-controller-7998c67dc4-pf6sb\" (UID: \"430164e9-3193-466f-904c-f2f542957ebd\") " pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:53.890785 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:53.890741    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:54.161936 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:54.161907    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pf6sb"]
Sep 07 12:59:54.164596 ip-10-0-143-132 kubenswrapper[2570]: W0907 12:59:54.164575    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430164e9_3193_466f_904c_f2f542957ebd.slice/crio-114c79a44d89afd03086dcc354e738435cbbf01479557d75d9f5701a123f3403 WatchSource:0}: Error finding container 114c79a44d89afd03086dcc354e738435cbbf01479557d75d9f5701a123f3403: Status 404 returned error can't find the container with id 114c79a44d89afd03086dcc354e738435cbbf01479557d75d9f5701a123f3403
Sep 07 12:59:54.465415 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:54.465381    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb" event={"ID":"430164e9-3193-466f-904c-f2f542957ebd","Type":"ContainerStarted","Data":"114c79a44d89afd03086dcc354e738435cbbf01479557d75d9f5701a123f3403"}
Sep 07 12:59:58.488067 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:58.488019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb" event={"ID":"430164e9-3193-466f-904c-f2f542957ebd","Type":"ContainerStarted","Data":"a17a5bcb02d1f67c9facee671dbd1049eb615a79199bcd556abb25d8db3278fc"}
Sep 07 12:59:58.488449 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:58.488096    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 12:59:58.511975 ip-10-0-143-132 kubenswrapper[2570]: I0907 12:59:58.511924    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb" podStartSLOduration=3.136824922 podStartE2EDuration="6.511908459s" totalImagesPullingTime="3.375083537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:58.510917183 +0000 UTC m=+422.217700126" watchObservedRunningTime="2026-09-07 12:59:58.511908459 +0000 UTC m=+422.218691391"
Sep 07 13:00:02.295696 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.295657    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"]
Sep 07 13:00:02.299440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.299419    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.302942 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.302913    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gt8hn\""
Sep 07 13:00:02.303184 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.303170    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 13:00:02.307253 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.307227    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"]
Sep 07 13:00:02.310747 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.310728    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.312033 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.312007    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"]
Sep 07 13:00:02.314914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.314877    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bnrbq\""
Sep 07 13:00:02.315430 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.315243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 13:00:02.325158 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.325099    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"]
Sep 07 13:00:02.362268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.362232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2v6\" (UniqueName: \"kubernetes.io/projected/69839a41-3ab9-412f-a4fb-b6b40d48af94-kube-api-access-hq2v6\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.362456 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.362357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.463105 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.463057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2v6\" (UniqueName: \"kubernetes.io/projected/69839a41-3ab9-412f-a4fb-b6b40d48af94-kube-api-access-hq2v6\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.463319 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.463134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.463319 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.463189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcs4v\" (UniqueName: \"kubernetes.io/projected/44c54b51-8d4b-4958-adf6-ca5d3de13a39-kube-api-access-qcs4v\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.463319 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.463228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.463475 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:02.463320    2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 07 13:00:02.463475 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:02.463404    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert podName:69839a41-3ab9-412f-a4fb-b6b40d48af94 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:02.963380583 +0000 UTC m=+426.670163495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert") pod "kserve-controller-manager-d6f4b65b8-m7m5l" (UID: "69839a41-3ab9-412f-a4fb-b6b40d48af94") : secret "kserve-webhook-server-cert" not found
Sep 07 13:00:02.475905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.475874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2v6\" (UniqueName: \"kubernetes.io/projected/69839a41-3ab9-412f-a4fb-b6b40d48af94-kube-api-access-hq2v6\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.564693 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.564581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.564693 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.564649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcs4v\" (UniqueName: \"kubernetes.io/projected/44c54b51-8d4b-4958-adf6-ca5d3de13a39-kube-api-access-qcs4v\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.564894 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:02.564740    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 07 13:00:02.564894 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:02.564816    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert podName:44c54b51-8d4b-4958-adf6-ca5d3de13a39 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:03.06479941 +0000 UTC m=+426.771582340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert") pod "llmisvc-controller-manager-777c6bd7d5-8dgqv" (UID: "44c54b51-8d4b-4958-adf6-ca5d3de13a39") : secret "llmisvc-webhook-server-cert" not found
Sep 07 13:00:02.578007 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.577980    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcs4v\" (UniqueName: \"kubernetes.io/projected/44c54b51-8d4b-4958-adf6-ca5d3de13a39-kube-api-access-qcs4v\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:02.968610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.968560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:02.971149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:02.971123    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69839a41-3ab9-412f-a4fb-b6b40d48af94-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7m5l\" (UID: \"69839a41-3ab9-412f-a4fb-b6b40d48af94\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:03.069736 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.069696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:03.072256 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.072231    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44c54b51-8d4b-4958-adf6-ca5d3de13a39-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8dgqv\" (UID: \"44c54b51-8d4b-4958-adf6-ca5d3de13a39\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:03.211291 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.211258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:03.221153 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.220983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:03.477595 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.477505    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 13:00:03.478051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.477802    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerName="discovery" containerID="cri-o://7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f" gracePeriod=30
Sep 07 13:00:03.497487 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.497404    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"]
Sep 07 13:00:03.500446 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:03.500417    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69839a41_3ab9_412f_a4fb_b6b40d48af94.slice/crio-e5f6e7b8bcebd6cf68886811f84db4ce6c5bb9fafe9db41137b9fa04310bc413 WatchSource:0}: Error finding container e5f6e7b8bcebd6cf68886811f84db4ce6c5bb9fafe9db41137b9fa04310bc413: Status 404 returned error can't find the container with id e5f6e7b8bcebd6cf68886811f84db4ce6c5bb9fafe9db41137b9fa04310bc413
Sep 07 13:00:03.513122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.513021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l" event={"ID":"69839a41-3ab9-412f-a4fb-b6b40d48af94","Type":"ContainerStarted","Data":"e5f6e7b8bcebd6cf68886811f84db4ce6c5bb9fafe9db41137b9fa04310bc413"}
Sep 07 13:00:03.517479 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.517457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"]
Sep 07 13:00:03.535438 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:03.535406    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod44c54b51_8d4b_4958_adf6_ca5d3de13a39.slice/crio-1fe913abb8e5c22727302163cb3f2b030d5c46d50d5de30cf2c990a014c5f504 WatchSource:0}: Error finding container 1fe913abb8e5c22727302163cb3f2b030d5c46d50d5de30cf2c990a014c5f504: Status 404 returned error can't find the container with id 1fe913abb8e5c22727302163cb3f2b030d5c46d50d5de30cf2c990a014c5f504
Sep 07 13:00:03.719505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.719480    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 13:00:03.877856 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.877758    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gs7x\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.877856 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.877816    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878085 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.877859    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878085 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.877934    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878085 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.878058    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878238 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.878100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878238 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.878126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig\") pod \"18d3abb0-0045-4e76-a318-89b4f3aa088d\" (UID: \"18d3abb0-0045-4e76-a318-89b4f3aa088d\") "
Sep 07 13:00:03.878486 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.878456    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:00:03.880335 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880310    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs" (OuterVolumeSpecName: "local-certs") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:00:03.880442 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880345    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:00:03.880556 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880536    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x" (OuterVolumeSpecName: "kube-api-access-5gs7x") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "kube-api-access-5gs7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:00:03.880605 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880548    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token" (OuterVolumeSpecName: "istio-token") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:00:03.880678 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880651    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:00:03.880678 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.880645    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts" (OuterVolumeSpecName: "cacerts") pod "18d3abb0-0045-4e76-a318-89b4f3aa088d" (UID: "18d3abb0-0045-4e76-a318-89b4f3aa088d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:00:03.980133 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980090    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-dns-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980133 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980132    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d3abb0-0045-4e76-a318-89b4f3aa088d-local-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980146    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-token\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980158    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-csr-ca-configmap\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980171    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-cacerts\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980184    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18d3abb0-0045-4e76-a318-89b4f3aa088d-istio-kubeconfig\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:03.980325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:03.980197    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gs7x\" (UniqueName: \"kubernetes.io/projected/18d3abb0-0045-4e76-a318-89b4f3aa088d-kube-api-access-5gs7x\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:04.518952 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.518916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv" event={"ID":"44c54b51-8d4b-4958-adf6-ca5d3de13a39","Type":"ContainerStarted","Data":"1fe913abb8e5c22727302163cb3f2b030d5c46d50d5de30cf2c990a014c5f504"}
Sep 07 13:00:04.520163 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.520135    2570 generic.go:356] "Generic (PLEG): container finished" podID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerID="7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f" exitCode=0
Sep 07 13:00:04.520276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.520174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" event={"ID":"18d3abb0-0045-4e76-a318-89b4f3aa088d","Type":"ContainerDied","Data":"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"}
Sep 07 13:00:04.520276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.520188    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"
Sep 07 13:00:04.520276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.520217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5" event={"ID":"18d3abb0-0045-4e76-a318-89b4f3aa088d","Type":"ContainerDied","Data":"cbefd08b9fd81ba98ac1d2d5865c1182387ec1561083af8811b922e121cb75c0"}
Sep 07 13:00:04.520276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.520243    2570 scope.go:117] "RemoveContainer" containerID="7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"
Sep 07 13:00:04.528830 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.528808    2570 scope.go:117] "RemoveContainer" containerID="7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"
Sep 07 13:00:04.529152 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:04.529129    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f\": container with ID starting with 7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f not found: ID does not exist" containerID="7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"
Sep 07 13:00:04.529220 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.529165    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f"} err="failed to get container status \"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f\": rpc error: code = NotFound desc = could not find container \"7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f\": container with ID starting with 7f4458addb87382cbd5f63f6b73f26e28957da8c04f5cb921c7c8fa8918bd23f not found: ID does not exist"
Sep 07 13:00:04.548772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.548741    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 13:00:04.554968 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.554938    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9qhf5"]
Sep 07 13:00:04.814554 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:04.814475    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" path="/var/lib/kubelet/pods/18d3abb0-0045-4e76-a318-89b4f3aa088d/volumes"
Sep 07 13:00:07.538029 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:07.537991    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l" event={"ID":"69839a41-3ab9-412f-a4fb-b6b40d48af94","Type":"ContainerStarted","Data":"e9bb79218d715286800c3ac31e4771b60be1b1b5e2f62b536b1a78d68db47b04"}
Sep 07 13:00:07.538410 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:07.538074    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:07.556573 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:07.556419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l" podStartSLOduration=2.4112282609999998 podStartE2EDuration="5.556402151s" totalImagesPullingTime="3.14517389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:07.555881133 +0000 UTC m=+431.262664074" watchObservedRunningTime="2026-09-07 13:00:07.556402151 +0000 UTC m=+431.263185108"
Sep 07 13:00:09.495362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:09.495331    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pf6sb"
Sep 07 13:00:09.550156 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:09.550057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv" event={"ID":"44c54b51-8d4b-4958-adf6-ca5d3de13a39","Type":"ContainerStarted","Data":"5210795310f199810ad0f0340cce7e8d0e75227a533a5e102f8bfd65a18f6af1"}
Sep 07 13:00:09.550327 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:09.550169    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:09.569318 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:09.569255    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv" podStartSLOduration=1.896442123 podStartE2EDuration="7.569231593s" totalImagesPullingTime="5.67278947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:09.567808448 +0000 UTC m=+433.274591380" watchObservedRunningTime="2026-09-07 13:00:09.569231593 +0000 UTC m=+433.276014528"
Sep 07 13:00:11.525063 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.525013    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b8dc4964b-86v92" podUID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" containerName="console" containerID="cri-o://1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc" gracePeriod=15
Sep 07 13:00:11.771986 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.771959    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 13:00:11.946869 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.946829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.946891    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9rl6\" (UniqueName: \"kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.946917    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947165 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947165 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947083    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947165 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947310 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947167    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config\") pod \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\" (UID: \"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa\") "
Sep 07 13:00:11.947364 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947303    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:00:11.947467 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947439    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-oauth-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:11.947684 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947657    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:00:11.947746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config" (OuterVolumeSpecName: "console-config") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:00:11.947895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.947875    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:00:11.949639 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.949583    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6" (OuterVolumeSpecName: "kube-api-access-c9rl6") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "kube-api-access-c9rl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:00:11.949754 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.949700    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:00:11.949924 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:11.949905    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" (UID: "1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:00:12.048799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048759    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.048799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048792    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-oauth-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.048799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048804    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9rl6\" (UniqueName: \"kubernetes.io/projected/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-kube-api-access-c9rl6\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.049045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048813    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-console-serving-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.049045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048823    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.049045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.048830    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa-trusted-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:00:12.564421 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.564385    2570 generic.go:356] "Generic (PLEG): container finished" podID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" containerID="1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc" exitCode=0
Sep 07 13:00:12.564816 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.564467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8dc4964b-86v92"
Sep 07 13:00:12.564816 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.564468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dc4964b-86v92" event={"ID":"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa","Type":"ContainerDied","Data":"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"}
Sep 07 13:00:12.564816 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.564531    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8dc4964b-86v92" event={"ID":"1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa","Type":"ContainerDied","Data":"fce451d4df89382475c63eecf87b3e244033ed68fd0750dfea1cd1b68f562a74"}
Sep 07 13:00:12.564816 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.564558    2570 scope.go:117] "RemoveContainer" containerID="1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"
Sep 07 13:00:12.573367 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.573347    2570 scope.go:117] "RemoveContainer" containerID="1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"
Sep 07 13:00:12.573699 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:00:12.573679    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc\": container with ID starting with 1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc not found: ID does not exist" containerID="1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"
Sep 07 13:00:12.573771 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.573706    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc"} err="failed to get container status \"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc\": rpc error: code = NotFound desc = could not find container \"1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc\": container with ID starting with 1f7ce038477e7351b8660dc6382f5deaec6c05eef8ec46bdb659dc6d792e5fcc not found: ID does not exist"
Sep 07 13:00:12.588264 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.588236    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 13:00:12.594522 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.594498    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8dc4964b-86v92"]
Sep 07 13:00:12.815093 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:12.815014    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" path="/var/lib/kubelet/pods/1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa/volumes"
Sep 07 13:00:38.548475 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:38.548439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7m5l"
Sep 07 13:00:40.557559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:40.557529    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8dgqv"
Sep 07 13:00:58.094360 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094321    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"]
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094611    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" containerName="console"
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094638    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" containerName="console"
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094646    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerName="discovery"
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094651    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerName="discovery"
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094698    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d3abb0-0045-4e76-a318-89b4f3aa088d" containerName="discovery"
Sep 07 13:00:58.094781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.094706    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee4ba42-9b19-4266-9f79-ddfb3ccce4aa" containerName="console"
Sep 07 13:00:58.099080 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.099062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.102439 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.102413    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfcv5\""
Sep 07 13:00:58.102564 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.102464    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 13:00:58.102564 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.102469    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 13:00:58.107757 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.107736    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"]
Sep 07 13:00:58.182055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.182017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fs8w\" (UniqueName: \"kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.182055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.182059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.182265 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.182127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.186253 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.186228    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"]
Sep 07 13:00:58.195032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.195003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.199614 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.199584    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"]
Sep 07 13:00:58.283301 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.283301 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.283571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.283571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fs8w\" (UniqueName: \"kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.283571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.283571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwfkz\" (UniqueName: \"kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.283749 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.283826 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.283809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.296728 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.296700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fs8w\" (UniqueName: \"kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.296879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.296826    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"]
Sep 07 13:00:58.300292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.300274    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.310496 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.310469    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"]
Sep 07 13:00:58.384743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.384743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.384743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwfkz\" (UniqueName: \"kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.384967 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.384967 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6jgt\" (UniqueName: \"kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.384967 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.384843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.385244 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.385222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.385279 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.385234    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.393246 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.393221    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"]
Sep 07 13:00:58.396221 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.396190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwfkz\" (UniqueName: \"kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.396728 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.396713    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.407473 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.407446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"]
Sep 07 13:00:58.408709 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.408685    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:00:58.485740 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6jgt\" (UniqueName: \"kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.485740 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.486012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.486012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.486012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.486012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.485915    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbsc\" (UniqueName: \"kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.486223 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.486166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.486280 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.486241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.495074 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.495050    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6jgt\" (UniqueName: \"kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.505833 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.505806    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:00:58.587046 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.587015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbsc\" (UniqueName: \"kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.587220 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.587075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.587220 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.587098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.587426 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.587407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.587551 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.587458    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.596464 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.596439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbsc\" (UniqueName: \"kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.611320 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.611293    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:00:58.688675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.688645    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"]
Sep 07 13:00:58.690313 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:58.690284    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac920ab_78cb_4aec_b813_8641e0e2f335.slice/crio-e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac WatchSource:0}: Error finding container e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac: Status 404 returned error can't find the container with id e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac
Sep 07 13:00:58.711376 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.711355    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:00:58.772772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.772521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls" event={"ID":"6ac920ab-78cb-4aec-b813-8641e0e2f335","Type":"ContainerStarted","Data":"e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac"}
Sep 07 13:00:58.785061 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.785004    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"]
Sep 07 13:00:58.788321 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:58.788291    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86be47f9_8c15_4024_a922_705afc777130.slice/crio-f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e WatchSource:0}: Error finding container f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e: Status 404 returned error can't find the container with id f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e
Sep 07 13:00:58.884758 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.884733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"]
Sep 07 13:00:58.886110 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:58.886085    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf23e61e_24a1_4d45_9957_ddec19d9bb59.slice/crio-39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22 WatchSource:0}: Error finding container 39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22: Status 404 returned error can't find the container with id 39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22
Sep 07 13:00:58.986612 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:58.986583    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"]
Sep 07 13:00:59.029881 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:00:59.029846    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc89b02_52af_46c0_9acc_01e5a8e211ec.slice/crio-c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d WatchSource:0}: Error finding container c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d: Status 404 returned error can't find the container with id c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d
Sep 07 13:00:59.778815 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.778778    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerID="ff4ccc923e4897755e0666bec09e3805f6190cf755a3e21c4c271f64ab3e4e42" exitCode=0
Sep 07 13:00:59.779240 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.778858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls" event={"ID":"6ac920ab-78cb-4aec-b813-8641e0e2f335","Type":"ContainerDied","Data":"ff4ccc923e4897755e0666bec09e3805f6190cf755a3e21c4c271f64ab3e4e42"}
Sep 07 13:00:59.780439 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.780386    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerID="3ca19b9ed3f398e7e17e3c51f5270761bf3b2fd1ce49a633aef8b8639976f28b" exitCode=0
Sep 07 13:00:59.780500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.780470    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk" event={"ID":"3fc89b02-52af-46c0-9acc-01e5a8e211ec","Type":"ContainerDied","Data":"3ca19b9ed3f398e7e17e3c51f5270761bf3b2fd1ce49a633aef8b8639976f28b"}
Sep 07 13:00:59.780563 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.780515    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk" event={"ID":"3fc89b02-52af-46c0-9acc-01e5a8e211ec","Type":"ContainerStarted","Data":"c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d"}
Sep 07 13:00:59.782300 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.782277    2570 generic.go:356] "Generic (PLEG): container finished" podID="86be47f9-8c15-4024-a922-705afc777130" containerID="200cb9141a3e28ba2d3445ebf0e3fbbebf2cdca2cdab60f8719cbc1b3c7096d3" exitCode=0
Sep 07 13:00:59.782375 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.782353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c" event={"ID":"86be47f9-8c15-4024-a922-705afc777130","Type":"ContainerDied","Data":"200cb9141a3e28ba2d3445ebf0e3fbbebf2cdca2cdab60f8719cbc1b3c7096d3"}
Sep 07 13:00:59.782448 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.782399    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c" event={"ID":"86be47f9-8c15-4024-a922-705afc777130","Type":"ContainerStarted","Data":"f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e"}
Sep 07 13:00:59.784183 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.784141    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerID="8056ea3721452581f5eab93381f6581a13d714ee553093b55e0fb58bd2352aee" exitCode=0
Sep 07 13:00:59.784258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.784201    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw" event={"ID":"cf23e61e-24a1-4d45-9957-ddec19d9bb59","Type":"ContainerDied","Data":"8056ea3721452581f5eab93381f6581a13d714ee553093b55e0fb58bd2352aee"}
Sep 07 13:00:59.784258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:00:59.784230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw" event={"ID":"cf23e61e-24a1-4d45-9957-ddec19d9bb59","Type":"ContainerStarted","Data":"39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22"}
Sep 07 13:01:00.791260 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:00.791226    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerID="45a5e509639420281b4903c47903a844e22d06d2ac97924e2d4cca65b8564134" exitCode=0
Sep 07 13:01:00.791634 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:00.791302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk" event={"ID":"3fc89b02-52af-46c0-9acc-01e5a8e211ec","Type":"ContainerDied","Data":"45a5e509639420281b4903c47903a844e22d06d2ac97924e2d4cca65b8564134"}
Sep 07 13:01:01.798549 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:01.798514    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerID="c893915692fae1e99f77200e7fb698aeedae1ad24b8af9a196bb5493a99dd4b0" exitCode=0
Sep 07 13:01:01.798985 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:01.798603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw" event={"ID":"cf23e61e-24a1-4d45-9957-ddec19d9bb59","Type":"ContainerDied","Data":"c893915692fae1e99f77200e7fb698aeedae1ad24b8af9a196bb5493a99dd4b0"}
Sep 07 13:01:01.800882 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:01.800859    2570 generic.go:356] "Generic (PLEG): container finished" podID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerID="2e545d6102b564529c7c051a8c57ae398ff7c5cecc1227ba1ff56e3370a87708" exitCode=0
Sep 07 13:01:01.801021 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:01.800914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk" event={"ID":"3fc89b02-52af-46c0-9acc-01e5a8e211ec","Type":"ContainerDied","Data":"2e545d6102b564529c7c051a8c57ae398ff7c5cecc1227ba1ff56e3370a87708"}
Sep 07 13:01:02.807328 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:02.807237    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerID="55090e7d799933ee4a20ac82665aac5eeb40efb050bee16df57b127643f7a193" exitCode=0
Sep 07 13:01:02.807812 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:02.807330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw" event={"ID":"cf23e61e-24a1-4d45-9957-ddec19d9bb59","Type":"ContainerDied","Data":"55090e7d799933ee4a20ac82665aac5eeb40efb050bee16df57b127643f7a193"}
Sep 07 13:01:02.809143 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:02.809122    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerID="eac12f3ec6b9030d6722a0f8054ee72d8bbc2510d20673d8d2b4a26a1e2f9f56" exitCode=0
Sep 07 13:01:02.815436 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:02.815409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls" event={"ID":"6ac920ab-78cb-4aec-b813-8641e0e2f335","Type":"ContainerDied","Data":"eac12f3ec6b9030d6722a0f8054ee72d8bbc2510d20673d8d2b4a26a1e2f9f56"}
Sep 07 13:01:02.937926 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:02.937895    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:01:03.025811 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.025773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrbsc\" (UniqueName: \"kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc\") pod \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") "
Sep 07 13:01:03.026005 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.025820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util\") pod \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") "
Sep 07 13:01:03.026005 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.025845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle\") pod \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\" (UID: \"3fc89b02-52af-46c0-9acc-01e5a8e211ec\") "
Sep 07 13:01:03.026449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.026423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle" (OuterVolumeSpecName: "bundle") pod "3fc89b02-52af-46c0-9acc-01e5a8e211ec" (UID: "3fc89b02-52af-46c0-9acc-01e5a8e211ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:03.027895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.027871    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc" (OuterVolumeSpecName: "kube-api-access-jrbsc") pod "3fc89b02-52af-46c0-9acc-01e5a8e211ec" (UID: "3fc89b02-52af-46c0-9acc-01e5a8e211ec"). InnerVolumeSpecName "kube-api-access-jrbsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:03.033505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.033472    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util" (OuterVolumeSpecName: "util") pod "3fc89b02-52af-46c0-9acc-01e5a8e211ec" (UID: "3fc89b02-52af-46c0-9acc-01e5a8e211ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:03.126510 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.126422    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:03.126510 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.126453    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fc89b02-52af-46c0-9acc-01e5a8e211ec-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:03.126510 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.126465    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrbsc\" (UniqueName: \"kubernetes.io/projected/3fc89b02-52af-46c0-9acc-01e5a8e211ec-kube-api-access-jrbsc\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:03.816486 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.816446    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerID="e97e772d99899434744253f49a15b7654e5351769c42f5f61c495b0b2e8084d4" exitCode=0
Sep 07 13:01:03.816971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.816514    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls" event={"ID":"6ac920ab-78cb-4aec-b813-8641e0e2f335","Type":"ContainerDied","Data":"e97e772d99899434744253f49a15b7654e5351769c42f5f61c495b0b2e8084d4"}
Sep 07 13:01:03.818399 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.818384    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk"
Sep 07 13:01:03.818467 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.818411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mj5pk" event={"ID":"3fc89b02-52af-46c0-9acc-01e5a8e211ec","Type":"ContainerDied","Data":"c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d"}
Sep 07 13:01:03.818467 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.818441    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c759b0d5c9b8b81b7d319d17779bbeda35a13b18ece2893a62312d01f905305d"
Sep 07 13:01:03.946515 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:03.946491    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:01:04.034894 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.034860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6jgt\" (UniqueName: \"kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt\") pod \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") "
Sep 07 13:01:04.035077 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.034915    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util\") pod \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") "
Sep 07 13:01:04.035077 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.034939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle\") pod \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\" (UID: \"cf23e61e-24a1-4d45-9957-ddec19d9bb59\") "
Sep 07 13:01:04.035489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.035457    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle" (OuterVolumeSpecName: "bundle") pod "cf23e61e-24a1-4d45-9957-ddec19d9bb59" (UID: "cf23e61e-24a1-4d45-9957-ddec19d9bb59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:04.037095 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.037072    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt" (OuterVolumeSpecName: "kube-api-access-f6jgt") pod "cf23e61e-24a1-4d45-9957-ddec19d9bb59" (UID: "cf23e61e-24a1-4d45-9957-ddec19d9bb59"). InnerVolumeSpecName "kube-api-access-f6jgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:04.042571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.042545    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util" (OuterVolumeSpecName: "util") pod "cf23e61e-24a1-4d45-9957-ddec19d9bb59" (UID: "cf23e61e-24a1-4d45-9957-ddec19d9bb59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:04.135708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.135592    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:04.135708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.135652    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf23e61e-24a1-4d45-9957-ddec19d9bb59-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:04.135708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.135662    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6jgt\" (UniqueName: \"kubernetes.io/projected/cf23e61e-24a1-4d45-9957-ddec19d9bb59-kube-api-access-f6jgt\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:04.824170 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.824137    2570 generic.go:356] "Generic (PLEG): container finished" podID="86be47f9-8c15-4024-a922-705afc777130" containerID="d1efdf591c5989de296b9d3f2fadcfe482eb1b13c2abe131560eb29cc94a83d1" exitCode=0
Sep 07 13:01:04.824552 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.824218    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c" event={"ID":"86be47f9-8c15-4024-a922-705afc777130","Type":"ContainerDied","Data":"d1efdf591c5989de296b9d3f2fadcfe482eb1b13c2abe131560eb29cc94a83d1"}
Sep 07 13:01:04.826271 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.826255    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw"
Sep 07 13:01:04.826362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.826295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbs5sdw" event={"ID":"cf23e61e-24a1-4d45-9957-ddec19d9bb59","Type":"ContainerDied","Data":"39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22"}
Sep 07 13:01:04.826362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.826339    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39028a64d9f30a91d52a176bc9869e7bbc86e98b169cc24a0c9d5570e484bb22"
Sep 07 13:01:04.958190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:04.958164    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:01:05.042961 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.042926    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util\") pod \"6ac920ab-78cb-4aec-b813-8641e0e2f335\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") "
Sep 07 13:01:05.043139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.042982    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fs8w\" (UniqueName: \"kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w\") pod \"6ac920ab-78cb-4aec-b813-8641e0e2f335\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") "
Sep 07 13:01:05.043139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.043019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle\") pod \"6ac920ab-78cb-4aec-b813-8641e0e2f335\" (UID: \"6ac920ab-78cb-4aec-b813-8641e0e2f335\") "
Sep 07 13:01:05.043495 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.043465    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle" (OuterVolumeSpecName: "bundle") pod "6ac920ab-78cb-4aec-b813-8641e0e2f335" (UID: "6ac920ab-78cb-4aec-b813-8641e0e2f335"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:05.045127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.045103    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w" (OuterVolumeSpecName: "kube-api-access-8fs8w") pod "6ac920ab-78cb-4aec-b813-8641e0e2f335" (UID: "6ac920ab-78cb-4aec-b813-8641e0e2f335"). InnerVolumeSpecName "kube-api-access-8fs8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:05.047995 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.047955    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util" (OuterVolumeSpecName: "util") pod "6ac920ab-78cb-4aec-b813-8641e0e2f335" (UID: "6ac920ab-78cb-4aec-b813-8641e0e2f335"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:05.144011 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.143923    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:05.144011 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.143956    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fs8w\" (UniqueName: \"kubernetes.io/projected/6ac920ab-78cb-4aec-b813-8641e0e2f335-kube-api-access-8fs8w\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:05.144011 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.143968    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ac920ab-78cb-4aec-b813-8641e0e2f335-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:05.833801 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.833769    2570 generic.go:356] "Generic (PLEG): container finished" podID="86be47f9-8c15-4024-a922-705afc777130" containerID="5cf930f4fb5ce4b7fe0d701ad31be05798d73acbe2fc76b79a81d50089847e1a" exitCode=0
Sep 07 13:01:05.834253 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.833861    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c" event={"ID":"86be47f9-8c15-4024-a922-705afc777130","Type":"ContainerDied","Data":"5cf930f4fb5ce4b7fe0d701ad31be05798d73acbe2fc76b79a81d50089847e1a"}
Sep 07 13:01:05.835835 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.835816    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls"
Sep 07 13:01:05.835945 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.835837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dk5ls" event={"ID":"6ac920ab-78cb-4aec-b813-8641e0e2f335","Type":"ContainerDied","Data":"e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac"}
Sep 07 13:01:05.835945 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:05.835872    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e836573cb007c88317afc7902bf92076e43f987218d5356a58fb25bf953017ac"
Sep 07 13:01:06.972522 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:06.972496    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:01:07.061411 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.061377    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle\") pod \"86be47f9-8c15-4024-a922-705afc777130\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") "
Sep 07 13:01:07.061411 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.061417    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util\") pod \"86be47f9-8c15-4024-a922-705afc777130\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") "
Sep 07 13:01:07.061651 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.061452    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwfkz\" (UniqueName: \"kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz\") pod \"86be47f9-8c15-4024-a922-705afc777130\" (UID: \"86be47f9-8c15-4024-a922-705afc777130\") "
Sep 07 13:01:07.061984 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.061961    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle" (OuterVolumeSpecName: "bundle") pod "86be47f9-8c15-4024-a922-705afc777130" (UID: "86be47f9-8c15-4024-a922-705afc777130"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:07.063583 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.063561    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz" (OuterVolumeSpecName: "kube-api-access-wwfkz") pod "86be47f9-8c15-4024-a922-705afc777130" (UID: "86be47f9-8c15-4024-a922-705afc777130"). InnerVolumeSpecName "kube-api-access-wwfkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:07.065836 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.065789    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util" (OuterVolumeSpecName: "util") pod "86be47f9-8c15-4024-a922-705afc777130" (UID: "86be47f9-8c15-4024-a922-705afc777130"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:07.162726 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.162694    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:07.162726 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.162723    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86be47f9-8c15-4024-a922-705afc777130-util\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:07.162914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.162734    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwfkz\" (UniqueName: \"kubernetes.io/projected/86be47f9-8c15-4024-a922-705afc777130-kube-api-access-wwfkz\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:07.847304 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.847274    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c"
Sep 07 13:01:07.847484 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.847305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chm44c" event={"ID":"86be47f9-8c15-4024-a922-705afc777130","Type":"ContainerDied","Data":"f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e"}
Sep 07 13:01:07.847484 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:07.847353    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5fdfcc91cd80c4fcea9e263bb133d3f8bbe6eb5d868defd4b582be71acc4e4e"
Sep 07 13:01:15.629695 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629656    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"]
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629930    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629941    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629952    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629958    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629963    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629969    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629976    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629983    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629989    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629994    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.629999    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630005    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630014    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630019    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630027    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630032    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="util"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630037    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630042    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630049    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630054    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630063    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630068    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="pull"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630074    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="extract"
Sep 07 13:01:15.630075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630080    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="extract"
Sep 07 13:01:15.630943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630125    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc89b02-52af-46c0-9acc-01e5a8e211ec" containerName="extract"
Sep 07 13:01:15.630943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630131    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf23e61e-24a1-4d45-9957-ddec19d9bb59" containerName="extract"
Sep 07 13:01:15.630943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630137    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86be47f9-8c15-4024-a922-705afc777130" containerName="extract"
Sep 07 13:01:15.630943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.630142    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ac920ab-78cb-4aec-b813-8641e0e2f335" containerName="extract"
Sep 07 13:01:15.632125 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.632106    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:15.634786 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.634764    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 13:01:15.635937 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.635910    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 13:01:15.636099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.635914    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pw274\""
Sep 07 13:01:15.636099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.635914    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 07 13:01:15.648358 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.648332    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"]
Sep 07 13:01:15.737555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.737511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4tp9\" (UniqueName: \"kubernetes.io/projected/9d3699a7-c4cd-4e13-9890-d31f91aece78-kube-api-access-l4tp9\") pod \"dns-operator-controller-manager-5985564776-5dmvd\" (UID: \"9d3699a7-c4cd-4e13-9890-d31f91aece78\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:15.838017 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.837973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4tp9\" (UniqueName: \"kubernetes.io/projected/9d3699a7-c4cd-4e13-9890-d31f91aece78-kube-api-access-l4tp9\") pod \"dns-operator-controller-manager-5985564776-5dmvd\" (UID: \"9d3699a7-c4cd-4e13-9890-d31f91aece78\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:15.852541 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.852512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4tp9\" (UniqueName: \"kubernetes.io/projected/9d3699a7-c4cd-4e13-9890-d31f91aece78-kube-api-access-l4tp9\") pod \"dns-operator-controller-manager-5985564776-5dmvd\" (UID: \"9d3699a7-c4cd-4e13-9890-d31f91aece78\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:15.941777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:15.941739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:16.226427 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:16.226399    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"]
Sep 07 13:01:16.228572 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:16.228543    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3699a7_c4cd_4e13_9890_d31f91aece78.slice/crio-73db02887d4df13e59873e81c68a869841d3872c262f85ae7660d935b6111672 WatchSource:0}: Error finding container 73db02887d4df13e59873e81c68a869841d3872c262f85ae7660d935b6111672: Status 404 returned error can't find the container with id 73db02887d4df13e59873e81c68a869841d3872c262f85ae7660d935b6111672
Sep 07 13:01:16.891154 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:16.891120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd" event={"ID":"9d3699a7-c4cd-4e13-9890-d31f91aece78","Type":"ContainerStarted","Data":"73db02887d4df13e59873e81c68a869841d3872c262f85ae7660d935b6111672"}
Sep 07 13:01:17.664760 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.664728    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"]
Sep 07 13:01:17.667036 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.667016    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:17.669746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.669724    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gkqpv\""
Sep 07 13:01:17.680306 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.680281    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"]
Sep 07 13:01:17.757032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.756997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-454f4\" (UniqueName: \"kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4\") pod \"limitador-operator-controller-manager-6c549b6d85-4scf5\" (UID: \"bb56a08f-d354-4713-8992-931d25e80918\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:17.858278 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.858243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-454f4\" (UniqueName: \"kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4\") pod \"limitador-operator-controller-manager-6c549b6d85-4scf5\" (UID: \"bb56a08f-d354-4713-8992-931d25e80918\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:17.875994 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.875963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-454f4\" (UniqueName: \"kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4\") pod \"limitador-operator-controller-manager-6c549b6d85-4scf5\" (UID: \"bb56a08f-d354-4713-8992-931d25e80918\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:17.980593 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:17.980503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:19.069508 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:19.069271    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"]
Sep 07 13:01:19.071872 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:19.071844    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb56a08f_d354_4713_8992_931d25e80918.slice/crio-85c2184c5821dce3869101d293df9cbe705914c9248ca766f2076de2e41d467b WatchSource:0}: Error finding container 85c2184c5821dce3869101d293df9cbe705914c9248ca766f2076de2e41d467b: Status 404 returned error can't find the container with id 85c2184c5821dce3869101d293df9cbe705914c9248ca766f2076de2e41d467b
Sep 07 13:01:19.907897 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:19.907862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd" event={"ID":"9d3699a7-c4cd-4e13-9890-d31f91aece78","Type":"ContainerStarted","Data":"aee946b7d9704d87410c7ec8117ed27ca5d0a0d753cc376965a7825a0d1a320e"}
Sep 07 13:01:19.908124 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:19.907974    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:19.909261 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:19.909238    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5" event={"ID":"bb56a08f-d354-4713-8992-931d25e80918","Type":"ContainerStarted","Data":"85c2184c5821dce3869101d293df9cbe705914c9248ca766f2076de2e41d467b"}
Sep 07 13:01:21.919804 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.919764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5" event={"ID":"bb56a08f-d354-4713-8992-931d25e80918","Type":"ContainerStarted","Data":"dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052"}
Sep 07 13:01:21.920223 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.919874    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:21.938783 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.938727    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd" podStartSLOduration=4.3131527179999996 podStartE2EDuration="6.938710027s" totalImagesPullingTime="2.625557309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:19.928986294 +0000 UTC m=+503.635769226" watchObservedRunningTime="2026-09-07 13:01:21.938710027 +0000 UTC m=+505.645492962"
Sep 07 13:01:21.939697 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.939661    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5" podStartSLOduration=2.196339368 podStartE2EDuration="4.939648245s" totalImagesPullingTime="2.743308877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:21.937318375 +0000 UTC m=+505.644101310" watchObservedRunningTime="2026-09-07 13:01:21.939648245 +0000 UTC m=+505.646431177"
Sep 07 13:01:21.978981 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.978946    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"]
Sep 07 13:01:21.982207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.982192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:21.984771 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.984754    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nqg55\""
Sep 07 13:01:21.997600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:21.997574    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"]
Sep 07 13:01:22.095914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.095834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpr7\" (UniqueName: \"kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.096058 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.095962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.197304 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.197262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.197550 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.197331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpr7\" (UniqueName: \"kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.197766 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.197746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.209574 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.209545    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpr7\" (UniqueName: \"kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7\") pod \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.292385 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.292341    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:22.585678 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.585609    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"]
Sep 07 13:01:22.589280 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:22.589248    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc608f195_ed08_47bc_86c1_a44c91b6089a.slice/crio-5c3440f05ed505fd212a81c4b851c68f180c5c50d9afd355ebce397f88d3221a WatchSource:0}: Error finding container 5c3440f05ed505fd212a81c4b851c68f180c5c50d9afd355ebce397f88d3221a: Status 404 returned error can't find the container with id 5c3440f05ed505fd212a81c4b851c68f180c5c50d9afd355ebce397f88d3221a
Sep 07 13:01:22.925496 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:22.925461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8" event={"ID":"c608f195-ed08-47bc-86c1-a44c91b6089a","Type":"ContainerStarted","Data":"5c3440f05ed505fd212a81c4b851c68f180c5c50d9afd355ebce397f88d3221a"}
Sep 07 13:01:24.609701 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.609666    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-84sjp"]
Sep 07 13:01:24.613567 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.613541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:24.616370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.616346    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6bvvv\""
Sep 07 13:01:24.630024 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.629997    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-84sjp"]
Sep 07 13:01:24.721894 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.715945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4dss\" (UniqueName: \"kubernetes.io/projected/3db5fbf9-c913-409f-8c2a-8a917157d415-kube-api-access-l4dss\") pod \"authorino-operator-68d88948d8-84sjp\" (UID: \"3db5fbf9-c913-409f-8c2a-8a917157d415\") " pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:24.818438 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.818405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4dss\" (UniqueName: \"kubernetes.io/projected/3db5fbf9-c913-409f-8c2a-8a917157d415-kube-api-access-l4dss\") pod \"authorino-operator-68d88948d8-84sjp\" (UID: \"3db5fbf9-c913-409f-8c2a-8a917157d415\") " pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:24.828722 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.828654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4dss\" (UniqueName: \"kubernetes.io/projected/3db5fbf9-c913-409f-8c2a-8a917157d415-kube-api-access-l4dss\") pod \"authorino-operator-68d88948d8-84sjp\" (UID: \"3db5fbf9-c913-409f-8c2a-8a917157d415\") " pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:24.926529 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:24.926488    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:25.219639 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:25.219594    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-84sjp"]
Sep 07 13:01:25.221774 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:25.221742    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db5fbf9_c913_409f_8c2a_8a917157d415.slice/crio-9cfea8e40b40f34e391a57cafe0dc99f187435a39c0ad762b7f4039241d532cf WatchSource:0}: Error finding container 9cfea8e40b40f34e391a57cafe0dc99f187435a39c0ad762b7f4039241d532cf: Status 404 returned error can't find the container with id 9cfea8e40b40f34e391a57cafe0dc99f187435a39c0ad762b7f4039241d532cf
Sep 07 13:01:25.944527 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:25.944483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp" event={"ID":"3db5fbf9-c913-409f-8c2a-8a917157d415","Type":"ContainerStarted","Data":"9cfea8e40b40f34e391a57cafe0dc99f187435a39c0ad762b7f4039241d532cf"}
Sep 07 13:01:26.954019 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:26.953978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8" event={"ID":"c608f195-ed08-47bc-86c1-a44c91b6089a","Type":"ContainerStarted","Data":"e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6"}
Sep 07 13:01:26.954521 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:26.954071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:26.979772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:26.979700    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8" podStartSLOduration=1.949425883 podStartE2EDuration="5.979678933s" totalImagesPullingTime="4.03025305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:26.977101814 +0000 UTC m=+510.683884777" watchObservedRunningTime="2026-09-07 13:01:26.979678933 +0000 UTC m=+510.686461883"
Sep 07 13:01:27.960258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:27.960220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp" event={"ID":"3db5fbf9-c913-409f-8c2a-8a917157d415","Type":"ContainerStarted","Data":"e742f64759016f6b11d06aa6ae526f7b5e18e925d0c5615ecacab7b289d78e58"}
Sep 07 13:01:27.981346 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:27.981297    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp" podStartSLOduration=1.8528862419999999 podStartE2EDuration="3.981280002s" totalImagesPullingTime="2.12839376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:27.980048358 +0000 UTC m=+511.686831294" watchObservedRunningTime="2026-09-07 13:01:27.981280002 +0000 UTC m=+511.688062934"
Sep 07 13:01:28.965019 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:28.964987    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:29.598309 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.598275    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"]
Sep 07 13:01:29.602121 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.602094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.604597 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.604567    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 13:01:29.604597 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.604591    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7c2jp\""
Sep 07 13:01:29.604801 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.604613    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 13:01:29.619454 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.619426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"]
Sep 07 13:01:29.762993 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.762956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec899ca-0835-434f-a418-453a3fddd42e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.763187 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.763017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpt2\" (UniqueName: \"kubernetes.io/projected/dec899ca-0835-434f-a418-453a3fddd42e-kube-api-access-dcpt2\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.763187 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.763074    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.864532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.864435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpt2\" (UniqueName: \"kubernetes.io/projected/dec899ca-0835-434f-a418-453a3fddd42e-kube-api-access-dcpt2\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.864532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.864481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.864532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.864532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec899ca-0835-434f-a418-453a3fddd42e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.864859 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:29.864680    2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 07 13:01:29.864859 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:29.864753    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert podName:dec899ca-0835-434f-a418-453a3fddd42e nodeName:}" failed. No retries permitted until 2026-09-07 13:01:30.364732067 +0000 UTC m=+514.071514990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-r8nsj" (UID: "dec899ca-0835-434f-a418-453a3fddd42e") : secret "plugin-serving-cert" not found
Sep 07 13:01:29.865256 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.865236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec899ca-0835-434f-a418-453a3fddd42e-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:29.877703 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:29.877673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpt2\" (UniqueName: \"kubernetes.io/projected/dec899ca-0835-434f-a418-453a3fddd42e-kube-api-access-dcpt2\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:30.368962 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.368915    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:30.371401 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.371376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec899ca-0835-434f-a418-453a3fddd42e-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-r8nsj\" (UID: \"dec899ca-0835-434f-a418-453a3fddd42e\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:30.511461 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.511419    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"
Sep 07 13:01:30.789154 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.789123    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj"]
Sep 07 13:01:30.790792 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:30.790756    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec899ca_0835_434f_a418_453a3fddd42e.slice/crio-ca67c5dd5265d3e3de6801b0dbad8ad911ce85a25b3e72d0506c1a5f5cab633c WatchSource:0}: Error finding container ca67c5dd5265d3e3de6801b0dbad8ad911ce85a25b3e72d0506c1a5f5cab633c: Status 404 returned error can't find the container with id ca67c5dd5265d3e3de6801b0dbad8ad911ce85a25b3e72d0506c1a5f5cab633c
Sep 07 13:01:30.916131 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.916102    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5dmvd"
Sep 07 13:01:30.976999 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:30.976968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj" event={"ID":"dec899ca-0835-434f-a418-453a3fddd42e","Type":"ContainerStarted","Data":"ca67c5dd5265d3e3de6801b0dbad8ad911ce85a25b3e72d0506c1a5f5cab633c"}
Sep 07 13:01:32.928133 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:32.928098    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:36.010978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:36.010939    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj" event={"ID":"dec899ca-0835-434f-a418-453a3fddd42e","Type":"ContainerStarted","Data":"62df10bc8196550a2a60ebecd2d287a7db2c5d268c3d1050bd23dfc24b0e1f9b"}
Sep 07 13:01:36.039411 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:36.039354    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-r8nsj" podStartSLOduration=2.302333499 podStartE2EDuration="7.03933748s" totalImagesPullingTime="4.737003981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:36.03721467 +0000 UTC m=+519.743997601" watchObservedRunningTime="2026-09-07 13:01:36.03933748 +0000 UTC m=+519.746120411"
Sep 07 13:01:37.963002 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:37.962970    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:39.570649 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.570600    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"]
Sep 07 13:01:39.576792 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.576756    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.588952 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.588921    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"]
Sep 07 13:01:39.658556 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.658517    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.658556 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.658560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5r2\" (UniqueName: \"kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.759190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.759150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.759190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.759192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5r2\" (UniqueName: \"kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.759555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.759536    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.769125 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.769100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5r2\" (UniqueName: \"kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2\") pod \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.888779 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.888687    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:39.972913 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:39.972883    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-84sjp"
Sep 07 13:01:40.076314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.076267    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"]
Sep 07 13:01:40.076488 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.076465    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" containerName="manager" containerID="cri-o://e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6" gracePeriod=2
Sep 07 13:01:40.082644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.082560    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"]
Sep 07 13:01:40.091255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.091227    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"]
Sep 07 13:01:40.098372 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.098347    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"]
Sep 07 13:01:40.111879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.111853    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:40.112162 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.112151    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" containerName="manager"
Sep 07 13:01:40.112203 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.112165    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" containerName="manager"
Sep 07 13:01:40.112236 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.112231    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" containerName="manager"
Sep 07 13:01:40.115117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.115100    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.118983 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.118959    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"]
Sep 07 13:01:40.119185 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.119160    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5" podUID="bb56a08f-d354-4713-8992-931d25e80918" containerName="manager" containerID="cri-o://dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052" gracePeriod=2
Sep 07 13:01:40.127195 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.127165    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"]
Sep 07 13:01:40.130699 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.130664    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:01:40.131078 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.131057    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb56a08f-d354-4713-8992-931d25e80918" containerName="manager"
Sep 07 13:01:40.131200 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.131187    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb56a08f-d354-4713-8992-931d25e80918" containerName="manager"
Sep 07 13:01:40.131396 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.131381    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb56a08f-d354-4713-8992-931d25e80918" containerName="manager"
Sep 07 13:01:40.134425 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.134407    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:40.134519 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.134493    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.154964 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.154802    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.155859 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.155831    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:01:40.157346 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.157312    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4scf5\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="bb56a08f-d354-4713-8992-931d25e80918" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:40.160029 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.159990    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.161193 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.161169    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"]
Sep 07 13:01:40.162979 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.162957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7625z\" (UniqueName: \"kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.163060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.163002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnzx\" (UniqueName: \"kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.163060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.163028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.163157 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.163091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.164561 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.164542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:40.174568 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.174533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"]
Sep 07 13:01:40.189432 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.189376    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4scf5\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="bb56a08f-d354-4713-8992-931d25e80918" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:40.219720 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.219671    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.263670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.263759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.263809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2w4j\" (UniqueName: \"kubernetes.io/projected/4e35c8f5-1530-400b-8172-6e19abf174fa-kube-api-access-n2w4j\") pod \"limitador-operator-controller-manager-6c549b6d85-qwfsd\" (UID: \"4e35c8f5-1530-400b-8172-6e19abf174fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.263846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7625z\" (UniqueName: \"kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.263902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnzx\" (UniqueName: \"kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.264274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.264107    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.264764 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.264404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.273587 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.273516    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7625z\" (UniqueName: \"kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z\") pod \"kuadrant-operator-controller-manager-68cf589589-bnfbg\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.273933 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.273911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnzx\" (UniqueName: \"kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx\") pod \"kuadrant-operator-controller-manager-58fc56757c-lckfm\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.304811 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.304772    2570 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 07 13:01:40.304811 ip-10-0-143-132 kubenswrapper[2570]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-bsl4j_kuadrant-system_abe80e6a-277d-4f3b-84fc-796b90f99d9a_0(7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-bsl4j to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb" Netns:"/var/run/netns/7508803c-9ee9-4e5d-a9e6-2b969565a767" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-68cf589589-bsl4j;K8S_POD_INFRA_CONTAINER_ID=7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb;K8S_POD_UID=abe80e6a-277d-4f3b-84fc-796b90f99d9a" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j] networking: [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j/abe80e6a-277d-4f3b-84fc-796b90f99d9a:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j 7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:27 [10.133.0.39/23]
Sep 07 13:01:40.304811 ip-10-0-143-132 kubenswrapper[2570]:         '
Sep 07 13:01:40.304811 ip-10-0-143-132 kubenswrapper[2570]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 13:01:40.304811 ip-10-0-143-132 kubenswrapper[2570]:  >
Sep 07 13:01:40.305030 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.304849    2570 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 07 13:01:40.305030 ip-10-0-143-132 kubenswrapper[2570]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-bsl4j_kuadrant-system_abe80e6a-277d-4f3b-84fc-796b90f99d9a_0(7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-bsl4j to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb" Netns:"/var/run/netns/7508803c-9ee9-4e5d-a9e6-2b969565a767" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-68cf589589-bsl4j;K8S_POD_INFRA_CONTAINER_ID=7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb;K8S_POD_UID=abe80e6a-277d-4f3b-84fc-796b90f99d9a" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j] networking: [kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j/abe80e6a-277d-4f3b-84fc-796b90f99d9a:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j 7ef969d22ff16482b2a5e948170a071baeb75b5a6ec925726a4868b5847271cb network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:27 [10.133.0.39/23]
Sep 07 13:01:40.305030 ip-10-0-143-132 kubenswrapper[2570]:         '
Sep 07 13:01:40.305030 ip-10-0-143-132 kubenswrapper[2570]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 07 13:01:40.305030 ip-10-0-143-132 kubenswrapper[2570]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:40.355993 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.355963    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.358024 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.358005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:40.358455 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.358434    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4scf5\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="bb56a08f-d354-4713-8992-931d25e80918" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:40.360603 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.360580    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.362780 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.362758    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zv7m8\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:40.364820 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:40.364799    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4scf5\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="bb56a08f-d354-4713-8992-931d25e80918" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:40.364820 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.364811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-454f4\" (UniqueName: \"kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4\") pod \"bb56a08f-d354-4713-8992-931d25e80918\" (UID: \"bb56a08f-d354-4713-8992-931d25e80918\") "
Sep 07 13:01:40.364904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.364882    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnpr7\" (UniqueName: \"kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7\") pod \"c608f195-ed08-47bc-86c1-a44c91b6089a\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") "
Sep 07 13:01:40.364937 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.364914    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume\") pod \"c608f195-ed08-47bc-86c1-a44c91b6089a\" (UID: \"c608f195-ed08-47bc-86c1-a44c91b6089a\") "
Sep 07 13:01:40.365002 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.364990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2w4j\" (UniqueName: \"kubernetes.io/projected/4e35c8f5-1530-400b-8172-6e19abf174fa-kube-api-access-n2w4j\") pod \"limitador-operator-controller-manager-6c549b6d85-qwfsd\" (UID: \"4e35c8f5-1530-400b-8172-6e19abf174fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:40.365454 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.365427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c608f195-ed08-47bc-86c1-a44c91b6089a" (UID: "c608f195-ed08-47bc-86c1-a44c91b6089a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:40.366955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.366925    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4" (OuterVolumeSpecName: "kube-api-access-454f4") pod "bb56a08f-d354-4713-8992-931d25e80918" (UID: "bb56a08f-d354-4713-8992-931d25e80918"). InnerVolumeSpecName "kube-api-access-454f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:40.367033 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.366985    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7" (OuterVolumeSpecName: "kube-api-access-hnpr7") pod "c608f195-ed08-47bc-86c1-a44c91b6089a" (UID: "c608f195-ed08-47bc-86c1-a44c91b6089a"). InnerVolumeSpecName "kube-api-access-hnpr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:40.377180 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.377160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2w4j\" (UniqueName: \"kubernetes.io/projected/4e35c8f5-1530-400b-8172-6e19abf174fa-kube-api-access-n2w4j\") pod \"limitador-operator-controller-manager-6c549b6d85-qwfsd\" (UID: \"4e35c8f5-1530-400b-8172-6e19abf174fa\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:40.466090 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.466001    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnpr7\" (UniqueName: \"kubernetes.io/projected/c608f195-ed08-47bc-86c1-a44c91b6089a-kube-api-access-hnpr7\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:40.466090 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.466031    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c608f195-ed08-47bc-86c1-a44c91b6089a-extensions-socket-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:40.466090 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.466043    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-454f4\" (UniqueName: \"kubernetes.io/projected/bb56a08f-d354-4713-8992-931d25e80918-kube-api-access-454f4\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:40.518969 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.518929    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:40.527183 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.527150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:40.534221 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.534191    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:40.816281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.816249    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb56a08f-d354-4713-8992-931d25e80918" path="/var/lib/kubelet/pods/bb56a08f-d354-4713-8992-931d25e80918/volumes"
Sep 07 13:01:40.816668 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.816648    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c608f195-ed08-47bc-86c1-a44c91b6089a" path="/var/lib/kubelet/pods/c608f195-ed08-47bc-86c1-a44c91b6089a/volumes"
Sep 07 13:01:40.830977 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.830955    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:40.832374 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:40.832350    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6198632_2351_4a1f_8170_7662574fb1d7.slice/crio-9ff420cbd9e80bae842a871d42796955a9e3121c3757012c6e21d66e8b7d2aac WatchSource:0}: Error finding container 9ff420cbd9e80bae842a871d42796955a9e3121c3757012c6e21d66e8b7d2aac: Status 404 returned error can't find the container with id 9ff420cbd9e80bae842a871d42796955a9e3121c3757012c6e21d66e8b7d2aac
Sep 07 13:01:40.832980 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:40.832965    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a7ae39_1e13_4761_845a_0b872610ccca.slice/crio-7d88267df5eced66e427f915c8f3caf8635a79122487fa5d55558f0006f6de19 WatchSource:0}: Error finding container 7d88267df5eced66e427f915c8f3caf8635a79122487fa5d55558f0006f6de19: Status 404 returned error can't find the container with id 7d88267df5eced66e427f915c8f3caf8635a79122487fa5d55558f0006f6de19
Sep 07 13:01:40.834112 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.834080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:01:40.841140 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:40.841116    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"]
Sep 07 13:01:40.842264 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:40.842235    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e35c8f5_1530_400b_8172_6e19abf174fa.slice/crio-9f0254da8a6baa5b4bcf7282db348494aa6a73b354850b63072b0296bf44884f WatchSource:0}: Error finding container 9f0254da8a6baa5b4bcf7282db348494aa6a73b354850b63072b0296bf44884f: Status 404 returned error can't find the container with id 9f0254da8a6baa5b4bcf7282db348494aa6a73b354850b63072b0296bf44884f
Sep 07 13:01:41.038281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.038194    2570 generic.go:356] "Generic (PLEG): container finished" podID="c608f195-ed08-47bc-86c1-a44c91b6089a" containerID="e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6" exitCode=0
Sep 07 13:01:41.038281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.038234    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zv7m8"
Sep 07 13:01:41.038520 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.038287    2570 scope.go:117] "RemoveContainer" containerID="e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6"
Sep 07 13:01:41.040421 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.040392    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" event={"ID":"22a7ae39-1e13-4761-845a-0b872610ccca","Type":"ContainerStarted","Data":"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"}
Sep 07 13:01:41.040572 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.040551    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:41.040684 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.040603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" event={"ID":"22a7ae39-1e13-4761-845a-0b872610ccca","Type":"ContainerStarted","Data":"7d88267df5eced66e427f915c8f3caf8635a79122487fa5d55558f0006f6de19"}
Sep 07 13:01:41.042577 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.042550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" event={"ID":"e6198632-2351-4a1f-8170-7662574fb1d7","Type":"ContainerStarted","Data":"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"}
Sep 07 13:01:41.042708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.042591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" event={"ID":"e6198632-2351-4a1f-8170-7662574fb1d7","Type":"ContainerStarted","Data":"9ff420cbd9e80bae842a871d42796955a9e3121c3757012c6e21d66e8b7d2aac"}
Sep 07 13:01:41.042708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.042676    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:41.045093 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.045054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd" event={"ID":"4e35c8f5-1530-400b-8172-6e19abf174fa","Type":"ContainerStarted","Data":"25a50222d6086e739fe0712c2fe720995143bc5485d683b3df13a8710b2076d9"}
Sep 07 13:01:41.047911 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.047532    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:41.047911 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.047593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd" event={"ID":"4e35c8f5-1530-400b-8172-6e19abf174fa","Type":"ContainerStarted","Data":"9f0254da8a6baa5b4bcf7282db348494aa6a73b354850b63072b0296bf44884f"}
Sep 07 13:01:41.050228 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.049288    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb56a08f-d354-4713-8992-931d25e80918" containerID="dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052" exitCode=0
Sep 07 13:01:41.050228 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.049380    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:41.050517 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.050340    2570 scope.go:117] "RemoveContainer" containerID="e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6"
Sep 07 13:01:41.050517 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.050493    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4scf5"
Sep 07 13:01:41.054869 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:41.052953    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6\": container with ID starting with e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6 not found: ID does not exist" containerID="e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6"
Sep 07 13:01:41.054869 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.052999    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6"} err="failed to get container status \"e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6\": rpc error: code = NotFound desc = could not find container \"e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6\": container with ID starting with e925c6c85f2cb275d5ba2c27051af257cf77537f5372fc067bb3c98145768cf6 not found: ID does not exist"
Sep 07 13:01:41.054869 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.053024    2570 scope.go:117] "RemoveContainer" containerID="dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052"
Sep 07 13:01:41.063723 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.063699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:41.064853 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.064829    2570 scope.go:117] "RemoveContainer" containerID="dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052"
Sep 07 13:01:41.065197 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:41.065155    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052\": container with ID starting with dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052 not found: ID does not exist" containerID="dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052"
Sep 07 13:01:41.065274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.065192    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052"} err="failed to get container status \"dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052\": rpc error: code = NotFound desc = could not find container \"dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052\": container with ID starting with dd118cb2a7f0bc8586a739f826acb595ccaf3d01c32bb74a81ae290ff6edd052 not found: ID does not exist"
Sep 07 13:01:41.071742 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.071716    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume\") pod \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") "
Sep 07 13:01:41.071822 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.071755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5r2\" (UniqueName: \"kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2\") pod \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\" (UID: \"abe80e6a-277d-4f3b-84fc-796b90f99d9a\") "
Sep 07 13:01:41.071976 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.071948    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "abe80e6a-277d-4f3b-84fc-796b90f99d9a" (UID: "abe80e6a-277d-4f3b-84fc-796b90f99d9a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:41.072095 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.072047    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/abe80e6a-277d-4f3b-84fc-796b90f99d9a-extensions-socket-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:41.073955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.073923    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2" (OuterVolumeSpecName: "kube-api-access-vq5r2") pod "abe80e6a-277d-4f3b-84fc-796b90f99d9a" (UID: "abe80e6a-277d-4f3b-84fc-796b90f99d9a"). InnerVolumeSpecName "kube-api-access-vq5r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:41.082769 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.082716    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" podStartSLOduration=1.08270205 podStartE2EDuration="1.08270205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:41.080527768 +0000 UTC m=+524.787310698" watchObservedRunningTime="2026-09-07 13:01:41.08270205 +0000 UTC m=+524.789484982"
Sep 07 13:01:41.108228 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.108175    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" podStartSLOduration=1.108158092 podStartE2EDuration="1.108158092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:41.106683594 +0000 UTC m=+524.813466525" watchObservedRunningTime="2026-09-07 13:01:41.108158092 +0000 UTC m=+524.814941021"
Sep 07 13:01:41.109150 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:41.109123    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="abe80e6a-277d-4f3b-84fc-796b90f99d9a" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:41.133163 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.133112    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd" podStartSLOduration=1.133096896 podStartE2EDuration="1.133096896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:41.13267508 +0000 UTC m=+524.839458014" watchObservedRunningTime="2026-09-07 13:01:41.133096896 +0000 UTC m=+524.839879827"
Sep 07 13:01:41.173225 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:41.173192    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5r2\" (UniqueName: \"kubernetes.io/projected/abe80e6a-277d-4f3b-84fc-796b90f99d9a-kube-api-access-vq5r2\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:42.057746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:42.057656    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:42.060414 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:42.060380    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="abe80e6a-277d-4f3b-84fc-796b90f99d9a" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:42.066100 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:42.066073    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bsl4j\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="abe80e6a-277d-4f3b-84fc-796b90f99d9a" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bsl4j"
Sep 07 13:01:42.815318 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:42.815285    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe80e6a-277d-4f3b-84fc-796b90f99d9a" path="/var/lib/kubelet/pods/abe80e6a-277d-4f3b-84fc-796b90f99d9a/volumes"
Sep 07 13:01:52.059783 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.059699    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:52.060147 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.059790    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:01:52.142724 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.142689    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:52.143049 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.142930    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" podUID="22a7ae39-1e13-4761-845a-0b872610ccca" containerName="manager" containerID="cri-o://5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25" gracePeriod=10
Sep 07 13:01:52.388503 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.388475    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:01:52.390477 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.390458    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:52.391656 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.391641    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.406711 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.406679    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:01:52.470736 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.470706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gnzx\" (UniqueName: \"kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx\") pod \"22a7ae39-1e13-4761-845a-0b872610ccca\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") "
Sep 07 13:01:52.470914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.470808    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume\") pod \"22a7ae39-1e13-4761-845a-0b872610ccca\" (UID: \"22a7ae39-1e13-4761-845a-0b872610ccca\") "
Sep 07 13:01:52.470914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.470907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.470987 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.470944    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7jml\" (UniqueName: \"kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.471188 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.471166    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22a7ae39-1e13-4761-845a-0b872610ccca" (UID: "22a7ae39-1e13-4761-845a-0b872610ccca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:01:52.472767 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.472745    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx" (OuterVolumeSpecName: "kube-api-access-7gnzx") pod "22a7ae39-1e13-4761-845a-0b872610ccca" (UID: "22a7ae39-1e13-4761-845a-0b872610ccca"). InnerVolumeSpecName "kube-api-access-7gnzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:52.572292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.572202    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.572292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.572252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7jml\" (UniqueName: \"kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.572455 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.572297    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gnzx\" (UniqueName: \"kubernetes.io/projected/22a7ae39-1e13-4761-845a-0b872610ccca-kube-api-access-7gnzx\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:52.572455 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.572307    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22a7ae39-1e13-4761-845a-0b872610ccca-extensions-socket-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:01:52.572614 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.572592    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.587245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.587207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7jml\" (UniqueName: \"kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g7zms\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.701184 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.701142    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:52.987565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:52.987527    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:01:52.990884 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:01:52.990858    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4308a5a_1fc1_46e2_bea2_04dd2b60e054.slice/crio-dfce80b7ce41ab5266d2a26ea4b7b739f157971bc2d22987761c4bd4ce6bf385 WatchSource:0}: Error finding container dfce80b7ce41ab5266d2a26ea4b7b739f157971bc2d22987761c4bd4ce6bf385: Status 404 returned error can't find the container with id dfce80b7ce41ab5266d2a26ea4b7b739f157971bc2d22987761c4bd4ce6bf385
Sep 07 13:01:53.066030 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.065988    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-qwfsd"
Sep 07 13:01:53.119609 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.119578    2570 generic.go:356] "Generic (PLEG): container finished" podID="22a7ae39-1e13-4761-845a-0b872610ccca" containerID="5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25" exitCode=0
Sep 07 13:01:53.119798 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.119656    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"
Sep 07 13:01:53.119798 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.119662    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" event={"ID":"22a7ae39-1e13-4761-845a-0b872610ccca","Type":"ContainerDied","Data":"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"}
Sep 07 13:01:53.119798 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.119713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm" event={"ID":"22a7ae39-1e13-4761-845a-0b872610ccca","Type":"ContainerDied","Data":"7d88267df5eced66e427f915c8f3caf8635a79122487fa5d55558f0006f6de19"}
Sep 07 13:01:53.119798 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.119743    2570 scope.go:117] "RemoveContainer" containerID="5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"
Sep 07 13:01:53.121868 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.121821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" event={"ID":"b4308a5a-1fc1-46e2-bea2-04dd2b60e054","Type":"ContainerStarted","Data":"ced1faaefe05f4697c40b06fef76ccbee3729bb1a99a3d97ea336edb28f9f7c4"}
Sep 07 13:01:53.122008 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.121876    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" event={"ID":"b4308a5a-1fc1-46e2-bea2-04dd2b60e054","Type":"ContainerStarted","Data":"dfce80b7ce41ab5266d2a26ea4b7b739f157971bc2d22987761c4bd4ce6bf385"}
Sep 07 13:01:53.122008 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.121992    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:01:53.128427 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.128407    2570 scope.go:117] "RemoveContainer" containerID="5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"
Sep 07 13:01:53.128757 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:01:53.128735    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25\": container with ID starting with 5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25 not found: ID does not exist" containerID="5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"
Sep 07 13:01:53.128822 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.128764    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25"} err="failed to get container status \"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25\": rpc error: code = NotFound desc = could not find container \"5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25\": container with ID starting with 5cd5ad9d79a1ed7af84c0084c6fb3aee29570c0ff5320fee6bc2cf25f7f79e25 not found: ID does not exist"
Sep 07 13:01:53.144694 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.144656    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:53.155557 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.155529    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-lckfm"]
Sep 07 13:01:53.182173 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:53.182123    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" podStartSLOduration=1.182103776 podStartE2EDuration="1.182103776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:53.179741685 +0000 UTC m=+536.886524617" watchObservedRunningTime="2026-09-07 13:01:53.182103776 +0000 UTC m=+536.888886707"
Sep 07 13:01:54.814790 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:01:54.814756    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22a7ae39-1e13-4761-845a-0b872610ccca" path="/var/lib/kubelet/pods/22a7ae39-1e13-4761-845a-0b872610ccca/volumes"
Sep 07 13:02:04.131149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.131115    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:02:04.200082 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.200039    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:02:04.200369 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.200337    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" podUID="e6198632-2351-4a1f-8170-7662574fb1d7" containerName="manager" containerID="cri-o://c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa" gracePeriod=10
Sep 07 13:02:04.451963 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.451935    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:02:04.580259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.580205    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume\") pod \"e6198632-2351-4a1f-8170-7662574fb1d7\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") "
Sep 07 13:02:04.580458 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.580323    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7625z\" (UniqueName: \"kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z\") pod \"e6198632-2351-4a1f-8170-7662574fb1d7\" (UID: \"e6198632-2351-4a1f-8170-7662574fb1d7\") "
Sep 07 13:02:04.580726 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.580693    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6198632-2351-4a1f-8170-7662574fb1d7" (UID: "e6198632-2351-4a1f-8170-7662574fb1d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:02:04.582389 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.582368    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z" (OuterVolumeSpecName: "kube-api-access-7625z") pod "e6198632-2351-4a1f-8170-7662574fb1d7" (UID: "e6198632-2351-4a1f-8170-7662574fb1d7"). InnerVolumeSpecName "kube-api-access-7625z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:04.681528 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.681484    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6198632-2351-4a1f-8170-7662574fb1d7-extensions-socket-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:04.681528 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:04.681520    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7625z\" (UniqueName: \"kubernetes.io/projected/e6198632-2351-4a1f-8170-7662574fb1d7-kube-api-access-7625z\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:05.188694 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.188654    2570 generic.go:356] "Generic (PLEG): container finished" podID="e6198632-2351-4a1f-8170-7662574fb1d7" containerID="c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa" exitCode=0
Sep 07 13:02:05.189149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.188706    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"
Sep 07 13:02:05.189149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.188717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" event={"ID":"e6198632-2351-4a1f-8170-7662574fb1d7","Type":"ContainerDied","Data":"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"}
Sep 07 13:02:05.189149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.188772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg" event={"ID":"e6198632-2351-4a1f-8170-7662574fb1d7","Type":"ContainerDied","Data":"9ff420cbd9e80bae842a871d42796955a9e3121c3757012c6e21d66e8b7d2aac"}
Sep 07 13:02:05.189149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.188805    2570 scope.go:117] "RemoveContainer" containerID="c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"
Sep 07 13:02:05.197256 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.197238    2570 scope.go:117] "RemoveContainer" containerID="c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"
Sep 07 13:02:05.197548 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:05.197528    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa\": container with ID starting with c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa not found: ID does not exist" containerID="c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"
Sep 07 13:02:05.197590 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.197558    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa"} err="failed to get container status \"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa\": rpc error: code = NotFound desc = could not find container \"c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa\": container with ID starting with c9eae3299d17b384b2cd135c472642f7505d228457bc0bb18f6fd193d8a714fa not found: ID does not exist"
Sep 07 13:02:05.214331 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.214303    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:02:05.221033 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:05.221007    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bnfbg"]
Sep 07 13:02:06.814692 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:06.814649    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6198632-2351-4a1f-8170-7662574fb1d7" path="/var/lib/kubelet/pods/e6198632-2351-4a1f-8170-7662574fb1d7/volumes"
Sep 07 13:02:22.935936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.935892    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:22.936500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936355    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6198632-2351-4a1f-8170-7662574fb1d7" containerName="manager"
Sep 07 13:02:22.936500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936375    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6198632-2351-4a1f-8170-7662574fb1d7" containerName="manager"
Sep 07 13:02:22.936500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936408    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a7ae39-1e13-4761-845a-0b872610ccca" containerName="manager"
Sep 07 13:02:22.936500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936419    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a7ae39-1e13-4761-845a-0b872610ccca" containerName="manager"
Sep 07 13:02:22.936500 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936500    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="22a7ae39-1e13-4761-845a-0b872610ccca" containerName="manager"
Sep 07 13:02:22.936792 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.936511    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6198632-2351-4a1f-8170-7662574fb1d7" containerName="manager"
Sep 07 13:02:22.939505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.939484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:22.942158 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.942138    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 13:02:22.950034 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:22.950008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:23.030053 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.030015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpph\" (UniqueName: \"kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.030239 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.030154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.031388 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.031360    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:23.131095 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.131054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpph\" (UniqueName: \"kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.131258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.131135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.131796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.131776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.143140 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.143108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpph\" (UniqueName: \"kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph\") pod \"limitador-limitador-859c4d96d6-tdcx2\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.250403 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.250305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:23.526750 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.526724    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:23.528768 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:23.528730    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cab170_f970_428e_a077_fff0fe2dff59.slice/crio-92bc07fbac8b7ea8dc256253ac86558ce33e57bbde39f9be5f8380372a42dd3f WatchSource:0}: Error finding container 92bc07fbac8b7ea8dc256253ac86558ce33e57bbde39f9be5f8380372a42dd3f: Status 404 returned error can't find the container with id 92bc07fbac8b7ea8dc256253ac86558ce33e57bbde39f9be5f8380372a42dd3f
Sep 07 13:02:23.811199 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.811118    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:23.815796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.815771    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:23.818212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.818179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rsv9q\""
Sep 07 13:02:23.825939 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.825908    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:23.938273 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.938234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbbn\" (UniqueName: \"kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn\") pod \"authorino-b54df94b4-lw4lx\" (UID: \"455fad90-dafd-4323-ad19-2c47cf8a1183\") " pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:23.947406 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.947377    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:23.950817 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.950794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:23.959656 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:23.959630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:24.038897 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.038852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbbn\" (UniqueName: \"kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn\") pod \"authorino-b54df94b4-lw4lx\" (UID: \"455fad90-dafd-4323-ad19-2c47cf8a1183\") " pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:24.039060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.038907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rhbd\" (UniqueName: \"kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd\") pod \"authorino-c548b5d7d-xrqcn\" (UID: \"014f58db-4930-468f-a1e3-9ac2b340121c\") " pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:24.050598 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.050570    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbbn\" (UniqueName: \"kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn\") pod \"authorino-b54df94b4-lw4lx\" (UID: \"455fad90-dafd-4323-ad19-2c47cf8a1183\") " pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:24.126878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.126779    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:24.140136 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.140108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rhbd\" (UniqueName: \"kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd\") pod \"authorino-c548b5d7d-xrqcn\" (UID: \"014f58db-4930-468f-a1e3-9ac2b340121c\") " pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:24.150304 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.150276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rhbd\" (UniqueName: \"kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd\") pod \"authorino-c548b5d7d-xrqcn\" (UID: \"014f58db-4930-468f-a1e3-9ac2b340121c\") " pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:24.259926 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.259887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:24.286361 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.286329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" event={"ID":"b4cab170-f970-428e-a077-fff0fe2dff59","Type":"ContainerStarted","Data":"92bc07fbac8b7ea8dc256253ac86558ce33e57bbde39f9be5f8380372a42dd3f"}
Sep 07 13:02:24.402024 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.401999    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:24.404454 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:24.404412    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod455fad90_dafd_4323_ad19_2c47cf8a1183.slice/crio-3ce24c2ad750f927f98c95bb7ea5b8ba3f55ff369a70a5279da0524c4521b31f WatchSource:0}: Error finding container 3ce24c2ad750f927f98c95bb7ea5b8ba3f55ff369a70a5279da0524c4521b31f: Status 404 returned error can't find the container with id 3ce24c2ad750f927f98c95bb7ea5b8ba3f55ff369a70a5279da0524c4521b31f
Sep 07 13:02:24.535117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:24.535092    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:24.536710 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:24.536681    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod014f58db_4930_468f_a1e3_9ac2b340121c.slice/crio-0ecedcc35b062e6f42d348fa8cc4ebc9da772e80cb4d6a7b4b3ada8089356cd6 WatchSource:0}: Error finding container 0ecedcc35b062e6f42d348fa8cc4ebc9da772e80cb4d6a7b4b3ada8089356cd6: Status 404 returned error can't find the container with id 0ecedcc35b062e6f42d348fa8cc4ebc9da772e80cb4d6a7b4b3ada8089356cd6
Sep 07 13:02:25.294266 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:25.294227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" event={"ID":"014f58db-4930-468f-a1e3-9ac2b340121c","Type":"ContainerStarted","Data":"0ecedcc35b062e6f42d348fa8cc4ebc9da772e80cb4d6a7b4b3ada8089356cd6"}
Sep 07 13:02:25.295679 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:25.295647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lw4lx" event={"ID":"455fad90-dafd-4323-ad19-2c47cf8a1183","Type":"ContainerStarted","Data":"3ce24c2ad750f927f98c95bb7ea5b8ba3f55ff369a70a5279da0524c4521b31f"}
Sep 07 13:02:25.342255 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:25.342196    2570 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260907%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260907T130224Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=99aa869a75fd268795703317304ea7a1ad00a61fe20c81fca54a1186d5b82d2f&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1788787044~hmac=351fa155b56b94fd981fdde57a6f33657baa39c116d88ecf795c03b088b744ef\": EOF; artifact err: provided artifact is a container image" image="registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97"
Sep 07 13:02:25.342455 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:25.342361    2570 kuberuntime_manager.go:1459] "Unhandled Error" err="container authorino start failed in pod authorino-c548b5d7d-xrqcn_kuadrant-system(014f58db-4930-468f-a1e3-9ac2b340121c): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260907%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260907T130224Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=99aa869a75fd268795703317304ea7a1ad00a61fe20c81fca54a1186d5b82d2f&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1788787044~hmac=351fa155b56b94fd981fdde57a6f33657baa39c116d88ecf795c03b088b744ef\": EOF; artifact err: provided artifact is a container image" logger="UnhandledError"
Sep 07 13:02:25.342455 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:25.342427    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260907%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260907T130224Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=99aa869a75fd268795703317304ea7a1ad00a61fe20c81fca54a1186d5b82d2f&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1788787044~hmac=351fa155b56b94fd981fdde57a6f33657baa39c116d88ecf795c03b088b744ef\\\": EOF; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" podUID="014f58db-4930-468f-a1e3-9ac2b340121c"
Sep 07 13:02:26.302605 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:26.302547    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/09/0940a0ae5bd9eac04a1297e7c1ac759f2fda1cf01ef0fb35cd5c4229db830f83?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260907%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260907T130224Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=99aa869a75fd268795703317304ea7a1ad00a61fe20c81fca54a1186d5b82d2f&region=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=rhcl-1----authorino-rhel9&akamai_signature=exp=1788787044~hmac=351fa155b56b94fd981fdde57a6f33657baa39c116d88ecf795c03b088b744ef\\\": EOF; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" podUID="014f58db-4930-468f-a1e3-9ac2b340121c"
Sep 07 13:02:27.308863 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:27.308823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lw4lx" event={"ID":"455fad90-dafd-4323-ad19-2c47cf8a1183","Type":"ContainerStarted","Data":"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"}
Sep 07 13:02:27.310437 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:27.310411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" event={"ID":"b4cab170-f970-428e-a077-fff0fe2dff59","Type":"ContainerStarted","Data":"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"}
Sep 07 13:02:27.310563 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:27.310496    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:27.332890 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:27.332834    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-lw4lx" podStartSLOduration=2.189047716 podStartE2EDuration="4.332816497s" totalImagesPullingTime="2.143768781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:27.33152488 +0000 UTC m=+571.038307811" watchObservedRunningTime="2026-09-07 13:02:27.332816497 +0000 UTC m=+571.039599429"
Sep 07 13:02:27.359878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:27.359827    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" podStartSLOduration=2.405487511 podStartE2EDuration="5.359809224s" totalImagesPullingTime="2.954321713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:27.359371628 +0000 UTC m=+571.066154559" watchObservedRunningTime="2026-09-07 13:02:27.359809224 +0000 UTC m=+571.066592165"
Sep 07 13:02:38.114888 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.114852    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:38.115339 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.115069    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" podUID="b4cab170-f970-428e-a077-fff0fe2dff59" containerName="limitador" containerID="cri-o://336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f" gracePeriod=30
Sep 07 13:02:38.115786 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.115723    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:38.674244 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.674172    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:38.757785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.757749    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrpph\" (UniqueName: \"kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph\") pod \"b4cab170-f970-428e-a077-fff0fe2dff59\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") "
Sep 07 13:02:38.757953 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.757811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file\") pod \"b4cab170-f970-428e-a077-fff0fe2dff59\" (UID: \"b4cab170-f970-428e-a077-fff0fe2dff59\") "
Sep 07 13:02:38.758170 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.758144    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file" (OuterVolumeSpecName: "config-file") pod "b4cab170-f970-428e-a077-fff0fe2dff59" (UID: "b4cab170-f970-428e-a077-fff0fe2dff59"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:02:38.759915 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.759888    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph" (OuterVolumeSpecName: "kube-api-access-nrpph") pod "b4cab170-f970-428e-a077-fff0fe2dff59" (UID: "b4cab170-f970-428e-a077-fff0fe2dff59"). InnerVolumeSpecName "kube-api-access-nrpph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:38.858337 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.858298    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrpph\" (UniqueName: \"kubernetes.io/projected/b4cab170-f970-428e-a077-fff0fe2dff59-kube-api-access-nrpph\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:38.858337 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:38.858329    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4cab170-f970-428e-a077-fff0fe2dff59-config-file\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:39.375440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.375405    2570 generic.go:356] "Generic (PLEG): container finished" podID="b4cab170-f970-428e-a077-fff0fe2dff59" containerID="336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f" exitCode=0
Sep 07 13:02:39.375905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.375487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" event={"ID":"b4cab170-f970-428e-a077-fff0fe2dff59","Type":"ContainerDied","Data":"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"}
Sep 07 13:02:39.375905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.375509    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"
Sep 07 13:02:39.375905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.375547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-tdcx2" event={"ID":"b4cab170-f970-428e-a077-fff0fe2dff59","Type":"ContainerDied","Data":"92bc07fbac8b7ea8dc256253ac86558ce33e57bbde39f9be5f8380372a42dd3f"}
Sep 07 13:02:39.375905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.375576    2570 scope.go:117] "RemoveContainer" containerID="336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"
Sep 07 13:02:39.377756 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.377729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" event={"ID":"014f58db-4930-468f-a1e3-9ac2b340121c","Type":"ContainerStarted","Data":"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"}
Sep 07 13:02:39.386419 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.386392    2570 scope.go:117] "RemoveContainer" containerID="336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"
Sep 07 13:02:39.386739 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:39.386718    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f\": container with ID starting with 336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f not found: ID does not exist" containerID="336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"
Sep 07 13:02:39.386828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.386745    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f"} err="failed to get container status \"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f\": rpc error: code = NotFound desc = could not find container \"336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f\": container with ID starting with 336c6338c3007fbed4b8f17f6ccbc44c3c34390f8b6635da969083342cd4183f not found: ID does not exist"
Sep 07 13:02:39.413835 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.413766    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" podStartSLOduration=1.684945036 podStartE2EDuration="16.413737022s" totalImagesPullingTime="14.728791986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-07 13:02:39.41288563 +0000 UTC m=+583.119668563" watchObservedRunningTime="2026-09-07 13:02:39.413737022 +0000 UTC m=+583.120519958"
Sep 07 13:02:39.435594 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.435565    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:39.441149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.441122    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-tdcx2"]
Sep 07 13:02:39.448398 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.448366    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:39.448603 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.448577    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-lw4lx" podUID="455fad90-dafd-4323-ad19-2c47cf8a1183" containerName="authorino" containerID="cri-o://91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4" gracePeriod=30
Sep 07 13:02:39.690045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.690013    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:39.764656 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.764608    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zbbn\" (UniqueName: \"kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn\") pod \"455fad90-dafd-4323-ad19-2c47cf8a1183\" (UID: \"455fad90-dafd-4323-ad19-2c47cf8a1183\") "
Sep 07 13:02:39.766704 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.766671    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn" (OuterVolumeSpecName: "kube-api-access-5zbbn") pod "455fad90-dafd-4323-ad19-2c47cf8a1183" (UID: "455fad90-dafd-4323-ad19-2c47cf8a1183"). InnerVolumeSpecName "kube-api-access-5zbbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:39.865402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.865307    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zbbn\" (UniqueName: \"kubernetes.io/projected/455fad90-dafd-4323-ad19-2c47cf8a1183-kube-api-access-5zbbn\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:39.935019 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.934984    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"]
Sep 07 13:02:39.935320 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935308    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455fad90-dafd-4323-ad19-2c47cf8a1183" containerName="authorino"
Sep 07 13:02:39.935374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935321    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="455fad90-dafd-4323-ad19-2c47cf8a1183" containerName="authorino"
Sep 07 13:02:39.935374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935334    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cab170-f970-428e-a077-fff0fe2dff59" containerName="limitador"
Sep 07 13:02:39.935374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935341    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cab170-f970-428e-a077-fff0fe2dff59" containerName="limitador"
Sep 07 13:02:39.935509 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935397    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="455fad90-dafd-4323-ad19-2c47cf8a1183" containerName="authorino"
Sep 07 13:02:39.935509 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.935406    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cab170-f970-428e-a077-fff0fe2dff59" containerName="limitador"
Sep 07 13:02:39.938260 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.938237    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:39.940723 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.940700    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 07 13:02:39.941071 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.941052    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:02:39.941140 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.941052    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 13:02:39.942169 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.942150    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lvc4g\""
Sep 07 13:02:39.947285 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.947260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"]
Sep 07 13:02:39.965630 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.965583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/066d589b-5092-4470-a498-52defaccb0fa-data\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:39.965780 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:39.965706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfgg4\" (UniqueName: \"kubernetes.io/projected/066d589b-5092-4470-a498-52defaccb0fa-kube-api-access-lfgg4\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.066339 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.066296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/066d589b-5092-4470-a498-52defaccb0fa-data\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.066513 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.066390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfgg4\" (UniqueName: \"kubernetes.io/projected/066d589b-5092-4470-a498-52defaccb0fa-kube-api-access-lfgg4\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.066751 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.066725    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/066d589b-5092-4470-a498-52defaccb0fa-data\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.076593 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.076563    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfgg4\" (UniqueName: \"kubernetes.io/projected/066d589b-5092-4470-a498-52defaccb0fa-kube-api-access-lfgg4\") pod \"postgres-69fb4594cf-dkdhn\" (UID: \"066d589b-5092-4470-a498-52defaccb0fa\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.249904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.249867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:40.385185 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.385145    2570 generic.go:356] "Generic (PLEG): container finished" podID="455fad90-dafd-4323-ad19-2c47cf8a1183" containerID="91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4" exitCode=0
Sep 07 13:02:40.385600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.385190    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lw4lx"
Sep 07 13:02:40.385600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.385203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lw4lx" event={"ID":"455fad90-dafd-4323-ad19-2c47cf8a1183","Type":"ContainerDied","Data":"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"}
Sep 07 13:02:40.385600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.385234    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lw4lx" event={"ID":"455fad90-dafd-4323-ad19-2c47cf8a1183","Type":"ContainerDied","Data":"3ce24c2ad750f927f98c95bb7ea5b8ba3f55ff369a70a5279da0524c4521b31f"}
Sep 07 13:02:40.385600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.385256    2570 scope.go:117] "RemoveContainer" containerID="91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"
Sep 07 13:02:40.393834 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.393815    2570 scope.go:117] "RemoveContainer" containerID="91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"
Sep 07 13:02:40.394158 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:40.394128    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4\": container with ID starting with 91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4 not found: ID does not exist" containerID="91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"
Sep 07 13:02:40.394239 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.394163    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4"} err="failed to get container status \"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4\": rpc error: code = NotFound desc = could not find container \"91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4\": container with ID starting with 91e0627bee5d5f21b7dc8742536bd3e8a6c8f5d8b803055c076545be6a184eb4 not found: ID does not exist"
Sep 07 13:02:40.408071 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.408044    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:40.414885 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.414856    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lw4lx"]
Sep 07 13:02:40.521957 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.521931    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"]
Sep 07 13:02:40.524321 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:40.524284    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066d589b_5092_4470_a498_52defaccb0fa.slice/crio-0d1ee520e8ae27d2638d6fb3f8e269c9d00716f6dfe788b26dbed7975a940347 WatchSource:0}: Error finding container 0d1ee520e8ae27d2638d6fb3f8e269c9d00716f6dfe788b26dbed7975a940347: Status 404 returned error can't find the container with id 0d1ee520e8ae27d2638d6fb3f8e269c9d00716f6dfe788b26dbed7975a940347
Sep 07 13:02:40.814948 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.814866    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="455fad90-dafd-4323-ad19-2c47cf8a1183" path="/var/lib/kubelet/pods/455fad90-dafd-4323-ad19-2c47cf8a1183/volumes"
Sep 07 13:02:40.815220 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:40.815207    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4cab170-f970-428e-a077-fff0fe2dff59" path="/var/lib/kubelet/pods/b4cab170-f970-428e-a077-fff0fe2dff59/volumes"
Sep 07 13:02:41.393370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:41.393329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn" event={"ID":"066d589b-5092-4470-a498-52defaccb0fa","Type":"ContainerStarted","Data":"0d1ee520e8ae27d2638d6fb3f8e269c9d00716f6dfe788b26dbed7975a940347"}
Sep 07 13:02:46.423791 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:46.423743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn" event={"ID":"066d589b-5092-4470-a498-52defaccb0fa","Type":"ContainerStarted","Data":"6f4afd0b20bbf5aef938c247c14162362b54891422278d1138c20aac50d264a8"}
Sep 07 13:02:46.424184 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:46.423823    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:46.446196 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:46.446135    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn" podStartSLOduration=2.513674896 podStartE2EDuration="7.44611688s" totalImagesPullingTime="4.932441984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:46.444070281 +0000 UTC m=+590.150853215" watchObservedRunningTime="2026-09-07 13:02:46.44611688 +0000 UTC m=+590.152899811"
Sep 07 13:02:52.458555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:52.458524    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dkdhn"
Sep 07 13:02:53.027606 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.027570    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:53.030996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.030968    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:53.040955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.040927    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:53.081300 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.081263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rz9j\" (UniqueName: \"kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j\") pod \"authorino-5dc7ccb5f-kgvpj\" (UID: \"9c20cf50-aff9-4858-9157-d94c88aa4766\") " pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:53.181914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.181871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rz9j\" (UniqueName: \"kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j\") pod \"authorino-5dc7ccb5f-kgvpj\" (UID: \"9c20cf50-aff9-4858-9157-d94c88aa4766\") " pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:53.191590 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.191562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rz9j\" (UniqueName: \"kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j\") pod \"authorino-5dc7ccb5f-kgvpj\" (UID: \"9c20cf50-aff9-4858-9157-d94c88aa4766\") " pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:53.275997 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.275960    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:53.276243 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.276227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:53.306040 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.306010    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:02:53.309610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.309586    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.312441 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.312420    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 07 13:02:53.320868 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.320842    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:02:53.382986 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.382950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.383142 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.383010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8487\" (UniqueName: \"kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.484297 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.484256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8487\" (UniqueName: \"kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.484799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.484337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.486851 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.486823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.494050 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.494028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8487\" (UniqueName: \"kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487\") pod \"authorino-66f97f6b7d-8nz2c\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") " pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.556677 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.556647    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:53.558669 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:53.558643    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c20cf50_aff9_4858_9157_d94c88aa4766.slice/crio-02fd35009edb565d4f5cb29539a3c705cc7ee5dec3962095fc9f13e149e3f42d WatchSource:0}: Error finding container 02fd35009edb565d4f5cb29539a3c705cc7ee5dec3962095fc9f13e149e3f42d: Status 404 returned error can't find the container with id 02fd35009edb565d4f5cb29539a3c705cc7ee5dec3962095fc9f13e149e3f42d
Sep 07 13:02:53.620839 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.620806    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:02:53.893973 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:53.893938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:02:53.898294 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:02:53.898261    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc88f6ec9_a02c_40b4_bdd6_4f9f94819922.slice/crio-064af494f2e20def7814fe202378f78a5563bd91b813b0940556679904ab5d64 WatchSource:0}: Error finding container 064af494f2e20def7814fe202378f78a5563bd91b813b0940556679904ab5d64: Status 404 returned error can't find the container with id 064af494f2e20def7814fe202378f78a5563bd91b813b0940556679904ab5d64
Sep 07 13:02:54.465273 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.465234    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" event={"ID":"c88f6ec9-a02c-40b4-bdd6-4f9f94819922","Type":"ContainerStarted","Data":"064af494f2e20def7814fe202378f78a5563bd91b813b0940556679904ab5d64"}
Sep 07 13:02:54.466779 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.466746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" event={"ID":"9c20cf50-aff9-4858-9157-d94c88aa4766","Type":"ContainerStarted","Data":"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"}
Sep 07 13:02:54.466928 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.466785    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" event={"ID":"9c20cf50-aff9-4858-9157-d94c88aa4766","Type":"ContainerStarted","Data":"02fd35009edb565d4f5cb29539a3c705cc7ee5dec3962095fc9f13e149e3f42d"}
Sep 07 13:02:54.466928 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.466852    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" podUID="9c20cf50-aff9-4858-9157-d94c88aa4766" containerName="authorino" containerID="cri-o://8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292" gracePeriod=30
Sep 07 13:02:54.485155 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.485109    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" podStartSLOduration=1.191705996 podStartE2EDuration="1.485094112s" totalImagesPullingTime="293.388116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:54.484854625 +0000 UTC m=+598.191637561" watchObservedRunningTime="2026-09-07 13:02:54.485094112 +0000 UTC m=+598.191877043"
Sep 07 13:02:54.712144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.712118    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:54.794767 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.794672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rz9j\" (UniqueName: \"kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j\") pod \"9c20cf50-aff9-4858-9157-d94c88aa4766\" (UID: \"9c20cf50-aff9-4858-9157-d94c88aa4766\") "
Sep 07 13:02:54.796787 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.796763    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j" (OuterVolumeSpecName: "kube-api-access-7rz9j") pod "9c20cf50-aff9-4858-9157-d94c88aa4766" (UID: "9c20cf50-aff9-4858-9157-d94c88aa4766"). InnerVolumeSpecName "kube-api-access-7rz9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:54.895202 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:54.895181    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rz9j\" (UniqueName: \"kubernetes.io/projected/9c20cf50-aff9-4858-9157-d94c88aa4766-kube-api-access-7rz9j\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:55.474076 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.474039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" event={"ID":"c88f6ec9-a02c-40b4-bdd6-4f9f94819922","Type":"ContainerStarted","Data":"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"}
Sep 07 13:02:55.475456 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.475426    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c20cf50-aff9-4858-9157-d94c88aa4766" containerID="8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292" exitCode=0
Sep 07 13:02:55.475596 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.475459    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj"
Sep 07 13:02:55.475596 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.475480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" event={"ID":"9c20cf50-aff9-4858-9157-d94c88aa4766","Type":"ContainerDied","Data":"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"}
Sep 07 13:02:55.475596 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.475502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-kgvpj" event={"ID":"9c20cf50-aff9-4858-9157-d94c88aa4766","Type":"ContainerDied","Data":"02fd35009edb565d4f5cb29539a3c705cc7ee5dec3962095fc9f13e149e3f42d"}
Sep 07 13:02:55.475596 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.475519    2570 scope.go:117] "RemoveContainer" containerID="8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"
Sep 07 13:02:55.484506 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.484487    2570 scope.go:117] "RemoveContainer" containerID="8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"
Sep 07 13:02:55.484840 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:55.484817    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292\": container with ID starting with 8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292 not found: ID does not exist" containerID="8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"
Sep 07 13:02:55.484904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.484849    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292"} err="failed to get container status \"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292\": rpc error: code = NotFound desc = could not find container \"8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292\": container with ID starting with 8f8e6e6b159e121593eec3ea4657a89659377aec08a270a62f176c930f18b292 not found: ID does not exist"
Sep 07 13:02:55.493717 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.493670    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" podStartSLOduration=1.513866835 podStartE2EDuration="2.493656026s" totalImagesPullingTime="979.789191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:55.493060104 +0000 UTC m=+599.199843036" watchObservedRunningTime="2026-09-07 13:02:55.493656026 +0000 UTC m=+599.200438966"
Sep 07 13:02:55.514114 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.514084    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:55.519441 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.519414    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-kgvpj"]
Sep 07 13:02:55.525850 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.525822    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:55.526045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.526020    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" podUID="014f58db-4930-468f-a1e3-9ac2b340121c" containerName="authorino" containerID="cri-o://6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0" gracePeriod=30
Sep 07 13:02:55.782370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.782336    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:55.903864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.903820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rhbd\" (UniqueName: \"kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd\") pod \"014f58db-4930-468f-a1e3-9ac2b340121c\" (UID: \"014f58db-4930-468f-a1e3-9ac2b340121c\") "
Sep 07 13:02:55.906106 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:55.906077    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd" (OuterVolumeSpecName: "kube-api-access-9rhbd") pod "014f58db-4930-468f-a1e3-9ac2b340121c" (UID: "014f58db-4930-468f-a1e3-9ac2b340121c"). InnerVolumeSpecName "kube-api-access-9rhbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:56.004902 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.004859    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rhbd\" (UniqueName: \"kubernetes.io/projected/014f58db-4930-468f-a1e3-9ac2b340121c-kube-api-access-9rhbd\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:02:56.482613 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.482574    2570 generic.go:356] "Generic (PLEG): container finished" podID="014f58db-4930-468f-a1e3-9ac2b340121c" containerID="6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0" exitCode=0
Sep 07 13:02:56.482613 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.482616    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-xrqcn"
Sep 07 13:02:56.482891 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.482662    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" event={"ID":"014f58db-4930-468f-a1e3-9ac2b340121c","Type":"ContainerDied","Data":"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"}
Sep 07 13:02:56.482891 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.482716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-xrqcn" event={"ID":"014f58db-4930-468f-a1e3-9ac2b340121c","Type":"ContainerDied","Data":"0ecedcc35b062e6f42d348fa8cc4ebc9da772e80cb4d6a7b4b3ada8089356cd6"}
Sep 07 13:02:56.482891 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.482739    2570 scope.go:117] "RemoveContainer" containerID="6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"
Sep 07 13:02:56.491412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.491393    2570 scope.go:117] "RemoveContainer" containerID="6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"
Sep 07 13:02:56.491703 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:02:56.491682    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0\": container with ID starting with 6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0 not found: ID does not exist" containerID="6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"
Sep 07 13:02:56.491825 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.491709    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0"} err="failed to get container status \"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0\": rpc error: code = NotFound desc = could not find container \"6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0\": container with ID starting with 6c55df9cc4c97f2d1bbf0cc7123cbccd15d3c30400cddef9b0f2cd971e6e1ff0 not found: ID does not exist"
Sep 07 13:02:56.506199 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.506174    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:56.511306 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.511281    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-xrqcn"]
Sep 07 13:02:56.814749 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.814719    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="014f58db-4930-468f-a1e3-9ac2b340121c" path="/var/lib/kubelet/pods/014f58db-4930-468f-a1e3-9ac2b340121c/volumes"
Sep 07 13:02:56.815039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:02:56.815027    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c20cf50-aff9-4858-9157-d94c88aa4766" path="/var/lib/kubelet/pods/9c20cf50-aff9-4858-9157-d94c88aa4766/volumes"
Sep 07 13:03:01.090489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090455    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090805    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014f58db-4930-468f-a1e3-9ac2b340121c" containerName="authorino"
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090817    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="014f58db-4930-468f-a1e3-9ac2b340121c" containerName="authorino"
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090826    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c20cf50-aff9-4858-9157-d94c88aa4766" containerName="authorino"
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090832    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c20cf50-aff9-4858-9157-d94c88aa4766" containerName="authorino"
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090879    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c20cf50-aff9-4858-9157-d94c88aa4766" containerName="authorino"
Sep 07 13:03:01.092864 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.090887    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="014f58db-4930-468f-a1e3-9ac2b340121c" containerName="authorino"
Sep 07 13:03:01.093769 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.093753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.097122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.097096    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjlz9\""
Sep 07 13:03:01.097412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.097396    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 13:03:01.098176 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.098155    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 13:03:01.098518 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.098499    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 13:03:01.107796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.107715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:01.149055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.149017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcp92\" (UniqueName: \"kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.149055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.149058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.149312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.149187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.250103 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.250055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.250284 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.250138    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcp92\" (UniqueName: \"kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.250284 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.250158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.252541 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.252511    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.252672 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.252539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.260823 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.260796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcp92\" (UniqueName: \"kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92\") pod \"maas-controller-6489bcfd48-5zj9s\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") " pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.336150 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.336115    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:03:01.339423 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.339406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.351095 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.351067    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:03:01.404546 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.404503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:01.452255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.452079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.452255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.452147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.452255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.452201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnvb\" (UniqueName: \"kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.552829 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.552771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.552829 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.552830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.553109 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.552884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnvb\" (UniqueName: \"kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.555343 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.555311    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.555343 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.555338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.562559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.562531    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnvb\" (UniqueName: \"kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb\") pod \"maas-controller-7f4d8b5df-pv5d4\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") " pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.651873 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.651836    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:01.684325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.684294    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:01.686871 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:03:01.686845    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9f022c_3402_4c76_a698_5e287729da20.slice/crio-418d0985957ac75986e6d03fa83da35c343b12c58bf6f22deb8ecafe7df10864 WatchSource:0}: Error finding container 418d0985957ac75986e6d03fa83da35c343b12c58bf6f22deb8ecafe7df10864: Status 404 returned error can't find the container with id 418d0985957ac75986e6d03fa83da35c343b12c58bf6f22deb8ecafe7df10864
Sep 07 13:03:01.688491 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.688363    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:03:01.932255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:01.932229    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:03:01.933875 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:03:01.933852    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b678df_8266_4dfd_932a_30a380cca350.slice/crio-4c446ec6331440bad5f41fcdf72b44ec64e14aedac0e1a28b3210fd13fce850b WatchSource:0}: Error finding container 4c446ec6331440bad5f41fcdf72b44ec64e14aedac0e1a28b3210fd13fce850b: Status 404 returned error can't find the container with id 4c446ec6331440bad5f41fcdf72b44ec64e14aedac0e1a28b3210fd13fce850b
Sep 07 13:03:02.520823 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:02.520784    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" event={"ID":"19b678df-8266-4dfd-932a-30a380cca350","Type":"ContainerStarted","Data":"4c446ec6331440bad5f41fcdf72b44ec64e14aedac0e1a28b3210fd13fce850b"}
Sep 07 13:03:02.521994 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:02.521968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" event={"ID":"6f9f022c-3402-4c76-a698-5e287729da20","Type":"ContainerStarted","Data":"418d0985957ac75986e6d03fa83da35c343b12c58bf6f22deb8ecafe7df10864"}
Sep 07 13:03:05.542028 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.541987    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" event={"ID":"19b678df-8266-4dfd-932a-30a380cca350","Type":"ContainerStarted","Data":"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"}
Sep 07 13:03:05.542512 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.542156    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:05.543867 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.543803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" event={"ID":"6f9f022c-3402-4c76-a698-5e287729da20","Type":"ContainerStarted","Data":"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"}
Sep 07 13:03:05.544014 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.543956    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:05.571270 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.571212    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" podStartSLOduration=1.7823056940000002 podStartE2EDuration="4.571192887s" totalImagesPullingTime="2.788887193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:05.569079408 +0000 UTC m=+609.275862349" watchObservedRunningTime="2026-09-07 13:03:05.571192887 +0000 UTC m=+609.277975816"
Sep 07 13:03:05.590289 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:05.590232    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" podStartSLOduration=1.5615406520000001 podStartE2EDuration="4.590215231s" totalImagesPullingTime="3.028674579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:05.588248601 +0000 UTC m=+609.295031534" watchObservedRunningTime="2026-09-07 13:03:05.590215231 +0000 UTC m=+609.296998163"
Sep 07 13:03:16.551407 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.551372    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:16.551847 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.551454    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:03:16.644384 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.644338    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:16.644993 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.644940    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" podUID="6f9f022c-3402-4c76-a698-5e287729da20" containerName="manager" containerID="cri-o://22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c" gracePeriod=30
Sep 07 13:03:16.886724 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.886697    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:16.989839 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.989801    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert\") pod \"6f9f022c-3402-4c76-a698-5e287729da20\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") "
Sep 07 13:03:16.990039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.989894    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcp92\" (UniqueName: \"kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92\") pod \"6f9f022c-3402-4c76-a698-5e287729da20\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") "
Sep 07 13:03:16.990039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.989913    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs\") pod \"6f9f022c-3402-4c76-a698-5e287729da20\" (UID: \"6f9f022c-3402-4c76-a698-5e287729da20\") "
Sep 07 13:03:16.992017 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.991988    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6f9f022c-3402-4c76-a698-5e287729da20" (UID: "6f9f022c-3402-4c76-a698-5e287729da20"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:03:16.992283 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.992101    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6f9f022c-3402-4c76-a698-5e287729da20" (UID: "6f9f022c-3402-4c76-a698-5e287729da20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:03:16.992283 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:16.992177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92" (OuterVolumeSpecName: "kube-api-access-jcp92") pod "6f9f022c-3402-4c76-a698-5e287729da20" (UID: "6f9f022c-3402-4c76-a698-5e287729da20"). InnerVolumeSpecName "kube-api-access-jcp92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:03:17.091345 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.091260    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-webhook-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.091345 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.091289    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcp92\" (UniqueName: \"kubernetes.io/projected/6f9f022c-3402-4c76-a698-5e287729da20-kube-api-access-jcp92\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.091345 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.091299    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f9f022c-3402-4c76-a698-5e287729da20-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.606427 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.606388    2570 generic.go:356] "Generic (PLEG): container finished" podID="6f9f022c-3402-4c76-a698-5e287729da20" containerID="22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c" exitCode=0
Sep 07 13:03:17.606889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.606434    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6489bcfd48-5zj9s"
Sep 07 13:03:17.606889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.606470    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" event={"ID":"6f9f022c-3402-4c76-a698-5e287729da20","Type":"ContainerDied","Data":"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"}
Sep 07 13:03:17.606889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.606530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6489bcfd48-5zj9s" event={"ID":"6f9f022c-3402-4c76-a698-5e287729da20","Type":"ContainerDied","Data":"418d0985957ac75986e6d03fa83da35c343b12c58bf6f22deb8ecafe7df10864"}
Sep 07 13:03:17.606889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.606554    2570 scope.go:117] "RemoveContainer" containerID="22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"
Sep 07 13:03:17.616213 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.616190    2570 scope.go:117] "RemoveContainer" containerID="22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"
Sep 07 13:03:17.616539 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:03:17.616517    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c\": container with ID starting with 22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c not found: ID does not exist" containerID="22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"
Sep 07 13:03:17.616644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.616547    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c"} err="failed to get container status \"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c\": rpc error: code = NotFound desc = could not find container \"22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c\": container with ID starting with 22074d3c73cdffedbbf2aa249ece13913fb570a8c8da8d0403a3edcb17decb2c not found: ID does not exist"
Sep 07 13:03:17.634369 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.634336    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:17.640409 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:17.640380    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6489bcfd48-5zj9s"]
Sep 07 13:03:18.814432 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:18.814400    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9f022c-3402-4c76-a698-5e287729da20" path="/var/lib/kubelet/pods/6f9f022c-3402-4c76-a698-5e287729da20/volumes"
Sep 07 13:03:38.259347 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.259305    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:03:38.259866 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.259665    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9f022c-3402-4c76-a698-5e287729da20" containerName="manager"
Sep 07 13:03:38.259866 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.259677    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9f022c-3402-4c76-a698-5e287729da20" containerName="manager"
Sep 07 13:03:38.259866 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.259739    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9f022c-3402-4c76-a698-5e287729da20" containerName="manager"
Sep 07 13:03:38.266162 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.266137    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.270176 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.270120    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 13:03:38.270176 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.270121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 13:03:38.270401 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.270142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kvznr\""
Sep 07 13:03:38.275129 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.275092    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jwf\" (UniqueName: \"kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.275275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.275162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.275275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.275210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.275393 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.275324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.278686 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.278661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:03:38.375971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.375931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.375971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.375975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jwf\" (UniqueName: \"kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.376227 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.376006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.376227 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.376043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.376227 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:03:38.376148    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 07 13:03:38.376227 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:03:38.376185    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 07 13:03:38.376227 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:03:38.376212    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls podName:5c31c113-7f5e-4005-aa8a-022761c76810 nodeName:}" failed. No retries permitted until 2026-09-07 13:03:38.876192187 +0000 UTC m=+642.582975100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls") pod "maas-api-6d966df4d9-rcn84" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810") : secret "maas-api-serving-cert" not found
Sep 07 13:03:38.376498 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:03:38.376251    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs podName:5c31c113-7f5e-4005-aa8a-022761c76810 nodeName:}" failed. No retries permitted until 2026-09-07 13:03:38.876232911 +0000 UTC m=+642.583015845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs") pod "maas-api-6d966df4d9-rcn84" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810") : secret "maas-api-metrics-tls" not found
Sep 07 13:03:38.376665 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.376644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.397318 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.397279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jwf\" (UniqueName: \"kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.880439 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.880390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.880439 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.880444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.883113 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.883087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:38.883231 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:38.883125    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") pod \"maas-api-6d966df4d9-rcn84\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") " pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:39.178122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:39.178084    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:39.465964 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:39.465884    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:03:39.468096 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:03:39.468062    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c31c113_7f5e_4005_aa8a_022761c76810.slice/crio-7bf0b7dba6e0766301b233bfbfdbe2660c5222dd0ed9fd6d9f02f0ac7125e5b3 WatchSource:0}: Error finding container 7bf0b7dba6e0766301b233bfbfdbe2660c5222dd0ed9fd6d9f02f0ac7125e5b3: Status 404 returned error can't find the container with id 7bf0b7dba6e0766301b233bfbfdbe2660c5222dd0ed9fd6d9f02f0ac7125e5b3
Sep 07 13:03:39.726080 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:39.725986    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" event={"ID":"5c31c113-7f5e-4005-aa8a-022761c76810","Type":"ContainerStarted","Data":"7bf0b7dba6e0766301b233bfbfdbe2660c5222dd0ed9fd6d9f02f0ac7125e5b3"}
Sep 07 13:03:41.739953 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:41.739914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" event={"ID":"5c31c113-7f5e-4005-aa8a-022761c76810","Type":"ContainerStarted","Data":"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"}
Sep 07 13:03:41.740340 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:41.739977    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:03:41.768774 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:41.768701    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" podStartSLOduration=1.69596586 podStartE2EDuration="3.768676764s" totalImagesPullingTime="2.072710904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:41.768415849 +0000 UTC m=+645.475198782" watchObservedRunningTime="2026-09-07 13:03:41.768676764 +0000 UTC m=+645.475459697"
Sep 07 13:03:47.750423 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:03:47.750390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:04:16.353314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.353281    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"]
Sep 07 13:04:16.360027 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.360003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.366999 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.366978    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 13:04:16.368202 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.368181    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 13:04:16.368297 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.368181    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4fn2j\""
Sep 07 13:04:16.368297 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.368227    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 07 13:04:16.377815 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.377782    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"]
Sep 07 13:04:16.507019 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.506976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.507207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.507031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.507207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.507077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.507207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.507142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfxjl\" (UniqueName: \"kubernetes.io/projected/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-kube-api-access-kfxjl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.507207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.507189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.507367 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.507232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608173 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608173 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfxjl\" (UniqueName: \"kubernetes.io/projected/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-kube-api-access-kfxjl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608444 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608444 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608444 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608444 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608685 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608685 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608581    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.608685 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.608674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.610772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.610751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.610946 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.610928    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.619386 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.619354    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfxjl\" (UniqueName: \"kubernetes.io/projected/fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4-kube-api-access-kfxjl\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk\" (UID: \"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.669899 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.669863    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:16.955067 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:16.955028    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"]
Sep 07 13:04:16.957366 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:04:16.957337    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2fc993_285b_44ee_8cd1_3f5f0b4f9eb4.slice/crio-80fe2e2298e8ea273bab004909dc0d363d15255c4dae055274f7988d47918bfc WatchSource:0}: Error finding container 80fe2e2298e8ea273bab004909dc0d363d15255c4dae055274f7988d47918bfc: Status 404 returned error can't find the container with id 80fe2e2298e8ea273bab004909dc0d363d15255c4dae055274f7988d47918bfc
Sep 07 13:04:17.924426 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:17.924387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk" event={"ID":"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4","Type":"ContainerStarted","Data":"80fe2e2298e8ea273bab004909dc0d363d15255c4dae055274f7988d47918bfc"}
Sep 07 13:04:18.930978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:18.930943    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk" event={"ID":"fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4","Type":"ContainerStarted","Data":"f29c6f259da2969283b975bf120b3f3df0828623a774d1be29764ed915665d36"}
Sep 07 13:04:18.969228 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:18.969172    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk" podStartSLOduration=1.892232045 podStartE2EDuration="2.969154338s" totalImagesPullingTime="1.076922293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:04:18.968332629 +0000 UTC m=+682.675115576" watchObservedRunningTime="2026-09-07 13:04:18.969154338 +0000 UTC m=+682.675937269"
Sep 07 13:04:26.670519 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:26.670480    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:26.671047 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:26.670550    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:26.683285 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:26.683249    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:04:26.986532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:04:26.986446    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk"
Sep 07 13:06:07.004408 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.004375    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cdf6bbd8c-pj9vg"]
Sep 07 13:06:07.007837 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.007815    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.019372 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.019340    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cdf6bbd8c-pj9vg"]
Sep 07 13:06:07.181760 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.181718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zncd\" (UniqueName: \"kubernetes.io/projected/745089c0-ddc7-424c-b30e-6053389ffaca-kube-api-access-4zncd\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.181931 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.181788    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/745089c0-ddc7-424c-b30e-6053389ffaca-tls-cert\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.282638 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.282529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/745089c0-ddc7-424c-b30e-6053389ffaca-tls-cert\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.282638 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.282610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zncd\" (UniqueName: \"kubernetes.io/projected/745089c0-ddc7-424c-b30e-6053389ffaca-kube-api-access-4zncd\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.285090 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.285066    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/745089c0-ddc7-424c-b30e-6053389ffaca-tls-cert\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.291931 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.291899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zncd\" (UniqueName: \"kubernetes.io/projected/745089c0-ddc7-424c-b30e-6053389ffaca-kube-api-access-4zncd\") pod \"authorino-6cdf6bbd8c-pj9vg\" (UID: \"745089c0-ddc7-424c-b30e-6053389ffaca\") " pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.316752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.316723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg"
Sep 07 13:06:07.591855 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:07.591826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cdf6bbd8c-pj9vg"]
Sep 07 13:06:07.593602 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:07.593578    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod745089c0_ddc7_424c_b30e_6053389ffaca.slice/crio-9f50cc69fb3c574a4c8df3626837a48c86eca5707dc9cff15c80172d26b3a647 WatchSource:0}: Error finding container 9f50cc69fb3c574a4c8df3626837a48c86eca5707dc9cff15c80172d26b3a647: Status 404 returned error can't find the container with id 9f50cc69fb3c574a4c8df3626837a48c86eca5707dc9cff15c80172d26b3a647
Sep 07 13:06:08.506721 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.506598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg" event={"ID":"745089c0-ddc7-424c-b30e-6053389ffaca","Type":"ContainerStarted","Data":"c3104ee72915c65ca7f72328584254ce836615775fafe6f90d3cf1b54bd9604b"}
Sep 07 13:06:08.506721 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.506679    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg" event={"ID":"745089c0-ddc7-424c-b30e-6053389ffaca","Type":"ContainerStarted","Data":"9f50cc69fb3c574a4c8df3626837a48c86eca5707dc9cff15c80172d26b3a647"}
Sep 07 13:06:08.527134 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.527075    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cdf6bbd8c-pj9vg" podStartSLOduration=1.870233891 podStartE2EDuration="2.527054622s" totalImagesPullingTime="656.820731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:08.524910266 +0000 UTC m=+792.231693226" watchObservedRunningTime="2026-09-07 13:06:08.527054622 +0000 UTC m=+792.233837554"
Sep 07 13:06:08.573015 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.571399    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:06:08.573015 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.571693    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" podUID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" containerName="authorino" containerID="cri-o://28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3" gracePeriod=30
Sep 07 13:06:08.834755 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.834728    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:06:08.997138 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.997104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert\") pod \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") "
Sep 07 13:06:08.997311 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.997244    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8487\" (UniqueName: \"kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487\") pod \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\" (UID: \"c88f6ec9-a02c-40b4-bdd6-4f9f94819922\") "
Sep 07 13:06:08.999368 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:08.999334    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487" (OuterVolumeSpecName: "kube-api-access-w8487") pod "c88f6ec9-a02c-40b4-bdd6-4f9f94819922" (UID: "c88f6ec9-a02c-40b4-bdd6-4f9f94819922"). InnerVolumeSpecName "kube-api-access-w8487". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:09.008809 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.008780    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c88f6ec9-a02c-40b4-bdd6-4f9f94819922" (UID: "c88f6ec9-a02c-40b4-bdd6-4f9f94819922"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:06:09.098903 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.098800    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8487\" (UniqueName: \"kubernetes.io/projected/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-kube-api-access-w8487\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:06:09.098903 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.098831    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c88f6ec9-a02c-40b4-bdd6-4f9f94819922-tls-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:06:09.512710 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.512674    2570 generic.go:356] "Generic (PLEG): container finished" podID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" containerID="28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3" exitCode=0
Sep 07 13:06:09.513128 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.512727    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c"
Sep 07 13:06:09.513128 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.512772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" event={"ID":"c88f6ec9-a02c-40b4-bdd6-4f9f94819922","Type":"ContainerDied","Data":"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"}
Sep 07 13:06:09.513128 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.512827    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f97f6b7d-8nz2c" event={"ID":"c88f6ec9-a02c-40b4-bdd6-4f9f94819922","Type":"ContainerDied","Data":"064af494f2e20def7814fe202378f78a5563bd91b813b0940556679904ab5d64"}
Sep 07 13:06:09.513128 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.512852    2570 scope.go:117] "RemoveContainer" containerID="28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"
Sep 07 13:06:09.522724 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.522705    2570 scope.go:117] "RemoveContainer" containerID="28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"
Sep 07 13:06:09.523007 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:09.522991    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3\": container with ID starting with 28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3 not found: ID does not exist" containerID="28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"
Sep 07 13:06:09.523054 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.523015    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3"} err="failed to get container status \"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3\": rpc error: code = NotFound desc = could not find container \"28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3\": container with ID starting with 28af2107f3948e22b55a1033a7c3df957813eb15065237eaa63c29fe15ccf8f3 not found: ID does not exist"
Sep 07 13:06:09.562031 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.561995    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:06:09.566202 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:09.566173    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66f97f6b7d-8nz2c"]
Sep 07 13:06:10.814825 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:10.814791    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" path="/var/lib/kubelet/pods/c88f6ec9-a02c-40b4-bdd6-4f9f94819922/volumes"
Sep 07 13:06:27.446821 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.446730    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7871-140406048697136"]
Sep 07 13:06:27.447279 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.447243    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" containerName="authorino"
Sep 07 13:06:27.447279 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.447260    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" containerName="authorino"
Sep 07 13:06:27.447387 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.447339    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c88f6ec9-a02c-40b4-bdd6-4f9f94819922" containerName="authorino"
Sep 07 13:06:27.450560 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.450538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:27.453172 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.453139    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2xgvq\""
Sep 07 13:06:27.458799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.458763    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7871-140406048697136"]
Sep 07 13:06:27.554741 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.554693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvtf5\" (UniqueName: \"kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5\") pod \"test-curl-7871-140406048697136\" (UID: \"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4\") " pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:27.655740 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.655700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvtf5\" (UniqueName: \"kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5\") pod \"test-curl-7871-140406048697136\" (UID: \"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4\") " pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:27.671912 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.671886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvtf5\" (UniqueName: \"kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5\") pod \"test-curl-7871-140406048697136\" (UID: \"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4\") " pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:27.761921 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:27.761835    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:28.038309 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:28.038253    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7871-140406048697136"]
Sep 07 13:06:28.040593 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:28.040561    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod710ec8d0_1b5d_47e6_acf2_9a33401dc5a4.slice/crio-1a878a62911db2a7b9aca593d82afd653e6f400d24bfd038521c3176c6b03c68 WatchSource:0}: Error finding container 1a878a62911db2a7b9aca593d82afd653e6f400d24bfd038521c3176c6b03c68: Status 404 returned error can't find the container with id 1a878a62911db2a7b9aca593d82afd653e6f400d24bfd038521c3176c6b03c68
Sep 07 13:06:28.615249 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:28.615208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7871-140406048697136" event={"ID":"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4","Type":"ContainerStarted","Data":"1a878a62911db2a7b9aca593d82afd653e6f400d24bfd038521c3176c6b03c68"}
Sep 07 13:06:29.623032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:29.622995    2570 generic.go:356] "Generic (PLEG): container finished" podID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" containerID="f4d920ddaf12c428e5cc02989aa2f47155e7809282895c5a13ad27f8a1f6e91f" exitCode=0
Sep 07 13:06:29.623418 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:29.623095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7871-140406048697136" event={"ID":"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4","Type":"ContainerDied","Data":"f4d920ddaf12c428e5cc02989aa2f47155e7809282895c5a13ad27f8a1f6e91f"}
Sep 07 13:06:30.612109 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.612076    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:06:30.616340 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.616313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.619104 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.619080    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7ce94d-serving-cert\""
Sep 07 13:06:30.628836 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.628758    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:06:30.681879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.681837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.682051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.681900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.682051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.681975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt44n\" (UniqueName: \"kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.682051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.681993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.774121 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.774087    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:30.783249 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.783222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.783382 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.783305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt44n\" (UniqueName: \"kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.783511 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.783486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.783583 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.783562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.784254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.784230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.786098 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.786076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.786177 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.786082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.795301 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.795274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt44n\" (UniqueName: \"kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n\") pod \"maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.806312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.806279    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7871-140406048697136_710ec8d0-1b5d-47e6-acf2-9a33401dc5a4/test-curl-7871-140406048697136/0.log"
Sep 07 13:06:30.832390 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.832353    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7871-140406048697136"]
Sep 07 13:06:30.834509 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.834487    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7871-140406048697136"]
Sep 07 13:06:30.884450 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.884339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvtf5\" (UniqueName: \"kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5\") pod \"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4\" (UID: \"710ec8d0-1b5d-47e6-acf2-9a33401dc5a4\") "
Sep 07 13:06:30.886633 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.886584    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5" (OuterVolumeSpecName: "kube-api-access-tvtf5") pod "710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" (UID: "710ec8d0-1b5d-47e6-acf2-9a33401dc5a4"). InnerVolumeSpecName "kube-api-access-tvtf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:30.930094 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.930052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:30.956076 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.956045    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7871-140406048698032"]
Sep 07 13:06:30.956470 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.956457    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" containerName="test-curl-7871-140406048697136"
Sep 07 13:06:30.956533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.956473    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" containerName="test-curl-7871-140406048697136"
Sep 07 13:06:30.956572 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.956551    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" containerName="test-curl-7871-140406048697136"
Sep 07 13:06:30.960015 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.959994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:30.970015 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.969988    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7871-140406048698032"]
Sep 07 13:06:30.985081 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.985054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csvd8\" (UniqueName: \"kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8\") pod \"test-curl-7871-140406048698032\" (UID: \"64a5596a-8c54-481d-88c5-07f38034fb51\") " pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:30.985258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:30.985142    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvtf5\" (UniqueName: \"kubernetes.io/projected/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4-kube-api-access-tvtf5\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:06:31.086535 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.086495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csvd8\" (UniqueName: \"kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8\") pod \"test-curl-7871-140406048698032\" (UID: \"64a5596a-8c54-481d-88c5-07f38034fb51\") " pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:31.101281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.101248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csvd8\" (UniqueName: \"kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8\") pod \"test-curl-7871-140406048698032\" (UID: \"64a5596a-8c54-481d-88c5-07f38034fb51\") " pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:31.215492 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.215464    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:06:31.217569 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:31.217541    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2da18f_1a28_4b58_903b_7506703987fb.slice/crio-f487957bb960e73066246c8d32c9089f1da05fa049806803fb405331b2e888d2 WatchSource:0}: Error finding container f487957bb960e73066246c8d32c9089f1da05fa049806803fb405331b2e888d2: Status 404 returned error can't find the container with id f487957bb960e73066246c8d32c9089f1da05fa049806803fb405331b2e888d2
Sep 07 13:06:31.271066 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.271033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:31.548187 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.548155    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7871-140406048698032"]
Sep 07 13:06:31.549675 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:31.549640    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64a5596a_8c54_481d_88c5_07f38034fb51.slice/crio-3cc08c7e3aa3c9e7cc40020781aadd0f416b488f5c131b8a22ef497877369ccf WatchSource:0}: Error finding container 3cc08c7e3aa3c9e7cc40020781aadd0f416b488f5c131b8a22ef497877369ccf: Status 404 returned error can't find the container with id 3cc08c7e3aa3c9e7cc40020781aadd0f416b488f5c131b8a22ef497877369ccf
Sep 07 13:06:31.638075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.638038    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" event={"ID":"0b2da18f-1a28-4b58-903b-7506703987fb","Type":"ContainerStarted","Data":"f487957bb960e73066246c8d32c9089f1da05fa049806803fb405331b2e888d2"}
Sep 07 13:06:31.639392 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.639371    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a878a62911db2a7b9aca593d82afd653e6f400d24bfd038521c3176c6b03c68"
Sep 07 13:06:31.639392 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.639385    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:31.640663 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:31.640640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7871-140406048698032" event={"ID":"64a5596a-8c54-481d-88c5-07f38034fb51","Type":"ContainerStarted","Data":"3cc08c7e3aa3c9e7cc40020781aadd0f416b488f5c131b8a22ef497877369ccf"}
Sep 07 13:06:31.651913 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:31.651884    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7871-140406048697136\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:32.648476 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.648437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" event={"ID":"0b2da18f-1a28-4b58-903b-7506703987fb","Type":"ContainerStarted","Data":"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"}
Sep 07 13:06:32.648952 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.648521    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:32.650196 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.650168    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7871-140406048698032" event={"ID":"64a5596a-8c54-481d-88c5-07f38034fb51","Type":"ContainerStarted","Data":"dea1ed4306ebd30d9c93b240dbf90dcb92b49e162d1b4d12b78cfc0d0963a853"}
Sep 07 13:06:32.650861 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:32.650836    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7871-140406048697136\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:32.671917 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:32.671879    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7871-140406048697136\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" pod="opendatahub/test-curl-7871-140406048697136"
Sep 07 13:06:32.672296 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.672254    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" podStartSLOduration=2.1879656929999998 podStartE2EDuration="2.67223865s" totalImagesPullingTime="484.272957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:32.669756636 +0000 UTC m=+816.376539568" watchObservedRunningTime="2026-09-07 13:06:32.67223865 +0000 UTC m=+816.379021581"
Sep 07 13:06:32.689340 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.689280    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7871-140406048698032" podStartSLOduration=1.701482927 podStartE2EDuration="2.689263402s" totalImagesPullingTime="987.780475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:32.68783462 +0000 UTC m=+816.394617553" watchObservedRunningTime="2026-09-07 13:06:32.689263402 +0000 UTC m=+816.396046335"
Sep 07 13:06:32.782485 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.782455    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7871-140406048698032_64a5596a-8c54-481d-88c5-07f38034fb51/test-curl-7871-140406048698032/0.log"
Sep 07 13:06:32.815464 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:32.815386    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710ec8d0-1b5d-47e6-acf2-9a33401dc5a4" path="/var/lib/kubelet/pods/710ec8d0-1b5d-47e6-acf2-9a33401dc5a4/volumes"
Sep 07 13:06:33.657723 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:33.657688    2570 generic.go:356] "Generic (PLEG): container finished" podID="64a5596a-8c54-481d-88c5-07f38034fb51" containerID="dea1ed4306ebd30d9c93b240dbf90dcb92b49e162d1b4d12b78cfc0d0963a853" exitCode=0
Sep 07 13:06:33.658216 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:33.657786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7871-140406048698032" event={"ID":"64a5596a-8c54-481d-88c5-07f38034fb51","Type":"ContainerDied","Data":"dea1ed4306ebd30d9c93b240dbf90dcb92b49e162d1b4d12b78cfc0d0963a853"}
Sep 07 13:06:34.796773 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:34.796740    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:34.835680 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:34.835645    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7871-140406048698032"]
Sep 07 13:06:34.842255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:34.842212    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7871-140406048698032"]
Sep 07 13:06:34.924192 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:34.924093    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csvd8\" (UniqueName: \"kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8\") pod \"64a5596a-8c54-481d-88c5-07f38034fb51\" (UID: \"64a5596a-8c54-481d-88c5-07f38034fb51\") "
Sep 07 13:06:34.926208 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:34.926177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8" (OuterVolumeSpecName: "kube-api-access-csvd8") pod "64a5596a-8c54-481d-88c5-07f38034fb51" (UID: "64a5596a-8c54-481d-88c5-07f38034fb51"). InnerVolumeSpecName "kube-api-access-csvd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:35.025289 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:35.025252    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csvd8\" (UniqueName: \"kubernetes.io/projected/64a5596a-8c54-481d-88c5-07f38034fb51-kube-api-access-csvd8\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:06:35.673992 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:35.673958    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cc08c7e3aa3c9e7cc40020781aadd0f416b488f5c131b8a22ef497877369ccf"
Sep 07 13:06:35.673992 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:35.673965    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:35.688083 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:35.688052    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7871-140406048698032\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:36.813202 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:36.813159    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7871-140406048698032\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" pod="opendatahub/test-curl-7871-140406048698032"
Sep 07 13:06:36.814757 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:36.814735    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" path="/var/lib/kubelet/pods/64a5596a-8c54-481d-88c5-07f38034fb51/volumes"
Sep 07 13:06:38.663194 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.663162    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:06:38.742904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.742869    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:06:38.743682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.743654    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" containerName="test-curl-7871-140406048698032"
Sep 07 13:06:38.743839 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.743825    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" containerName="test-curl-7871-140406048698032"
Sep 07 13:06:38.744048 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.744031    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a5596a-8c54-481d-88c5-07f38034fb51" containerName="test-curl-7871-140406048698032"
Sep 07 13:06:38.746924 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.746904    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.749673 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.749649    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2cd995c1-serving-cert\""
Sep 07 13:06:38.759001 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.758726    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:06:38.860566 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.860526    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.860566 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.860570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.860848 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.860701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.860848 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.860734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4sd\" (UniqueName: \"kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.961330 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.961236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.961330 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.961281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.961330 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.961334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.961650 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.961351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4sd\" (UniqueName: \"kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.961650 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:38.961473    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-serving-cert: secret "maas-api-e2e-ait-2cd995c1-serving-cert" not found
Sep 07 13:06:38.961650 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:38.961562    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls podName:a42fd9ad-e006-46df-b69e-a96d78ac8f18 nodeName:}" failed. No retries permitted until 2026-09-07 13:06:39.461540131 +0000 UTC m=+823.168323043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls") pod "maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" (UID: "a42fd9ad-e006-46df-b69e-a96d78ac8f18") : secret "maas-api-e2e-ait-2cd995c1-serving-cert" not found
Sep 07 13:06:38.962058 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.962036    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.963913 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.963889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:38.971507 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:38.971478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4sd\" (UniqueName: \"kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:39.467632 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:39.467574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:39.470137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:39.470103    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") pod \"maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:39.661896 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:39.661853    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:39.946405 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:39.946374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:06:39.952634 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:39.952583    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42fd9ad_e006_46df_b69e_a96d78ac8f18.slice/crio-66313f08c6004e19741bb2122fd9a326bdd3a453e64b844f0fe559339e1a6251 WatchSource:0}: Error finding container 66313f08c6004e19741bb2122fd9a326bdd3a453e64b844f0fe559339e1a6251: Status 404 returned error can't find the container with id 66313f08c6004e19741bb2122fd9a326bdd3a453e64b844f0fe559339e1a6251
Sep 07 13:06:40.704589 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:40.704547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" event={"ID":"a42fd9ad-e006-46df-b69e-a96d78ac8f18","Type":"ContainerStarted","Data":"66313f08c6004e19741bb2122fd9a326bdd3a453e64b844f0fe559339e1a6251"}
Sep 07 13:06:40.953552 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:40.953510    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:06:40.958018 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:40.957949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:40.960798 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:40.960774    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-e9d55a-serving-cert\""
Sep 07 13:06:40.967382 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:40.967354    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:06:41.085027 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.084991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.085212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.085054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.085212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.085135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.085212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.085169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxmr\" (UniqueName: \"kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.185939 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.185892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.186120 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.185960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.186120 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.186008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.186120 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.186037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxmr\" (UniqueName: \"kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.186732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.186703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.189116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.189081    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.189234 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.189140    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.196201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.196176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxmr\" (UniqueName: \"kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr\") pod \"maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.273212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.273132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:41.558995 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.558970    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:06:41.560835 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:06:41.560808    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9fb22c_d5e8_4326_8d4f_741d7e3fba4d.slice/crio-7ce433bf69a55044034d3957b3e7809f89f44e28c496b017bfed7c4f62f5add3 WatchSource:0}: Error finding container 7ce433bf69a55044034d3957b3e7809f89f44e28c496b017bfed7c4f62f5add3: Status 404 returned error can't find the container with id 7ce433bf69a55044034d3957b3e7809f89f44e28c496b017bfed7c4f62f5add3
Sep 07 13:06:41.712402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.712367    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" event={"ID":"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d","Type":"ContainerStarted","Data":"7ce433bf69a55044034d3957b3e7809f89f44e28c496b017bfed7c4f62f5add3"}
Sep 07 13:06:41.714409 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.714379    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" event={"ID":"a42fd9ad-e006-46df-b69e-a96d78ac8f18","Type":"ContainerStarted","Data":"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"}
Sep 07 13:06:41.714558 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.714491    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:41.743872 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:41.743818    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" podStartSLOduration=2.941881397 podStartE2EDuration="3.743799264s" totalImagesPullingTime="801.917867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:41.740129805 +0000 UTC m=+825.446912763" watchObservedRunningTime="2026-09-07 13:06:41.743799264 +0000 UTC m=+825.450582196"
Sep 07 13:06:42.721333 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:42.721290    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" event={"ID":"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d","Type":"ContainerStarted","Data":"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"}
Sep 07 13:06:42.721776 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:42.721367    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:42.744087 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:42.744019    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" podStartSLOduration=2.240133376 podStartE2EDuration="2.743994958s" totalImagesPullingTime="503.861582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:42.741652234 +0000 UTC m=+826.448435161" watchObservedRunningTime="2026-09-07 13:06:42.743994958 +0000 UTC m=+826.450777888"
Sep 07 13:06:47.726956 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:47.726918    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:06:48.733652 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:48.733595    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:06:59.723428 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.723387    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:06:59.728655 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.728612    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.732218 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.732185    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-76f028-serving-cert\""
Sep 07 13:06:59.742841 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.742809    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:06:59.852070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.852011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkvc4\" (UniqueName: \"kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.852070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.852075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.852312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.852116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.852312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.852160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.953390 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.953350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkvc4\" (UniqueName: \"kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.953599 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.953411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.953599 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.953455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.953599 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.953494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.953807 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:59.953612    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-serving-cert: secret "maas-api-e2e-inf-b-76f028-serving-cert" not found
Sep 07 13:06:59.953807 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:06:59.953699    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls podName:fcfddb5c-7b28-4e81-8688-dab73980a637 nodeName:}" failed. No retries permitted until 2026-09-07 13:07:00.453676133 +0000 UTC m=+844.160459062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls") pod "maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" (UID: "fcfddb5c-7b28-4e81-8688-dab73980a637") : secret "maas-api-e2e-inf-b-76f028-serving-cert" not found
Sep 07 13:06:59.954244 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.954214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.956174 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.956142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:06:59.964114 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:06:59.964084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkvc4\" (UniqueName: \"kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:00.458799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:00.458759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:00.461303 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:00.461273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") pod \"maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:00.644343 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:00.644299    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:00.931813 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:00.931785    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:07:00.933365 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:07:00.933341    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfddb5c_7b28_4e81_8688_dab73980a637.slice/crio-856f0d2e85131d1c4f247c853f801e6c91f71da5d16e11b6497fe365302a545c WatchSource:0}: Error finding container 856f0d2e85131d1c4f247c853f801e6c91f71da5d16e11b6497fe365302a545c: Status 404 returned error can't find the container with id 856f0d2e85131d1c4f247c853f801e6c91f71da5d16e11b6497fe365302a545c
Sep 07 13:07:01.839233 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:01.839194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" event={"ID":"fcfddb5c-7b28-4e81-8688-dab73980a637","Type":"ContainerStarted","Data":"856f0d2e85131d1c4f247c853f801e6c91f71da5d16e11b6497fe365302a545c"}
Sep 07 13:07:02.848736 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:02.848695    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" event={"ID":"fcfddb5c-7b28-4e81-8688-dab73980a637","Type":"ContainerStarted","Data":"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"}
Sep 07 13:07:02.849113 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:02.848842    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:02.874292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:02.874222    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" podStartSLOduration=2.08052067 podStartE2EDuration="3.874199971s" totalImagesPullingTime="1.793679301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:07:02.869884141 +0000 UTC m=+846.576667076" watchObservedRunningTime="2026-09-07 13:07:02.874199971 +0000 UTC m=+846.580982903"
Sep 07 13:07:08.861606 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:08.861573    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:07:19.682274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.682239    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:07:19.682793 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.682441    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" podUID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" containerName="maas-api" containerID="cri-o://64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d" gracePeriod=30
Sep 07 13:07:19.940001 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.939903    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:07:19.942307 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.942278    2570 generic.go:356] "Generic (PLEG): container finished" podID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" containerID="64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d" exitCode=0
Sep 07 13:07:19.942449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.942323    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"
Sep 07 13:07:19.942449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.942359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" event={"ID":"a42fd9ad-e006-46df-b69e-a96d78ac8f18","Type":"ContainerDied","Data":"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"}
Sep 07 13:07:19.942449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.942412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88" event={"ID":"a42fd9ad-e006-46df-b69e-a96d78ac8f18","Type":"ContainerDied","Data":"66313f08c6004e19741bb2122fd9a326bdd3a453e64b844f0fe559339e1a6251"}
Sep 07 13:07:19.942449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.942435    2570 scope.go:117] "RemoveContainer" containerID="64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"
Sep 07 13:07:19.954306 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.954279    2570 scope.go:117] "RemoveContainer" containerID="64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"
Sep 07 13:07:19.954658 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:19.954641    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d\": container with ID starting with 64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d not found: ID does not exist" containerID="64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"
Sep 07 13:07:19.954728 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:19.954667    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d"} err="failed to get container status \"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d\": rpc error: code = NotFound desc = could not find container \"64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d\": container with ID starting with 64657436a3486f22b595dfb778269bade624767ba3c1df590e2a84ffd045328d not found: ID does not exist"
Sep 07 13:07:20.043718 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.043681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs\") pod \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") "
Sep 07 13:07:20.043923 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.043752    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4sd\" (UniqueName: \"kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd\") pod \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") "
Sep 07 13:07:20.043923 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.043866    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") pod \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") "
Sep 07 13:07:20.043923 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.043912    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca\") pod \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\" (UID: \"a42fd9ad-e006-46df-b69e-a96d78ac8f18\") "
Sep 07 13:07:20.044524 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.044478    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a42fd9ad-e006-46df-b69e-a96d78ac8f18" (UID: "a42fd9ad-e006-46df-b69e-a96d78ac8f18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:07:20.046260 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.046229    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a42fd9ad-e006-46df-b69e-a96d78ac8f18" (UID: "a42fd9ad-e006-46df-b69e-a96d78ac8f18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:07:20.046402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.046380    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a42fd9ad-e006-46df-b69e-a96d78ac8f18" (UID: "a42fd9ad-e006-46df-b69e-a96d78ac8f18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:07:20.046468 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.046415    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd" (OuterVolumeSpecName: "kube-api-access-xz4sd") pod "a42fd9ad-e006-46df-b69e-a96d78ac8f18" (UID: "a42fd9ad-e006-46df-b69e-a96d78ac8f18"). InnerVolumeSpecName "kube-api-access-xz4sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:07:20.145472 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.145433    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:20.145472 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.145472    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a42fd9ad-e006-46df-b69e-a96d78ac8f18-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:20.145721 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.145488    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42fd9ad-e006-46df-b69e-a96d78ac8f18-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:20.145721 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.145504    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4sd\" (UniqueName: \"kubernetes.io/projected/a42fd9ad-e006-46df-b69e-a96d78ac8f18-kube-api-access-xz4sd\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:20.276419 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.276377    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:07:20.285471 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.285444    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2cd995c1-6fbdddb95d-9ld88"]
Sep 07 13:07:20.815879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:20.815843    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" path="/var/lib/kubelet/pods/a42fd9ad-e006-46df-b69e-a96d78ac8f18/volumes"
Sep 07 13:07:24.437996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.437962    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:24.438408 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.438391    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" containerName="maas-api"
Sep 07 13:07:24.438408 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.438407    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" containerName="maas-api"
Sep 07 13:07:24.438528 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.438473    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42fd9ad-e006-46df-b69e-a96d78ac8f18" containerName="maas-api"
Sep 07 13:07:24.441771 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.441737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.445008 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.444984    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c8f5c2a5-serving-cert\""
Sep 07 13:07:24.456931 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.456892    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:24.483610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.483568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.483807 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.483663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.483807 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.483704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxld\" (UniqueName: \"kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.483807 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.483756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.585314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.585247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.585535 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.585353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.585535 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.585389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxld\" (UniqueName: \"kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.585535 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.585439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.585751 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:24.585598    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-serving-cert: secret "maas-api-e2e-migrate-c8f5c2a5-serving-cert" not found
Sep 07 13:07:24.585751 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:24.585693    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls podName:6b77d2a7-5cf4-4188-91e3-d50575abfe84 nodeName:}" failed. No retries permitted until 2026-09-07 13:07:25.085672427 +0000 UTC m=+868.792455343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls") pod "maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84") : secret "maas-api-e2e-migrate-c8f5c2a5-serving-cert" not found
Sep 07 13:07:24.586182 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.586149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.588284 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.588261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:24.597212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:24.597182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxld\" (UniqueName: \"kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:25.091665 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:25.091584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:25.091856 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:25.091732    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-serving-cert: secret "maas-api-e2e-migrate-c8f5c2a5-serving-cert" not found
Sep 07 13:07:25.091856 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:25.091813    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls podName:6b77d2a7-5cf4-4188-91e3-d50575abfe84 nodeName:}" failed. No retries permitted until 2026-09-07 13:07:26.091797121 +0000 UTC m=+869.798580036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls") pod "maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84") : secret "maas-api-e2e-migrate-c8f5c2a5-serving-cert" not found
Sep 07 13:07:26.101875 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:26.101840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:26.104537 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:26.104513    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:26.257493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:26.257449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:26.541010 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:26.540980    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:26.543210 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:07:26.543177    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b77d2a7_5cf4_4188_91e3_d50575abfe84.slice/crio-66bbfc97cd20a71c245b80e76d3f5837d266be1b59f84abe3fbae38d7ca75a3f WatchSource:0}: Error finding container 66bbfc97cd20a71c245b80e76d3f5837d266be1b59f84abe3fbae38d7ca75a3f: Status 404 returned error can't find the container with id 66bbfc97cd20a71c245b80e76d3f5837d266be1b59f84abe3fbae38d7ca75a3f
Sep 07 13:07:26.991308 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:26.991262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" event={"ID":"6b77d2a7-5cf4-4188-91e3-d50575abfe84","Type":"ContainerStarted","Data":"66bbfc97cd20a71c245b80e76d3f5837d266be1b59f84abe3fbae38d7ca75a3f"}
Sep 07 13:07:27.997996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:27.997955    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" event={"ID":"6b77d2a7-5cf4-4188-91e3-d50575abfe84","Type":"ContainerStarted","Data":"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"}
Sep 07 13:07:27.998377 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:27.998031    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:28.021212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:28.021155    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" podStartSLOduration=3.6218735730000002 podStartE2EDuration="4.021137739s" totalImagesPullingTime="399.264166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:07:28.020313972 +0000 UTC m=+871.727096907" watchObservedRunningTime="2026-09-07 13:07:28.021137739 +0000 UTC m=+871.727920670"
Sep 07 13:07:34.009374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:34.009337    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:42.512832 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.512791    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:07:42.517342 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.517319    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.520460 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.520435    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-c8f26638-kserve-self-signed-certs\""
Sep 07 13:07:42.533476 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.533450    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:07:42.649122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4b7\" (UniqueName: \"kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.649122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.649395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.649395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649221    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.649395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.649395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.649325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750288 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4b7\" (UniqueName: \"kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750489 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.750986 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.751118 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.750992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.751118 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.751054    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.753276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.753257    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.753357 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.753287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.759574 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.759548    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4b7\" (UniqueName: \"kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7\") pod \"e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") " pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:42.833847 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:42.833761    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:43.111582 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:43.111555    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:07:43.113946 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:07:43.113905    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e5fed8_aa86_4a0b_ae6d_d6cbd6eb3704.slice/crio-14b4e1785e31131d3ee3c9271a9508045d9f27f21e2653d608011c7cc25846c5 WatchSource:0}: Error finding container 14b4e1785e31131d3ee3c9271a9508045d9f27f21e2653d608011c7cc25846c5: Status 404 returned error can't find the container with id 14b4e1785e31131d3ee3c9271a9508045d9f27f21e2653d608011c7cc25846c5
Sep 07 13:07:44.091092 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:44.091053    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" event={"ID":"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704","Type":"ContainerStarted","Data":"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"}
Sep 07 13:07:44.091598 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:44.091106    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" event={"ID":"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704","Type":"ContainerStarted","Data":"14b4e1785e31131d3ee3c9271a9508045d9f27f21e2653d608011c7cc25846c5"}
Sep 07 13:07:44.111268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:44.111211    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" podStartSLOduration=2.111193803 podStartE2EDuration="2.111193803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:07:44.110312492 +0000 UTC m=+887.817095425" watchObservedRunningTime="2026-09-07 13:07:44.111193803 +0000 UTC m=+887.817976734"
Sep 07 13:07:52.833944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:52.833856    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:52.833944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:52.833921    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:52.848524 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:52.848492    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:53.154703 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:53.154666    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:07:55.694161 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:55.694121    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:55.694543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:55.694354    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" podUID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" containerName="maas-api" containerID="cri-o://9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447" gracePeriod=30
Sep 07 13:07:55.947609 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:55.947543    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:56.074937 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.074905    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca\") pod \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") "
Sep 07 13:07:56.075169 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.075150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") pod \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") "
Sep 07 13:07:56.075321 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.075290    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b77d2a7-5cf4-4188-91e3-d50575abfe84" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:07:56.075834 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.075401    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlxld\" (UniqueName: \"kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld\") pod \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") "
Sep 07 13:07:56.076030 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.076013    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs\") pod \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\" (UID: \"6b77d2a7-5cf4-4188-91e3-d50575abfe84\") "
Sep 07 13:07:56.076438 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.076422    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b77d2a7-5cf4-4188-91e3-d50575abfe84-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:56.078838 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.078775    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b77d2a7-5cf4-4188-91e3-d50575abfe84" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:07:56.080303 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.080145    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld" (OuterVolumeSpecName: "kube-api-access-dlxld") pod "6b77d2a7-5cf4-4188-91e3-d50575abfe84" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84"). InnerVolumeSpecName "kube-api-access-dlxld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:07:56.080597 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.080573    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b77d2a7-5cf4-4188-91e3-d50575abfe84" (UID: "6b77d2a7-5cf4-4188-91e3-d50575abfe84"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:07:56.163086 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.163045    2570 generic.go:356] "Generic (PLEG): container finished" podID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" containerID="9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447" exitCode=0
Sep 07 13:07:56.163086 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.163085    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"
Sep 07 13:07:56.163296 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.163125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" event={"ID":"6b77d2a7-5cf4-4188-91e3-d50575abfe84","Type":"ContainerDied","Data":"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"}
Sep 07 13:07:56.163296 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.163178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t" event={"ID":"6b77d2a7-5cf4-4188-91e3-d50575abfe84","Type":"ContainerDied","Data":"66bbfc97cd20a71c245b80e76d3f5837d266be1b59f84abe3fbae38d7ca75a3f"}
Sep 07 13:07:56.163296 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.163232    2570 scope.go:117] "RemoveContainer" containerID="9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"
Sep 07 13:07:56.172841 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.172822    2570 scope.go:117] "RemoveContainer" containerID="9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"
Sep 07 13:07:56.173105 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:07:56.173083    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447\": container with ID starting with 9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447 not found: ID does not exist" containerID="9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"
Sep 07 13:07:56.173162 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.173119    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447"} err="failed to get container status \"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447\": rpc error: code = NotFound desc = could not find container \"9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447\": container with ID starting with 9b842efef95d3224bc059c801c8a6cec6ada4078a56120f347f68e6ecb7c4447 not found: ID does not exist"
Sep 07 13:07:56.177138 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.177120    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:56.177138 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.177137    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlxld\" (UniqueName: \"kubernetes.io/projected/6b77d2a7-5cf4-4188-91e3-d50575abfe84-kube-api-access-dlxld\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:56.177273 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.177147    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b77d2a7-5cf4-4188-91e3-d50575abfe84-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:07:56.188328 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.188306    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:56.198703 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.198642    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c8f5c2a5-7fc946889d-v8k8t"]
Sep 07 13:07:56.815411 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:07:56.815379    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" path="/var/lib/kubelet/pods/6b77d2a7-5cf4-4188-91e3-d50575abfe84/volumes"
Sep 07 13:08:00.196990 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.196952    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:00.197565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.197335    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" containerName="maas-api"
Sep 07 13:08:00.197565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.197347    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" containerName="maas-api"
Sep 07 13:08:00.197565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.197412    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b77d2a7-5cf4-4188-91e3-d50575abfe84" containerName="maas-api"
Sep 07 13:08:00.202339 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.202317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.205337 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.205316    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-40becd28-serving-cert\""
Sep 07 13:08:00.215663 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.215639    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:00.312992 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.312951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.313201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.313010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj7sj\" (UniqueName: \"kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.313201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.313108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.313201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.313146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.414170 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.414122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.414360 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.414185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj7sj\" (UniqueName: \"kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.414360 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.414213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.414360 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.414228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.414360 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:08:00.414285    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-serving-cert: secret "maas-api-e2e-ait-40becd28-serving-cert" not found
Sep 07 13:08:00.414360 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:08:00.414357    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls podName:1169d48a-6330-4bd9-beee-c6b6b58af0ec nodeName:}" failed. No retries permitted until 2026-09-07 13:08:00.914335777 +0000 UTC m=+904.621118687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls") pod "maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" (UID: "1169d48a-6330-4bd9-beee-c6b6b58af0ec") : secret "maas-api-e2e-ait-40becd28-serving-cert" not found
Sep 07 13:08:00.414998 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.414979    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.416719 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.416699    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.424536 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.424512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj7sj\" (UniqueName: \"kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.919238 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.919204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:00.921636 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:00.921599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") pod \"maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:01.116230 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:01.116115    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:01.411116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:01.411091    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:01.413482 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:08:01.413436    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1169d48a_6330_4bd9_beee_c6b6b58af0ec.slice/crio-c5fc704a47db6653b8643096c8d9945856aac806f5af1ca5a66a3c9f621f7042 WatchSource:0}: Error finding container c5fc704a47db6653b8643096c8d9945856aac806f5af1ca5a66a3c9f621f7042: Status 404 returned error can't find the container with id c5fc704a47db6653b8643096c8d9945856aac806f5af1ca5a66a3c9f621f7042
Sep 07 13:08:02.202195 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:02.202160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" event={"ID":"1169d48a-6330-4bd9-beee-c6b6b58af0ec","Type":"ContainerStarted","Data":"a29eee4f0655b7dd564ffddd6789eb759b84211179eace3954df79cc9c39b5e6"}
Sep 07 13:08:02.202402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:02.202214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" event={"ID":"1169d48a-6330-4bd9-beee-c6b6b58af0ec","Type":"ContainerStarted","Data":"c5fc704a47db6653b8643096c8d9945856aac806f5af1ca5a66a3c9f621f7042"}
Sep 07 13:08:02.202402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:02.202299    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:02.230216 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:02.230159    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" podStartSLOduration=1.837438847 podStartE2EDuration="2.230139085s" totalImagesPullingTime="392.700238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:08:02.229806475 +0000 UTC m=+905.936589407" watchObservedRunningTime="2026-09-07 13:08:02.230139085 +0000 UTC m=+905.936922017"
Sep 07 13:08:08.213204 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:08.213172    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:28.660562 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:28.660521    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:08:32.832528 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:32.832491    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:08:32.833043 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:32.832769    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" podUID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" containerName="maas-api" containerID="cri-o://95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9" gracePeriod=30
Sep 07 13:08:33.095144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.095067    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:08:33.222394 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222365    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca\") pod \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") "
Sep 07 13:08:33.222605 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222422    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kxmr\" (UniqueName: \"kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr\") pod \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") "
Sep 07 13:08:33.222605 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222534    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs\") pod \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") "
Sep 07 13:08:33.222605 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222576    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls\") pod \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\" (UID: \"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d\") "
Sep 07 13:08:33.222818 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222774    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" (UID: "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:08:33.222920 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.222902    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:33.224722 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.224689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" (UID: "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:08:33.224846 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.224766    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr" (OuterVolumeSpecName: "kube-api-access-2kxmr") pod "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" (UID: "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d"). InnerVolumeSpecName "kube-api-access-2kxmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:08:33.225033 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.225017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" (UID: "eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:08:33.324258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.324220    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kxmr\" (UniqueName: \"kubernetes.io/projected/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-kube-api-access-2kxmr\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:33.324258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.324260    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:33.324463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.324275    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:33.381139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.381052    2570 generic.go:356] "Generic (PLEG): container finished" podID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" containerID="95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9" exitCode=0
Sep 07 13:08:33.381139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.381098    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"
Sep 07 13:08:33.381374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.381138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" event={"ID":"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d","Type":"ContainerDied","Data":"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"}
Sep 07 13:08:33.381374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.381198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq" event={"ID":"eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d","Type":"ContainerDied","Data":"7ce433bf69a55044034d3957b3e7809f89f44e28c496b017bfed7c4f62f5add3"}
Sep 07 13:08:33.381374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.381227    2570 scope.go:117] "RemoveContainer" containerID="95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"
Sep 07 13:08:33.392483 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.392461    2570 scope.go:117] "RemoveContainer" containerID="95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"
Sep 07 13:08:33.392836 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:08:33.392809    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9\": container with ID starting with 95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9 not found: ID does not exist" containerID="95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"
Sep 07 13:08:33.392897 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.392852    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9"} err="failed to get container status \"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9\": rpc error: code = NotFound desc = could not find container \"95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9\": container with ID starting with 95005c30b2f164d6b5ee618fbfeeb20a985077b6e6929ad36628e8bf9426c7a9 not found: ID does not exist"
Sep 07 13:08:33.408071 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.408038    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:08:33.416382 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:33.416352    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-e9d55a-6578f474b8-wcvrq"]
Sep 07 13:08:34.815769 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:34.815737    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" path="/var/lib/kubelet/pods/eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d/volumes"
Sep 07 13:08:41.236943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.236909    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:41.237347 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.237118    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" podUID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" containerName="maas-api" containerID="cri-o://a29eee4f0655b7dd564ffddd6789eb759b84211179eace3954df79cc9c39b5e6" gracePeriod=30
Sep 07 13:08:41.430894 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.430861    2570 generic.go:356] "Generic (PLEG): container finished" podID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" containerID="a29eee4f0655b7dd564ffddd6789eb759b84211179eace3954df79cc9c39b5e6" exitCode=0
Sep 07 13:08:41.431058 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.430925    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" event={"ID":"1169d48a-6330-4bd9-beee-c6b6b58af0ec","Type":"ContainerDied","Data":"a29eee4f0655b7dd564ffddd6789eb759b84211179eace3954df79cc9c39b5e6"}
Sep 07 13:08:41.486180 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.486153    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:41.608217 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.608121    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca\") pod \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") "
Sep 07 13:08:41.608217 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.608177    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs\") pod \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") "
Sep 07 13:08:41.608217 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.608210    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj7sj\" (UniqueName: \"kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj\") pod \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") "
Sep 07 13:08:41.608450 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.608285    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") pod \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\" (UID: \"1169d48a-6330-4bd9-beee-c6b6b58af0ec\") "
Sep 07 13:08:41.608588 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.608561    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1169d48a-6330-4bd9-beee-c6b6b58af0ec" (UID: "1169d48a-6330-4bd9-beee-c6b6b58af0ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:08:41.610499 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.610465    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1169d48a-6330-4bd9-beee-c6b6b58af0ec" (UID: "1169d48a-6330-4bd9-beee-c6b6b58af0ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:08:41.610499 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.610481    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1169d48a-6330-4bd9-beee-c6b6b58af0ec" (UID: "1169d48a-6330-4bd9-beee-c6b6b58af0ec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:08:41.610705 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.610545    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj" (OuterVolumeSpecName: "kube-api-access-tj7sj") pod "1169d48a-6330-4bd9-beee-c6b6b58af0ec" (UID: "1169d48a-6330-4bd9-beee-c6b6b58af0ec"). InnerVolumeSpecName "kube-api-access-tj7sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:08:41.709099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.709068    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1169d48a-6330-4bd9-beee-c6b6b58af0ec-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:41.709099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.709096    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:41.709099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.709107    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj7sj\" (UniqueName: \"kubernetes.io/projected/1169d48a-6330-4bd9-beee-c6b6b58af0ec-kube-api-access-tj7sj\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:41.709330 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:41.709116    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1169d48a-6330-4bd9-beee-c6b6b58af0ec-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:42.438511 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.438481    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"
Sep 07 13:08:42.438956 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.438507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f" event={"ID":"1169d48a-6330-4bd9-beee-c6b6b58af0ec","Type":"ContainerDied","Data":"c5fc704a47db6653b8643096c8d9945856aac806f5af1ca5a66a3c9f621f7042"}
Sep 07 13:08:42.438956 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.438579    2570 scope.go:117] "RemoveContainer" containerID="a29eee4f0655b7dd564ffddd6789eb759b84211179eace3954df79cc9c39b5e6"
Sep 07 13:08:42.463404 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.463371    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:42.475139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.472611    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-40becd28-74bc76b44d-hwq5f"]
Sep 07 13:08:42.815036 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:42.814956    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" path="/var/lib/kubelet/pods/1169d48a-6330-4bd9-beee-c6b6b58af0ec/volumes"
Sep 07 13:08:43.681341 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:43.681267    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" podUID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" containerName="main" containerID="cri-o://2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e" gracePeriod=45
Sep 07 13:08:43.943326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:43.943254    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:08:44.129458 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129458 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129466    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129701 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129541    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk4b7\" (UniqueName: \"kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129701 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129717    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129743    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs\") pod \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\" (UID: \"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704\") "
Sep 07 13:08:44.129797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129747    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home" (OuterVolumeSpecName: "home") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:08:44.129797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129762    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:08:44.130013 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129939    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache" (OuterVolumeSpecName: "model-cache") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:08:44.130013 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129974    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.130013 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.129988    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.131896 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.131866    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm" (OuterVolumeSpecName: "dshm") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:08:44.131896 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.131882    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:08:44.132032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.131895    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7" (OuterVolumeSpecName: "kube-api-access-tk4b7") pod "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" (UID: "08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704"). InnerVolumeSpecName "kube-api-access-tk4b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:08:44.231122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.231028    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.231122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.231061    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.231122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.231071    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.231122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.231081    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk4b7\" (UniqueName: \"kubernetes.io/projected/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704-kube-api-access-tk4b7\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:08:44.453835 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.453796    2570 generic.go:356] "Generic (PLEG): container finished" podID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" containerID="2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e" exitCode=0
Sep 07 13:08:44.453835 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.453842    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"
Sep 07 13:08:44.454116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.453883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" event={"ID":"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704","Type":"ContainerDied","Data":"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"}
Sep 07 13:08:44.454116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.453938    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8" event={"ID":"08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704","Type":"ContainerDied","Data":"14b4e1785e31131d3ee3c9271a9508045d9f27f21e2653d608011c7cc25846c5"}
Sep 07 13:08:44.454116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.453961    2570 scope.go:117] "RemoveContainer" containerID="2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"
Sep 07 13:08:44.464003 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.463982    2570 scope.go:117] "RemoveContainer" containerID="2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"
Sep 07 13:08:44.464315 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:08:44.464294    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e\": container with ID starting with 2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e not found: ID does not exist" containerID="2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"
Sep 07 13:08:44.464361 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.464324    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e"} err="failed to get container status \"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e\": rpc error: code = NotFound desc = could not find container \"2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e\": container with ID starting with 2ff4207b6dcdbb962d8759c0060ac402ef35514e49aaa7f401cc157943c6609e not found: ID does not exist"
Sep 07 13:08:44.477701 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.477668    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:08:44.484673 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.484588    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-c8f26638-kserve-5f69cb5fcf-ps6j8"]
Sep 07 13:08:44.815698 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:44.815590    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" path="/var/lib/kubelet/pods/08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704/volumes"
Sep 07 13:08:47.556323 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556284    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:08:47.556808 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556790    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" containerName="maas-api"
Sep 07 13:08:47.556808 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556808    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" containerName="maas-api"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556822    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" containerName="main"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556827    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" containerName="main"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556847    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" containerName="maas-api"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556853    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" containerName="maas-api"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556908    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="08e5fed8-aa86-4a0b-ae6d-d6cbd6eb3704" containerName="main"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556918    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1169d48a-6330-4bd9-beee-c6b6b58af0ec" containerName="maas-api"
Sep 07 13:08:47.556944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.556926    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9fb22c-d5e8-4326-8d4f-741d7e3fba4d" containerName="maas-api"
Sep 07 13:08:47.561252 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.561222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.563839 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.563805    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-42173418-serving-cert\""
Sep 07 13:08:47.580656 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.580612    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:08:47.660898 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.660851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.661111 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.660926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.661111 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.660989    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.661111 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.661013    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jf76\" (UniqueName: \"kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.761995 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.761957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.762178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.762006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.762178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.762068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.762178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.762093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jf76\" (UniqueName: \"kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.762595 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.762570    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.764749 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.764726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.764834 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.764733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.771363 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.771339    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jf76\" (UniqueName: \"kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76\") pod \"maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:47.872574 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:47.872477    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:48.156075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:48.156049    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:08:48.158164 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:08:48.158138    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841a9f96_3975_4fc1_a2bc_7d669fa9fcb3.slice/crio-ef66b9a7dd4e0dc9a85395a9e7326e031b206c7c62ce9a6cedceffc60d460a38 WatchSource:0}: Error finding container ef66b9a7dd4e0dc9a85395a9e7326e031b206c7c62ce9a6cedceffc60d460a38: Status 404 returned error can't find the container with id ef66b9a7dd4e0dc9a85395a9e7326e031b206c7c62ce9a6cedceffc60d460a38
Sep 07 13:08:48.159453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:48.159436    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:08:48.477226 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:48.477139    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" event={"ID":"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3","Type":"ContainerStarted","Data":"ef66b9a7dd4e0dc9a85395a9e7326e031b206c7c62ce9a6cedceffc60d460a38"}
Sep 07 13:08:49.484360 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:49.484323    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" event={"ID":"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3","Type":"ContainerStarted","Data":"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"}
Sep 07 13:08:49.484769 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:49.484444    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:08:49.503979 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:49.503930    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" podStartSLOduration=2.016520892 podStartE2EDuration="2.50391304s" totalImagesPullingTime="487.392148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:08:49.503002363 +0000 UTC m=+953.209785294" watchObservedRunningTime="2026-09-07 13:08:49.50391304 +0000 UTC m=+953.210695970"
Sep 07 13:08:55.495091 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:08:55.495059    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:09:07.323606 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.323569    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:09:07.328644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.328592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.331246 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.331223    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-02ea24-serving-cert\""
Sep 07 13:09:07.338281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.338256    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:09:07.422648 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.422548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtprb\" (UniqueName: \"kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.422648 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.422633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.422936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.422686    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.422936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.422834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.523881 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.523833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.524070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.523892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.524070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.523961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.524070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.523992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtprb\" (UniqueName: \"kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.524616 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.524592    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.526388 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.526364    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.526484 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.526400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.538660 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.538611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtprb\" (UniqueName: \"kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb\") pod \"maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.640580 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.640494    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:07.928929 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:07.928903    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:09:07.931238 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:09:07.931205    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dbf16b_d835_45e7_9689_fad1b0741acb.slice/crio-1687b3d848a8c3d146653e74cb1565c434c50aa823e70514543eb361dc5246cb WatchSource:0}: Error finding container 1687b3d848a8c3d146653e74cb1565c434c50aa823e70514543eb361dc5246cb: Status 404 returned error can't find the container with id 1687b3d848a8c3d146653e74cb1565c434c50aa823e70514543eb361dc5246cb
Sep 07 13:09:08.588103 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:08.588012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" event={"ID":"38dbf16b-d835-45e7-9689-fad1b0741acb","Type":"ContainerStarted","Data":"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"}
Sep 07 13:09:08.588103 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:08.588066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" event={"ID":"38dbf16b-d835-45e7-9689-fad1b0741acb","Type":"ContainerStarted","Data":"1687b3d848a8c3d146653e74cb1565c434c50aa823e70514543eb361dc5246cb"}
Sep 07 13:09:08.588103 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:08.588088    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:08.608338 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:08.608284    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" podStartSLOduration=1.250278057 podStartE2EDuration="1.608267497s" totalImagesPullingTime="357.98944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:09:08.60784843 +0000 UTC m=+972.314631362" watchObservedRunningTime="2026-09-07 13:09:08.608267497 +0000 UTC m=+972.315050428"
Sep 07 13:09:14.600048 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:14.600018    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:09:18.156159 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.156121    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:09:18.156759 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.156373    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" podUID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" containerName="maas-api" containerID="cri-o://4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f" gracePeriod=30
Sep 07 13:09:18.424327 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.424302    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:09:18.525564 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.525524    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jf76\" (UniqueName: \"kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76\") pod \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") "
Sep 07 13:09:18.525777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.525577    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs\") pod \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") "
Sep 07 13:09:18.525777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.525629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls\") pod \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") "
Sep 07 13:09:18.525777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.525669    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca\") pod \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\" (UID: \"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3\") "
Sep 07 13:09:18.526265 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.526234    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" (UID: "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:09:18.528234 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.528204    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76" (OuterVolumeSpecName: "kube-api-access-5jf76") pod "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" (UID: "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3"). InnerVolumeSpecName "kube-api-access-5jf76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:09:18.528347 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.528213    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" (UID: "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:09:18.528417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.528375    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" (UID: "841a9f96-3975-4fc1-a2bc-7d669fa9fcb3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:09:18.626789 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.626756    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jf76\" (UniqueName: \"kubernetes.io/projected/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-kube-api-access-5jf76\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:09:18.626789 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.626783    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:09:18.626789 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.626794    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:09:18.627026 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.626803    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:09:18.645296 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.645258    2570 generic.go:356] "Generic (PLEG): container finished" podID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" containerID="4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f" exitCode=0
Sep 07 13:09:18.645490 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.645329    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"
Sep 07 13:09:18.645490 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.645343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" event={"ID":"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3","Type":"ContainerDied","Data":"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"}
Sep 07 13:09:18.645490 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.645416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn" event={"ID":"841a9f96-3975-4fc1-a2bc-7d669fa9fcb3","Type":"ContainerDied","Data":"ef66b9a7dd4e0dc9a85395a9e7326e031b206c7c62ce9a6cedceffc60d460a38"}
Sep 07 13:09:18.645490 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.645448    2570 scope.go:117] "RemoveContainer" containerID="4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"
Sep 07 13:09:18.656210 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.656187    2570 scope.go:117] "RemoveContainer" containerID="4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"
Sep 07 13:09:18.656536 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:09:18.656515    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f\": container with ID starting with 4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f not found: ID does not exist" containerID="4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"
Sep 07 13:09:18.656607 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.656549    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f"} err="failed to get container status \"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f\": rpc error: code = NotFound desc = could not find container \"4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f\": container with ID starting with 4bd93c54961d275984881ce3c9f56335d415cfa31e1e8d0e56e6dcd26dc6066f not found: ID does not exist"
Sep 07 13:09:18.670453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.670377    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:09:18.680530 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.675678    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-42173418-5787c7c8d7-f6vpn"]
Sep 07 13:09:18.815138 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:18.815103    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" path="/var/lib/kubelet/pods/841a9f96-3975-4fc1-a2bc-7d669fa9fcb3/volumes"
Sep 07 13:09:50.505505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.505463    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:09:50.506003 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.505920    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" containerName="maas-api"
Sep 07 13:09:50.506003 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.505934    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" containerName="maas-api"
Sep 07 13:09:50.506076 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.506019    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="841a9f96-3975-4fc1-a2bc-7d669fa9fcb3" containerName="maas-api"
Sep 07 13:09:50.509419 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.509399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.512392 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.512363    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-02ea24\"/\"kube-root-ca.crt\""
Sep 07 13:09:50.512555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.512419    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-02ea24\"/\"openshift-service-ca.crt\""
Sep 07 13:09:50.513582 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.513561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-02ea24\"/\"default-dockercfg-nmzzs\""
Sep 07 13:09:50.513722 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.513602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-02ea24\"/\"explicit-model-02ea24-kserve-self-signed-certs\""
Sep 07 13:09:50.522068 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.522040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:09:50.617752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.617752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.618000 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.618000 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph484\" (UniqueName: \"kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.618000 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.618000 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.617983    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719477 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph484\" (UniqueName: \"kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.719706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.719600    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.720041 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.720017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.720116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.720088    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.720116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.720108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.722028 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.722005    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.722198 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.722180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.728512 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.728483    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph484\" (UniqueName: \"kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484\") pod \"explicit-model-02ea24-kserve-5857cf745c-cv4zg\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") " pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:50.819550 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:50.819455    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:09:51.096590 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:51.096560    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:09:51.098806 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:09:51.098777    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b808563_cf91_4fff_a94f_5afb0865fdd9.slice/crio-18f6b4a4d19b9942634778c1ee7a0402dfaaf5cf7b1192b88b43a7a290e5a951 WatchSource:0}: Error finding container 18f6b4a4d19b9942634778c1ee7a0402dfaaf5cf7b1192b88b43a7a290e5a951: Status 404 returned error can't find the container with id 18f6b4a4d19b9942634778c1ee7a0402dfaaf5cf7b1192b88b43a7a290e5a951
Sep 07 13:09:51.831235 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:51.831197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" event={"ID":"0b808563-cf91-4fff-a94f-5afb0865fdd9","Type":"ContainerStarted","Data":"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"}
Sep 07 13:09:51.831669 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:51.831254    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" event={"ID":"0b808563-cf91-4fff-a94f-5afb0865fdd9","Type":"ContainerStarted","Data":"18f6b4a4d19b9942634778c1ee7a0402dfaaf5cf7b1192b88b43a7a290e5a951"}
Sep 07 13:09:51.850498 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:51.850435    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" podStartSLOduration=1.850415551 podStartE2EDuration="1.850415551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:09:51.850074039 +0000 UTC m=+1015.556856971" watchObservedRunningTime="2026-09-07 13:09:51.850415551 +0000 UTC m=+1015.557198486"
Sep 07 13:09:53.385999 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:09:53.385962    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:10:00.820585 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:00.820558    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:10:04.197275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.197237    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:10:04.197782 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.197572    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" podUID="38dbf16b-d835-45e7-9689-fad1b0741acb" containerName="maas-api" containerID="cri-o://1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976" gracePeriod=30
Sep 07 13:10:04.453990 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.453914    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:10:04.542105 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.542073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtprb\" (UniqueName: \"kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb\") pod \"38dbf16b-d835-45e7-9689-fad1b0741acb\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") "
Sep 07 13:10:04.542275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.542114    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca\") pod \"38dbf16b-d835-45e7-9689-fad1b0741acb\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") "
Sep 07 13:10:04.542275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.542154    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs\") pod \"38dbf16b-d835-45e7-9689-fad1b0741acb\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") "
Sep 07 13:10:04.542275 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.542195    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls\") pod \"38dbf16b-d835-45e7-9689-fad1b0741acb\" (UID: \"38dbf16b-d835-45e7-9689-fad1b0741acb\") "
Sep 07 13:10:04.542520 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.542491    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38dbf16b-d835-45e7-9689-fad1b0741acb" (UID: "38dbf16b-d835-45e7-9689-fad1b0741acb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:10:04.545753 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.545723    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb" (OuterVolumeSpecName: "kube-api-access-xtprb") pod "38dbf16b-d835-45e7-9689-fad1b0741acb" (UID: "38dbf16b-d835-45e7-9689-fad1b0741acb"). InnerVolumeSpecName "kube-api-access-xtprb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:10:04.545850 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.545746    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38dbf16b-d835-45e7-9689-fad1b0741acb" (UID: "38dbf16b-d835-45e7-9689-fad1b0741acb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:04.545850 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.545730    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "38dbf16b-d835-45e7-9689-fad1b0741acb" (UID: "38dbf16b-d835-45e7-9689-fad1b0741acb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:04.643731 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.643694    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtprb\" (UniqueName: \"kubernetes.io/projected/38dbf16b-d835-45e7-9689-fad1b0741acb-kube-api-access-xtprb\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:04.643731 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.643727    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbf16b-d835-45e7-9689-fad1b0741acb-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:04.643946 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.643742    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:04.643946 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.643755    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbf16b-d835-45e7-9689-fad1b0741acb-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:04.905871 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.905833    2570 generic.go:356] "Generic (PLEG): container finished" podID="38dbf16b-d835-45e7-9689-fad1b0741acb" containerID="1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976" exitCode=0
Sep 07 13:10:04.906056 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.905881    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"
Sep 07 13:10:04.906056 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.905923    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" event={"ID":"38dbf16b-d835-45e7-9689-fad1b0741acb","Type":"ContainerDied","Data":"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"}
Sep 07 13:10:04.906056 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.905990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8" event={"ID":"38dbf16b-d835-45e7-9689-fad1b0741acb","Type":"ContainerDied","Data":"1687b3d848a8c3d146653e74cb1565c434c50aa823e70514543eb361dc5246cb"}
Sep 07 13:10:04.906056 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.906021    2570 scope.go:117] "RemoveContainer" containerID="1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"
Sep 07 13:10:04.915292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.915272    2570 scope.go:117] "RemoveContainer" containerID="1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"
Sep 07 13:10:04.915593 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:10:04.915570    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976\": container with ID starting with 1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976 not found: ID does not exist" containerID="1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"
Sep 07 13:10:04.915665 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.915609    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976"} err="failed to get container status \"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976\": rpc error: code = NotFound desc = could not find container \"1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976\": container with ID starting with 1bbb2d6806a9ad82c925384c71dec3143788ad50ede8d0462c351a1e7e6d7976 not found: ID does not exist"
Sep 07 13:10:04.927470 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.927442    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:10:04.932612 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:04.932586    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-02ea24-86884b95cd-j4dm8"]
Sep 07 13:10:06.816554 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:06.816510    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38dbf16b-d835-45e7-9689-fad1b0741acb" path="/var/lib/kubelet/pods/38dbf16b-d835-45e7-9689-fad1b0741acb/volumes"
Sep 07 13:10:08.864775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:08.864737    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" podUID="0b808563-cf91-4fff-a94f-5afb0865fdd9" containerName="main" containerID="cri-o://07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39" gracePeriod=45
Sep 07 13:10:09.113450 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.113422    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:10:09.182726 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182695    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.182895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182802    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.182895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182824    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.182895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182861    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.182895 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182886    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.183082 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182926    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph484\" (UniqueName: \"kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484\") pod \"0b808563-cf91-4fff-a94f-5afb0865fdd9\" (UID: \"0b808563-cf91-4fff-a94f-5afb0865fdd9\") "
Sep 07 13:10:09.183082 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.182939    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:09.183196 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.183096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:09.183254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.183209    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.183254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.183208    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home" (OuterVolumeSpecName: "home") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:09.183254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.183224    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.185200 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.185164    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm" (OuterVolumeSpecName: "dshm") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:09.185334 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.185272    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:09.185334 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.185287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484" (OuterVolumeSpecName: "kube-api-access-ph484") pod "0b808563-cf91-4fff-a94f-5afb0865fdd9" (UID: "0b808563-cf91-4fff-a94f-5afb0865fdd9"). InnerVolumeSpecName "kube-api-access-ph484". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:10:09.283675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.283602    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.283675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.283666    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b808563-cf91-4fff-a94f-5afb0865fdd9-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.283675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.283676    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b808563-cf91-4fff-a94f-5afb0865fdd9-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.283675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.283685    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph484\" (UniqueName: \"kubernetes.io/projected/0b808563-cf91-4fff-a94f-5afb0865fdd9-kube-api-access-ph484\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:09.940665 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.940604    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b808563-cf91-4fff-a94f-5afb0865fdd9" containerID="07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39" exitCode=0
Sep 07 13:10:09.940665 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.940666    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"
Sep 07 13:10:09.941194 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.940694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" event={"ID":"0b808563-cf91-4fff-a94f-5afb0865fdd9","Type":"ContainerDied","Data":"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"}
Sep 07 13:10:09.941194 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.940752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg" event={"ID":"0b808563-cf91-4fff-a94f-5afb0865fdd9","Type":"ContainerDied","Data":"18f6b4a4d19b9942634778c1ee7a0402dfaaf5cf7b1192b88b43a7a290e5a951"}
Sep 07 13:10:09.941194 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.940781    2570 scope.go:117] "RemoveContainer" containerID="07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"
Sep 07 13:10:09.951646 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.951607    2570 scope.go:117] "RemoveContainer" containerID="07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"
Sep 07 13:10:09.951969 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:10:09.951945    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39\": container with ID starting with 07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39 not found: ID does not exist" containerID="07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"
Sep 07 13:10:09.952034 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.951983    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39"} err="failed to get container status \"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39\": rpc error: code = NotFound desc = could not find container \"07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39\": container with ID starting with 07dff9cfbdeec795d1c360268455e1126ff6654d89b3226d427e77c72de8cd39 not found: ID does not exist"
Sep 07 13:10:09.967730 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.967674    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:10:09.969806 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:09.969783    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-02ea24/explicit-model-02ea24-kserve-5857cf745c-cv4zg"]
Sep 07 13:10:10.814858 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:10.814823    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b808563-cf91-4fff-a94f-5afb0865fdd9" path="/var/lib/kubelet/pods/0b808563-cf91-4fff-a94f-5afb0865fdd9/volumes"
Sep 07 13:10:25.507492 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507454    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:25.507917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507844    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dbf16b-d835-45e7-9689-fad1b0741acb" containerName="maas-api"
Sep 07 13:10:25.507917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507857    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dbf16b-d835-45e7-9689-fad1b0741acb" containerName="maas-api"
Sep 07 13:10:25.507917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507876    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b808563-cf91-4fff-a94f-5afb0865fdd9" containerName="main"
Sep 07 13:10:25.507917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507882    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b808563-cf91-4fff-a94f-5afb0865fdd9" containerName="main"
Sep 07 13:10:25.508053 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507938    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38dbf16b-d835-45e7-9689-fad1b0741acb" containerName="maas-api"
Sep 07 13:10:25.508053 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.507948    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b808563-cf91-4fff-a94f-5afb0865fdd9" containerName="main"
Sep 07 13:10:25.511011 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.510991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.513983 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.513955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3777f2\"/\"kube-root-ca.crt\""
Sep 07 13:10:25.514147 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.513998    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3777f2\"/\"default-dockercfg-5m9jp\""
Sep 07 13:10:25.515378 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.515358    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3777f2\"/\"openshift-service-ca.crt\""
Sep 07 13:10:25.515485 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.515469    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3777f2\"/\"noten-model-3777f2-kserve-self-signed-certs\""
Sep 07 13:10:25.524005 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.523980    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:25.625236 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.625442 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.625442 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.625442 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.625442 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qrh\" (UniqueName: \"kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.625671 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.625467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726354 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qrh\" (UniqueName: \"kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726906 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.726906 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.726896    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.727026 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.727007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.728918 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.728893    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.729084 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.729064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.736311 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.736285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qrh\" (UniqueName: \"kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh\") pod \"noten-model-3777f2-kserve-775d4d8d7f-jl8qc\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") " pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:25.820474 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:25.820384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:26.104686 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:26.103884    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:27.052054 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:27.052014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" event={"ID":"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f","Type":"ContainerStarted","Data":"e24c099417e9923cd6c192e37d9d94e74a1c6573b3867378bd20c4b224913a30"}
Sep 07 13:10:27.052548 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:27.052072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" event={"ID":"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f","Type":"ContainerStarted","Data":"d80617a0fcf1ae236c9c15311cc56b6ae63f539900f0efaa45b9249155706da7"}
Sep 07 13:10:27.079037 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:27.078968    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" podStartSLOduration=2.078951284 podStartE2EDuration="2.078951284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:10:27.07807769 +0000 UTC m=+1050.784860622" watchObservedRunningTime="2026-09-07 13:10:27.078951284 +0000 UTC m=+1050.785734215"
Sep 07 13:10:30.998276 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:30.998241    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:35.821125 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:35.821087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:46.018383 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.018334    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" podUID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" containerName="main" containerID="cri-o://e24c099417e9923cd6c192e37d9d94e74a1c6573b3867378bd20c4b224913a30" gracePeriod=45
Sep 07 13:10:46.154955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.154912    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" containerID="e24c099417e9923cd6c192e37d9d94e74a1c6573b3867378bd20c4b224913a30" exitCode=0
Sep 07 13:10:46.155139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.154987    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" event={"ID":"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f","Type":"ContainerDied","Data":"e24c099417e9923cd6c192e37d9d94e74a1c6573b3867378bd20c4b224913a30"}
Sep 07 13:10:46.285177 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.285152    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:46.296453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296426    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296455    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296711 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296476    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2qrh\" (UniqueName: \"kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296711 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296500    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296711 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296711 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296662    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache\") pod \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\" (UID: \"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f\") "
Sep 07 13:10:46.296922 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.296792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:46.297035 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.297011    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:46.297092 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.297019    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.297205 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.297169    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home" (OuterVolumeSpecName: "home") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:46.299042 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.299013    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm" (OuterVolumeSpecName: "dshm") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:10:46.299167 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.299112    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh" (OuterVolumeSpecName: "kube-api-access-s2qrh") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "kube-api-access-s2qrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:10:46.299167 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.299152    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" (UID: "1e2a35ca-18e3-4c2d-b52c-527a3a766f8f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:46.398107 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.398069    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.398107 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.398097    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.398107 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.398109    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.398107 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.398117    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2qrh\" (UniqueName: \"kubernetes.io/projected/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-kube-api-access-s2qrh\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.398380 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.398126    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:46.687870 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.687836    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:10:46.688096 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.688063    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" podUID="0b2da18f-1a28-4b58-903b-7506703987fb" containerName="maas-api" containerID="cri-o://5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d" gracePeriod=30
Sep 07 13:10:46.947615 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:46.947584    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:10:47.003201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.003159    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca\") pod \"0b2da18f-1a28-4b58-903b-7506703987fb\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") "
Sep 07 13:10:47.003201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.003201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls\") pod \"0b2da18f-1a28-4b58-903b-7506703987fb\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") "
Sep 07 13:10:47.003463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.003228    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt44n\" (UniqueName: \"kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n\") pod \"0b2da18f-1a28-4b58-903b-7506703987fb\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") "
Sep 07 13:10:47.003463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.003257    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs\") pod \"0b2da18f-1a28-4b58-903b-7506703987fb\" (UID: \"0b2da18f-1a28-4b58-903b-7506703987fb\") "
Sep 07 13:10:47.003577 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.003527    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b2da18f-1a28-4b58-903b-7506703987fb" (UID: "0b2da18f-1a28-4b58-903b-7506703987fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:10:47.005468 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.005433    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0b2da18f-1a28-4b58-903b-7506703987fb" (UID: "0b2da18f-1a28-4b58-903b-7506703987fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:47.005592 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.005467    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b2da18f-1a28-4b58-903b-7506703987fb" (UID: "0b2da18f-1a28-4b58-903b-7506703987fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:10:47.005592 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.005474    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n" (OuterVolumeSpecName: "kube-api-access-tt44n") pod "0b2da18f-1a28-4b58-903b-7506703987fb" (UID: "0b2da18f-1a28-4b58-903b-7506703987fb"). InnerVolumeSpecName "kube-api-access-tt44n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:10:47.105081 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.105034    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:47.105081 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.105079    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b2da18f-1a28-4b58-903b-7506703987fb-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:47.105496 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.105096    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b2da18f-1a28-4b58-903b-7506703987fb-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:47.105496 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.105110    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt44n\" (UniqueName: \"kubernetes.io/projected/0b2da18f-1a28-4b58-903b-7506703987fb-kube-api-access-tt44n\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:10:47.161573 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.161541    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"
Sep 07 13:10:47.161772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.161565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc" event={"ID":"1e2a35ca-18e3-4c2d-b52c-527a3a766f8f","Type":"ContainerDied","Data":"d80617a0fcf1ae236c9c15311cc56b6ae63f539900f0efaa45b9249155706da7"}
Sep 07 13:10:47.161772 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.161650    2570 scope.go:117] "RemoveContainer" containerID="e24c099417e9923cd6c192e37d9d94e74a1c6573b3867378bd20c4b224913a30"
Sep 07 13:10:47.163062 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.163041    2570 generic.go:356] "Generic (PLEG): container finished" podID="0b2da18f-1a28-4b58-903b-7506703987fb" containerID="5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d" exitCode=0
Sep 07 13:10:47.163151 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.163082    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"
Sep 07 13:10:47.163151 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.163126    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" event={"ID":"0b2da18f-1a28-4b58-903b-7506703987fb","Type":"ContainerDied","Data":"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"}
Sep 07 13:10:47.163251 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.163173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn" event={"ID":"0b2da18f-1a28-4b58-903b-7506703987fb","Type":"ContainerDied","Data":"f487957bb960e73066246c8d32c9089f1da05fa049806803fb405331b2e888d2"}
Sep 07 13:10:47.172612 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.172591    2570 scope.go:117] "RemoveContainer" containerID="5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"
Sep 07 13:10:47.181373 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.181357    2570 scope.go:117] "RemoveContainer" containerID="5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"
Sep 07 13:10:47.181725 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:10:47.181701    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d\": container with ID starting with 5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d not found: ID does not exist" containerID="5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"
Sep 07 13:10:47.181788 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.181735    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d"} err="failed to get container status \"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d\": rpc error: code = NotFound desc = could not find container \"5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d\": container with ID starting with 5b5adf9d664d69696426e30c70f2656e0db1d8b7dff0b44a99c2adb10092ff0d not found: ID does not exist"
Sep 07 13:10:47.183030 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.183012    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:47.187988 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.187933    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-3777f2/noten-model-3777f2-kserve-775d4d8d7f-jl8qc"]
Sep 07 13:10:47.207648 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.207602    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:10:47.211193 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:47.211172    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7ce94d-57df7dd57f-tv8cn"]
Sep 07 13:10:48.815003 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:48.814969    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2da18f-1a28-4b58-903b-7506703987fb" path="/var/lib/kubelet/pods/0b2da18f-1a28-4b58-903b-7506703987fb/volumes"
Sep 07 13:10:48.815386 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:10:48.815356    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" path="/var/lib/kubelet/pods/1e2a35ca-18e3-4c2d-b52c-527a3a766f8f/volumes"
Sep 07 13:11:04.895866 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.895816    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896370    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2da18f-1a28-4b58-903b-7506703987fb" containerName="maas-api"
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896395    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2da18f-1a28-4b58-903b-7506703987fb" containerName="maas-api"
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896405    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" containerName="main"
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896411    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" containerName="main"
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896478    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2a35ca-18e3-4c2d-b52c-527a3a766f8f" containerName="main"
Sep 07 13:11:04.896645 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.896493    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2da18f-1a28-4b58-903b-7506703987fb" containerName="maas-api"
Sep 07 13:11:04.901459 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.901424    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:04.905274 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.905249    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-953bf16f-serving-cert\""
Sep 07 13:11:04.905556 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.905528    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:04.964355 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.964321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:04.964533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.964384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:04.964533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.964452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxwh\" (UniqueName: \"kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:04.964533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:04.964487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.065385 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.065345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxwh\" (UniqueName: \"kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.065569 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.065404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.065569 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.065535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.065708 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.065643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.066255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.066229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.067981 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.067955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.068068 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.068000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.079927 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.079905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxwh\" (UniqueName: \"kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh\") pod \"maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.215357 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.215317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:05.510018 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:05.509935    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:05.513482 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:11:05.513452    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9006eccf_5f30_4fd8_bf38_763b236ec63e.slice/crio-9881528bdeb547175535db0ea243dbc46b45ab922392dc55e72a44644118aa41 WatchSource:0}: Error finding container 9881528bdeb547175535db0ea243dbc46b45ab922392dc55e72a44644118aa41: Status 404 returned error can't find the container with id 9881528bdeb547175535db0ea243dbc46b45ab922392dc55e72a44644118aa41
Sep 07 13:11:06.002307 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.002280    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:11:06.002727 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.002512    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" podUID="fcfddb5c-7b28-4e81-8688-dab73980a637" containerName="maas-api" containerID="cri-o://163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e" gracePeriod=30
Sep 07 13:11:06.265475 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.265440    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:11:06.270991 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.270960    2570 generic.go:356] "Generic (PLEG): container finished" podID="fcfddb5c-7b28-4e81-8688-dab73980a637" containerID="163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e" exitCode=0
Sep 07 13:11:06.271160 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.270999    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"
Sep 07 13:11:06.271160 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.271050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" event={"ID":"fcfddb5c-7b28-4e81-8688-dab73980a637","Type":"ContainerDied","Data":"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"}
Sep 07 13:11:06.271160 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.271110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh" event={"ID":"fcfddb5c-7b28-4e81-8688-dab73980a637","Type":"ContainerDied","Data":"856f0d2e85131d1c4f247c853f801e6c91f71da5d16e11b6497fe365302a545c"}
Sep 07 13:11:06.271160 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.271140    2570 scope.go:117] "RemoveContainer" containerID="163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"
Sep 07 13:11:06.272962 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.272935    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" event={"ID":"9006eccf-5f30-4fd8-bf38-763b236ec63e","Type":"ContainerStarted","Data":"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"}
Sep 07 13:11:06.273098 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.272985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" event={"ID":"9006eccf-5f30-4fd8-bf38-763b236ec63e","Type":"ContainerStarted","Data":"9881528bdeb547175535db0ea243dbc46b45ab922392dc55e72a44644118aa41"}
Sep 07 13:11:06.273098 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.273015    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:06.284046 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.284012    2570 scope.go:117] "RemoveContainer" containerID="163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"
Sep 07 13:11:06.284469 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:11:06.284437    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e\": container with ID starting with 163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e not found: ID does not exist" containerID="163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"
Sep 07 13:11:06.284567 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.284471    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e"} err="failed to get container status \"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e\": rpc error: code = NotFound desc = could not find container \"163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e\": container with ID starting with 163f56f63b9b9955699041f7493cf699d6a5624e2997a20634ee67a02dde037e not found: ID does not exist"
Sep 07 13:11:06.315356 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.315291    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" podStartSLOduration=1.84914933 podStartE2EDuration="2.31526761s" totalImagesPullingTime="466.11828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:11:06.31189518 +0000 UTC m=+1090.018678113" watchObservedRunningTime="2026-09-07 13:11:06.31526761 +0000 UTC m=+1090.022050559"
Sep 07 13:11:06.378070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.378040    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca\") pod \"fcfddb5c-7b28-4e81-8688-dab73980a637\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") "
Sep 07 13:11:06.378255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.378079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs\") pod \"fcfddb5c-7b28-4e81-8688-dab73980a637\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") "
Sep 07 13:11:06.378255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.378101    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkvc4\" (UniqueName: \"kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4\") pod \"fcfddb5c-7b28-4e81-8688-dab73980a637\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") "
Sep 07 13:11:06.378255 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.378151    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") pod \"fcfddb5c-7b28-4e81-8688-dab73980a637\" (UID: \"fcfddb5c-7b28-4e81-8688-dab73980a637\") "
Sep 07 13:11:06.378756 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.378452    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fcfddb5c-7b28-4e81-8688-dab73980a637" (UID: "fcfddb5c-7b28-4e81-8688-dab73980a637"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:11:06.380600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.380418    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fcfddb5c-7b28-4e81-8688-dab73980a637" (UID: "fcfddb5c-7b28-4e81-8688-dab73980a637"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:11:06.380600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.380468    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fcfddb5c-7b28-4e81-8688-dab73980a637" (UID: "fcfddb5c-7b28-4e81-8688-dab73980a637"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:11:06.380600 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.380575    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4" (OuterVolumeSpecName: "kube-api-access-bkvc4") pod "fcfddb5c-7b28-4e81-8688-dab73980a637" (UID: "fcfddb5c-7b28-4e81-8688-dab73980a637"). InnerVolumeSpecName "kube-api-access-bkvc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:11:06.479542 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.479504    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfddb5c-7b28-4e81-8688-dab73980a637-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:06.479542 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.479536    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:06.479542 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.479545    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkvc4\" (UniqueName: \"kubernetes.io/projected/fcfddb5c-7b28-4e81-8688-dab73980a637-kube-api-access-bkvc4\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:06.479797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.479555    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcfddb5c-7b28-4e81-8688-dab73980a637-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:06.606439 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.606404    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:11:06.616448 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.616421    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76f028-7b4b76bc85-hxcnh"]
Sep 07 13:11:06.815654 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:06.815608    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcfddb5c-7b28-4e81-8688-dab73980a637" path="/var/lib/kubelet/pods/fcfddb5c-7b28-4e81-8688-dab73980a637/volumes"
Sep 07 13:11:12.285388 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:12.285356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:18.923231 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.923194    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:11:18.923599 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.923577    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcfddb5c-7b28-4e81-8688-dab73980a637" containerName="maas-api"
Sep 07 13:11:18.923599 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.923590    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcfddb5c-7b28-4e81-8688-dab73980a637" containerName="maas-api"
Sep 07 13:11:18.923715 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.923681    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcfddb5c-7b28-4e81-8688-dab73980a637" containerName="maas-api"
Sep 07 13:11:18.928462 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.928434    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:18.931336 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.931314    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-aa813e-serving-cert\""
Sep 07 13:11:18.940640 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:18.940600    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:11:19.102131 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.102094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.102344 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.102147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.102344 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.102175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.102344 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.102242    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xmw\" (UniqueName: \"kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.203440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.203337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.203440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.203379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.203440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.203408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.203786 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.203441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xmw\" (UniqueName: \"kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.204124 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.204092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.205867 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.205847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.205962 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.205946    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.214993 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.214966    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xmw\" (UniqueName: \"kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw\") pod \"maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.239972 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.239933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:19.531908 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:19.531878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:11:19.533705 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:11:19.533676    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37454922_33b4_416e_9cff_fd17e81e8e31.slice/crio-dac257596811eb2c2095614bbe06dfff7bbd389afe552ec49105b74ecc365719 WatchSource:0}: Error finding container dac257596811eb2c2095614bbe06dfff7bbd389afe552ec49105b74ecc365719: Status 404 returned error can't find the container with id dac257596811eb2c2095614bbe06dfff7bbd389afe552ec49105b74ecc365719
Sep 07 13:11:20.349395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:20.349351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" event={"ID":"37454922-33b4-416e-9cff-fd17e81e8e31","Type":"ContainerStarted","Data":"dac257596811eb2c2095614bbe06dfff7bbd389afe552ec49105b74ecc365719"}
Sep 07 13:11:22.364341 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:22.364292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" event={"ID":"37454922-33b4-416e-9cff-fd17e81e8e31","Type":"ContainerStarted","Data":"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"}
Sep 07 13:11:22.364853 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:22.364677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:22.394119 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:22.394046    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" podStartSLOduration=2.436237869 podStartE2EDuration="4.394022891s" totalImagesPullingTime="1.957785022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:11:22.390146749 +0000 UTC m=+1106.096929706" watchObservedRunningTime="2026-09-07 13:11:22.394022891 +0000 UTC m=+1106.100805824"
Sep 07 13:11:28.381706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:28.381672    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:11:49.268633 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.268587    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:11:49.272188 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.272167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.275643 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.275602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-ae93b0-serving-cert\""
Sep 07 13:11:49.289093 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.289062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:11:49.353743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.353696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.353743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.353748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.354007 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.353855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jjg8\" (UniqueName: \"kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.354007 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.353905    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.455106 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.455064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.455325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.455149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.455325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.455210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jjg8\" (UniqueName: \"kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.455325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.455245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.455891 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.455865    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.457754 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.457735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.457931 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.457910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.474095 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.474058    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jjg8\" (UniqueName: \"kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8\") pod \"maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.582640 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.582528    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:49.869228 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:49.869137    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:11:49.872266 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:11:49.872229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4463e6de_3d70_4272_a28f_e346b34eac6f.slice/crio-b639c8104f9ba9e8097f2045f1f0cb9fa001b878f5396f61507270e652b61a33 WatchSource:0}: Error finding container b639c8104f9ba9e8097f2045f1f0cb9fa001b878f5396f61507270e652b61a33: Status 404 returned error can't find the container with id b639c8104f9ba9e8097f2045f1f0cb9fa001b878f5396f61507270e652b61a33
Sep 07 13:11:50.525104 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.525069    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" event={"ID":"4463e6de-3d70-4272-a28f-e346b34eac6f","Type":"ContainerStarted","Data":"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"}
Sep 07 13:11:50.525499 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.525129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" event={"ID":"4463e6de-3d70-4272-a28f-e346b34eac6f","Type":"ContainerStarted","Data":"b639c8104f9ba9e8097f2045f1f0cb9fa001b878f5396f61507270e652b61a33"}
Sep 07 13:11:50.525499 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.525158    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:11:50.559364 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.559288    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" podStartSLOduration=1.115164483 podStartE2EDuration="1.559265822s" totalImagesPullingTime="444.101339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:11:50.557341024 +0000 UTC m=+1134.264123957" watchObservedRunningTime="2026-09-07 13:11:50.559265822 +0000 UTC m=+1134.266048756"
Sep 07 13:11:50.613314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.613228    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:50.613470 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.613424    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" podUID="9006eccf-5f30-4fd8-bf38-763b236ec63e" containerName="maas-api" containerID="cri-o://40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e" gracePeriod=30
Sep 07 13:11:50.879075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.879005    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:50.968570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.968532    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca\") pod \"9006eccf-5f30-4fd8-bf38-763b236ec63e\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") "
Sep 07 13:11:50.968782 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.968681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs\") pod \"9006eccf-5f30-4fd8-bf38-763b236ec63e\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") "
Sep 07 13:11:50.968782 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.968717    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls\") pod \"9006eccf-5f30-4fd8-bf38-763b236ec63e\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") "
Sep 07 13:11:50.968782 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.968777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxxwh\" (UniqueName: \"kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh\") pod \"9006eccf-5f30-4fd8-bf38-763b236ec63e\" (UID: \"9006eccf-5f30-4fd8-bf38-763b236ec63e\") "
Sep 07 13:11:50.968952 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.968905    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9006eccf-5f30-4fd8-bf38-763b236ec63e" (UID: "9006eccf-5f30-4fd8-bf38-763b236ec63e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:11:50.969069 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.969039    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9006eccf-5f30-4fd8-bf38-763b236ec63e-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:50.970904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.970877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9006eccf-5f30-4fd8-bf38-763b236ec63e" (UID: "9006eccf-5f30-4fd8-bf38-763b236ec63e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:11:50.970904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.970890    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9006eccf-5f30-4fd8-bf38-763b236ec63e" (UID: "9006eccf-5f30-4fd8-bf38-763b236ec63e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:11:50.971065 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:50.971004    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh" (OuterVolumeSpecName: "kube-api-access-hxxwh") pod "9006eccf-5f30-4fd8-bf38-763b236ec63e" (UID: "9006eccf-5f30-4fd8-bf38-763b236ec63e"). InnerVolumeSpecName "kube-api-access-hxxwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:11:51.069872 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.069828    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:51.069872 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.069863    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9006eccf-5f30-4fd8-bf38-763b236ec63e-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:51.069872 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.069875    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxxwh\" (UniqueName: \"kubernetes.io/projected/9006eccf-5f30-4fd8-bf38-763b236ec63e-kube-api-access-hxxwh\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:11:51.532038 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.532001    2570 generic.go:356] "Generic (PLEG): container finished" podID="9006eccf-5f30-4fd8-bf38-763b236ec63e" containerID="40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e" exitCode=0
Sep 07 13:11:51.532533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.532056    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"
Sep 07 13:11:51.532533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.532082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" event={"ID":"9006eccf-5f30-4fd8-bf38-763b236ec63e","Type":"ContainerDied","Data":"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"}
Sep 07 13:11:51.532533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.532135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j" event={"ID":"9006eccf-5f30-4fd8-bf38-763b236ec63e","Type":"ContainerDied","Data":"9881528bdeb547175535db0ea243dbc46b45ab922392dc55e72a44644118aa41"}
Sep 07 13:11:51.532533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.532157    2570 scope.go:117] "RemoveContainer" containerID="40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"
Sep 07 13:11:51.542292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.542270    2570 scope.go:117] "RemoveContainer" containerID="40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"
Sep 07 13:11:51.542668 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:11:51.542642    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e\": container with ID starting with 40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e not found: ID does not exist" containerID="40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"
Sep 07 13:11:51.542754 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.542682    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e"} err="failed to get container status \"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e\": rpc error: code = NotFound desc = could not find container \"40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e\": container with ID starting with 40bb80866eafca7b4547e992a0b489d0e883159453efefb17ac90d9d09f4529e not found: ID does not exist"
Sep 07 13:11:51.557682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.557650    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:51.563728 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:51.563699    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-953bf16f-6c7bbc8579-wcv8j"]
Sep 07 13:11:52.815032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:52.814996    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9006eccf-5f30-4fd8-bf38-763b236ec63e" path="/var/lib/kubelet/pods/9006eccf-5f30-4fd8-bf38-763b236ec63e/volumes"
Sep 07 13:11:56.538346 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:11:56.538314    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:12:19.452000 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.451899    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:12:19.452581 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.452319    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9006eccf-5f30-4fd8-bf38-763b236ec63e" containerName="maas-api"
Sep 07 13:12:19.452581 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.452332    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9006eccf-5f30-4fd8-bf38-763b236ec63e" containerName="maas-api"
Sep 07 13:12:19.452581 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.452404    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9006eccf-5f30-4fd8-bf38-763b236ec63e" containerName="maas-api"
Sep 07 13:12:19.457060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.457035    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.460070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.460046    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-bc4b05-serving-cert\""
Sep 07 13:12:19.468974 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.468799    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:12:19.626218 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.626184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.626425 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.626234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.626425 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.626330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.626425 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.626384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpgv\" (UniqueName: \"kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.727268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.727186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.727268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.727243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.727483 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.727410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.727483 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.727455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpgv\" (UniqueName: \"kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.728071 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.728045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.729752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.729732    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.729838 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.729764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.738406 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.738383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpgv\" (UniqueName: \"kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv\") pod \"maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:19.769984 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:19.769954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:20.050165 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:20.050136    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:12:20.051750 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:12:20.051720    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e4e590_5372_4647_812e_b803ca2b4727.slice/crio-3ec8257b1785d9c97c9bdfbb03016a9d64e471a6bd10dfc39936f8ecee8c5f0e WatchSource:0}: Error finding container 3ec8257b1785d9c97c9bdfbb03016a9d64e471a6bd10dfc39936f8ecee8c5f0e: Status 404 returned error can't find the container with id 3ec8257b1785d9c97c9bdfbb03016a9d64e471a6bd10dfc39936f8ecee8c5f0e
Sep 07 13:12:20.708853 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:20.708812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" event={"ID":"31e4e590-5372-4647-812e-b803ca2b4727","Type":"ContainerStarted","Data":"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"}
Sep 07 13:12:20.709253 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:20.708877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" event={"ID":"31e4e590-5372-4647-812e-b803ca2b4727","Type":"ContainerStarted","Data":"3ec8257b1785d9c97c9bdfbb03016a9d64e471a6bd10dfc39936f8ecee8c5f0e"}
Sep 07 13:12:20.709253 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:20.709015    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:20.738238 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:20.738186    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" podStartSLOduration=1.294105351 podStartE2EDuration="1.738163016s" totalImagesPullingTime="444.057665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:12:20.735979611 +0000 UTC m=+1164.442762542" watchObservedRunningTime="2026-09-07 13:12:20.738163016 +0000 UTC m=+1164.444945949"
Sep 07 13:12:26.719638 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:26.719594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:12:48.409099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.409061    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:12:48.417542 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.417507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.420219 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.420196    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-45d721-serving-cert\""
Sep 07 13:12:48.425315 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.425247    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:12:48.491137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.491099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.491137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.491139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hh7\" (UniqueName: \"kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.491334 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.491230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.491334 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.491315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.592833 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.592791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.592996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.592857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.592996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.592892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hh7\" (UniqueName: \"kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.592996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.592954    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.592996 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:12:48.592966    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-serving-cert: secret "maas-api-e2e-shared-b-w2-45d721-serving-cert" not found
Sep 07 13:12:48.593203 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:12:48.593061    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls podName:5eb22175-c848-4315-aa9d-370bffd08792 nodeName:}" failed. No retries permitted until 2026-09-07 13:12:49.093038788 +0000 UTC m=+1192.799821716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls") pod "maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" (UID: "5eb22175-c848-4315-aa9d-370bffd08792") : secret "maas-api-e2e-shared-b-w2-45d721-serving-cert" not found
Sep 07 13:12:48.593785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.593760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.595958 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.595921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:48.602907 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:48.602878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hh7\" (UniqueName: \"kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:49.098066 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:49.098025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:49.100454 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:49.100433    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:49.329264 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:49.329223    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:49.614604 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:49.614575    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:12:49.616130 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:12:49.616104    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb22175_c848_4315_aa9d_370bffd08792.slice/crio-354b6e866c0e602dc8061ca74b1643d56c48a897e47ae46a6f3f2c25d85791d9 WatchSource:0}: Error finding container 354b6e866c0e602dc8061ca74b1643d56c48a897e47ae46a6f3f2c25d85791d9: Status 404 returned error can't find the container with id 354b6e866c0e602dc8061ca74b1643d56c48a897e47ae46a6f3f2c25d85791d9
Sep 07 13:12:49.878914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:49.878875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" event={"ID":"5eb22175-c848-4315-aa9d-370bffd08792","Type":"ContainerStarted","Data":"354b6e866c0e602dc8061ca74b1643d56c48a897e47ae46a6f3f2c25d85791d9"}
Sep 07 13:12:50.886813 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:50.886761    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" event={"ID":"5eb22175-c848-4315-aa9d-370bffd08792","Type":"ContainerStarted","Data":"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"}
Sep 07 13:12:50.887332 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:50.886871    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:50.908251 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:50.908193    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" podStartSLOduration=2.168624184 podStartE2EDuration="2.908175333s" totalImagesPullingTime="739.551149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:12:50.906448017 +0000 UTC m=+1194.613230971" watchObservedRunningTime="2026-09-07 13:12:50.908175333 +0000 UTC m=+1194.614958264"
Sep 07 13:12:56.898558 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:56.898526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:12:56.948412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:56.948373    2570 scope.go:117] "RemoveContainer" containerID="dea1ed4306ebd30d9c93b240dbf90dcb92b49e162d1b4d12b78cfc0d0963a853"
Sep 07 13:12:56.960759 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:12:56.960723    2570 scope.go:117] "RemoveContainer" containerID="f4d920ddaf12c428e5cc02989aa2f47155e7809282895c5a13ad27f8a1f6e91f"
Sep 07 13:13:08.112259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.112223    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:13:08.115536 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.115518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.119824 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.119792    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"openshift-service-ca.crt\""
Sep 07 13:13:08.119966 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.119897    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"auth-test-model-ae93b0-kserve-self-signed-certs\""
Sep 07 13:13:08.119966 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.119906    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"default-dockercfg-fzswr\""
Sep 07 13:13:08.119966 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.119812    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"kube-root-ca.crt\""
Sep 07 13:13:08.128475 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.128448    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:13:08.267474 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.267719 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.267719 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.267719 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.267867 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.267867 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.267755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525f5\" (UniqueName: \"kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.368911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.368958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.368979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369012 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369356 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369035    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369356 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525f5\" (UniqueName: \"kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369469 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369363    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369469 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369417    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.369540 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.369472    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.371372 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.371349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.371538 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.371523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.380004 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.379983    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-525f5\" (UniqueName: \"kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5\") pod \"auth-test-model-ae93b0-kserve-59798d8f47-lssk6\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.424947 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.424910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:08.706020 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.705976    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:13:08.709729 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:08.709682    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod258abd28_361e_4645_9e46_591003f811cd.slice/crio-5c09a58c2252f2e791e20aad9d8c2e4952d2b587d2cae6289adb150113b12926 WatchSource:0}: Error finding container 5c09a58c2252f2e791e20aad9d8c2e4952d2b587d2cae6289adb150113b12926: Status 404 returned error can't find the container with id 5c09a58c2252f2e791e20aad9d8c2e4952d2b587d2cae6289adb150113b12926
Sep 07 13:13:08.995055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.994963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" event={"ID":"258abd28-361e-4645-9e46-591003f811cd","Type":"ContainerStarted","Data":"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"}
Sep 07 13:13:08.995055 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:08.995014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" event={"ID":"258abd28-361e-4645-9e46-591003f811cd","Type":"ContainerStarted","Data":"5c09a58c2252f2e791e20aad9d8c2e4952d2b587d2cae6289adb150113b12926"}
Sep 07 13:13:09.015759 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:09.015703    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" podStartSLOduration=1.015685285 podStartE2EDuration="1.015685285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:13:09.013139405 +0000 UTC m=+1212.719922338" watchObservedRunningTime="2026-09-07 13:13:09.015685285 +0000 UTC m=+1212.722468245"
Sep 07 13:13:12.931370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:12.931329    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:12.934958 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:12.934936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:12.938085 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:12.938057    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2xgvq\""
Sep 07 13:13:12.941579 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:12.941549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:13.114052 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:13.114017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwtv\" (UniqueName: \"kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv\") pod \"test-curl-7859-140021184427472\" (UID: \"081614de-cfea-429c-985f-db605844d261\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:13.215329 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:13.215239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwtv\" (UniqueName: \"kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv\") pod \"test-curl-7859-140021184427472\" (UID: \"081614de-cfea-429c-985f-db605844d261\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:13.226137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:13.226106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwtv\" (UniqueName: \"kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv\") pod \"test-curl-7859-140021184427472\" (UID: \"081614de-cfea-429c-985f-db605844d261\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:13.246293 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:13.246256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:13.524435 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:13.524402    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:13.525923 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:13.525894    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod081614de_cfea_429c_985f_db605844d261.slice/crio-025269cef5642bbef19b8a89c025943f9d635445175186c42b63e6d153667a3e WatchSource:0}: Error finding container 025269cef5642bbef19b8a89c025943f9d635445175186c42b63e6d153667a3e: Status 404 returned error can't find the container with id 025269cef5642bbef19b8a89c025943f9d635445175186c42b63e6d153667a3e
Sep 07 13:13:14.028137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:14.028101    2570 generic.go:356] "Generic (PLEG): container finished" podID="081614de-cfea-429c-985f-db605844d261" containerID="a11bd8fed48a9ba05cc2b19c43af87a1f1d45b05af7a28f464ab6e4a32cce5e1" exitCode=0
Sep 07 13:13:14.028529 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:14.028182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184427472" event={"ID":"081614de-cfea-429c-985f-db605844d261","Type":"ContainerDied","Data":"a11bd8fed48a9ba05cc2b19c43af87a1f1d45b05af7a28f464ab6e4a32cce5e1"}
Sep 07 13:13:14.028529 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:14.028221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184427472" event={"ID":"081614de-cfea-429c-985f-db605844d261","Type":"ContainerStarted","Data":"025269cef5642bbef19b8a89c025943f9d635445175186c42b63e6d153667a3e"}
Sep 07 13:13:15.167975 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.167944    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.206136 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.206109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7859-140021184427472_081614de-cfea-429c-985f-db605844d261/test-curl-7859-140021184427472/0.log"
Sep 07 13:13:15.230878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.230841    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:15.235886 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.235857    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:15.335030 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.334935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwwtv\" (UniqueName: \"kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv\") pod \"081614de-cfea-429c-985f-db605844d261\" (UID: \"081614de-cfea-429c-985f-db605844d261\") "
Sep 07 13:13:15.336971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.336945    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv" (OuterVolumeSpecName: "kube-api-access-mwwtv") pod "081614de-cfea-429c-985f-db605844d261" (UID: "081614de-cfea-429c-985f-db605844d261"). InnerVolumeSpecName "kube-api-access-mwwtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:13:15.368285 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.368249    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:15.368675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.368654    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081614de-cfea-429c-985f-db605844d261" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:15.368675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.368672    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="081614de-cfea-429c-985f-db605844d261" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:15.368858 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.368771    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="081614de-cfea-429c-985f-db605844d261" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:15.371867 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.371848    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.379412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.379286    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:15.436760 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.436720    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwwtv\" (UniqueName: \"kubernetes.io/projected/081614de-cfea-429c-985f-db605844d261-kube-api-access-mwwtv\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:13:15.537290 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.537249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7x4l\" (UniqueName: \"kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l\") pod \"test-curl-7859-140021184427472\" (UID: \"12a9550b-4001-4370-9afb-d43ed0bf613f\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.638258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.638160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7x4l\" (UniqueName: \"kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l\") pod \"test-curl-7859-140021184427472\" (UID: \"12a9550b-4001-4370-9afb-d43ed0bf613f\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.647909 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.647872    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7x4l\" (UniqueName: \"kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l\") pod \"test-curl-7859-140021184427472\" (UID: \"12a9550b-4001-4370-9afb-d43ed0bf613f\") " pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.681757 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.681709    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:15.960978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:15.960950    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:15.961737 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:15.961707    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12a9550b_4001_4370_9afb_d43ed0bf613f.slice/crio-66d3c71d16ee493a2eff3900629ee4b214a31283cc78d816b0b158c7f22390d1 WatchSource:0}: Error finding container 66d3c71d16ee493a2eff3900629ee4b214a31283cc78d816b0b158c7f22390d1: Status 404 returned error can't find the container with id 66d3c71d16ee493a2eff3900629ee4b214a31283cc78d816b0b158c7f22390d1
Sep 07 13:13:16.039526 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:16.039480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184427472" event={"ID":"12a9550b-4001-4370-9afb-d43ed0bf613f","Type":"ContainerStarted","Data":"66d3c71d16ee493a2eff3900629ee4b214a31283cc78d816b0b158c7f22390d1"}
Sep 07 13:13:16.040784 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:16.040765    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="025269cef5642bbef19b8a89c025943f9d635445175186c42b63e6d153667a3e"
Sep 07 13:13:16.040912 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:16.040806    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:16.055507 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:16.055462    2570 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7859-140021184427472" oldPodUID="081614de-cfea-429c-985f-db605844d261" podUID="12a9550b-4001-4370-9afb-d43ed0bf613f"
Sep 07 13:13:16.815421 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:16.815337    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081614de-cfea-429c-985f-db605844d261" path="/var/lib/kubelet/pods/081614de-cfea-429c-985f-db605844d261/volumes"
Sep 07 13:13:17.047820 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:17.047787    2570 generic.go:356] "Generic (PLEG): container finished" podID="12a9550b-4001-4370-9afb-d43ed0bf613f" containerID="b4e316d7f3e9995c4840ceb15a2ba4b9e0d5f05a5a8395e613db209f6a4ac586" exitCode=0
Sep 07 13:13:17.048036 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:17.047866    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184427472" event={"ID":"12a9550b-4001-4370-9afb-d43ed0bf613f","Type":"ContainerDied","Data":"b4e316d7f3e9995c4840ceb15a2ba4b9e0d5f05a5a8395e613db209f6a4ac586"}
Sep 07 13:13:18.192147 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.192119    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:18.216264 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.216236    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7859-140021184427472_12a9550b-4001-4370-9afb-d43ed0bf613f/test-curl-7859-140021184427472/0.log"
Sep 07 13:13:18.242768 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.242734    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:18.248121 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.248096    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7859-140021184427472"]
Sep 07 13:13:18.364130 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.364026    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7x4l\" (UniqueName: \"kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l\") pod \"12a9550b-4001-4370-9afb-d43ed0bf613f\" (UID: \"12a9550b-4001-4370-9afb-d43ed0bf613f\") "
Sep 07 13:13:18.366122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.366093    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l" (OuterVolumeSpecName: "kube-api-access-p7x4l") pod "12a9550b-4001-4370-9afb-d43ed0bf613f" (UID: "12a9550b-4001-4370-9afb-d43ed0bf613f"). InnerVolumeSpecName "kube-api-access-p7x4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:13:18.372916 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.372888    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:18.373477 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.373400    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12a9550b-4001-4370-9afb-d43ed0bf613f" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:18.373477 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.373420    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="12a9550b-4001-4370-9afb-d43ed0bf613f" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:18.373640 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.373540    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="12a9550b-4001-4370-9afb-d43ed0bf613f" containerName="test-curl-7859-140021184427472"
Sep 07 13:13:18.376907 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.376883    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:18.383549 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.383523    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:18.425516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.425476    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:18.425516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.425526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:18.437834 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.437807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:18.465744 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.465714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdhsh\" (UniqueName: \"kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh\") pod \"test-curl-7859-140021184428048\" (UID: \"5dbdd08d-1178-4238-98b5-bd30ce900b54\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:18.465929 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.465769    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7x4l\" (UniqueName: \"kubernetes.io/projected/12a9550b-4001-4370-9afb-d43ed0bf613f-kube-api-access-p7x4l\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:13:18.566179 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.566146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdhsh\" (UniqueName: \"kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh\") pod \"test-curl-7859-140021184428048\" (UID: \"5dbdd08d-1178-4238-98b5-bd30ce900b54\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:18.575541 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.575506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdhsh\" (UniqueName: \"kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh\") pod \"test-curl-7859-140021184428048\" (UID: \"5dbdd08d-1178-4238-98b5-bd30ce900b54\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:18.686840 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.686791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:18.816949 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.816913    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12a9550b-4001-4370-9afb-d43ed0bf613f" path="/var/lib/kubelet/pods/12a9550b-4001-4370-9afb-d43ed0bf613f/volumes"
Sep 07 13:13:18.979754 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:18.979727    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:18.982008 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:18.981981    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dbdd08d_1178_4238_98b5_bd30ce900b54.slice/crio-4c87d6358d82a2c5e441ce4f52159b8d8f807d7c4e41298a5bbfb39da75f47e0 WatchSource:0}: Error finding container 4c87d6358d82a2c5e441ce4f52159b8d8f807d7c4e41298a5bbfb39da75f47e0: Status 404 returned error can't find the container with id 4c87d6358d82a2c5e441ce4f52159b8d8f807d7c4e41298a5bbfb39da75f47e0
Sep 07 13:13:19.063006 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:19.062977    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184427472"
Sep 07 13:13:19.063006 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:19.062989    2570 scope.go:117] "RemoveContainer" containerID="b4e316d7f3e9995c4840ceb15a2ba4b9e0d5f05a5a8395e613db209f6a4ac586"
Sep 07 13:13:19.064420 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:19.064383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184428048" event={"ID":"5dbdd08d-1178-4238-98b5-bd30ce900b54","Type":"ContainerStarted","Data":"4c87d6358d82a2c5e441ce4f52159b8d8f807d7c4e41298a5bbfb39da75f47e0"}
Sep 07 13:13:19.076280 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:19.076260    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:13:20.072464 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:20.072424    2570 generic.go:356] "Generic (PLEG): container finished" podID="5dbdd08d-1178-4238-98b5-bd30ce900b54" containerID="2aa27ea1b85cc6d919363d77e566141c91df33ccc9456dab78d2dd22292b02cc" exitCode=0
Sep 07 13:13:20.072842 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:20.072513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184428048" event={"ID":"5dbdd08d-1178-4238-98b5-bd30ce900b54","Type":"ContainerDied","Data":"2aa27ea1b85cc6d919363d77e566141c91df33ccc9456dab78d2dd22292b02cc"}
Sep 07 13:13:21.211191 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.211165    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.235728 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.235702    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7859-140021184428048_5dbdd08d-1178-4238-98b5-bd30ce900b54/test-curl-7859-140021184428048/0.log"
Sep 07 13:13:21.261802 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.261770    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:21.266735 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.266708    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:21.288561 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.288537    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdhsh\" (UniqueName: \"kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh\") pod \"5dbdd08d-1178-4238-98b5-bd30ce900b54\" (UID: \"5dbdd08d-1178-4238-98b5-bd30ce900b54\") "
Sep 07 13:13:21.290579 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.290557    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh" (OuterVolumeSpecName: "kube-api-access-sdhsh") pod "5dbdd08d-1178-4238-98b5-bd30ce900b54" (UID: "5dbdd08d-1178-4238-98b5-bd30ce900b54"). InnerVolumeSpecName "kube-api-access-sdhsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:13:21.389947 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.389861    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdhsh\" (UniqueName: \"kubernetes.io/projected/5dbdd08d-1178-4238-98b5-bd30ce900b54-kube-api-access-sdhsh\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:13:21.392712 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.392684    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:21.393075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.393063    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dbdd08d-1178-4238-98b5-bd30ce900b54" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:21.393119 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.393077    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dbdd08d-1178-4238-98b5-bd30ce900b54" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:21.393162 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.393152    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dbdd08d-1178-4238-98b5-bd30ce900b54" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:21.396168 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.396153    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.404403 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.404377    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:21.490377 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.490338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-564c8\" (UniqueName: \"kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8\") pod \"test-curl-7859-140021184428048\" (UID: \"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.591211 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.591154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-564c8\" (UniqueName: \"kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8\") pod \"test-curl-7859-140021184428048\" (UID: \"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.600812 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.600782    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-564c8\" (UniqueName: \"kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8\") pod \"test-curl-7859-140021184428048\" (UID: \"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b\") " pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.706201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.706154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:21.981021 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:21.980922    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:21.983687 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:21.983655    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ad48041_9a28_4f3f_ab7c_bfa8f0819f0b.slice/crio-f4c9a1f496eae7d885996e08e8507fc00f9b5335beac59fdedc95f958b2f2368 WatchSource:0}: Error finding container f4c9a1f496eae7d885996e08e8507fc00f9b5335beac59fdedc95f958b2f2368: Status 404 returned error can't find the container with id f4c9a1f496eae7d885996e08e8507fc00f9b5335beac59fdedc95f958b2f2368
Sep 07 13:13:22.086293 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:22.086266    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c87d6358d82a2c5e441ce4f52159b8d8f807d7c4e41298a5bbfb39da75f47e0"
Sep 07 13:13:22.086293 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:22.086267    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:22.087677 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:22.087643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184428048" event={"ID":"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b","Type":"ContainerStarted","Data":"f4c9a1f496eae7d885996e08e8507fc00f9b5335beac59fdedc95f958b2f2368"}
Sep 07 13:13:22.100554 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:22.100527    2570 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7859-140021184428048" oldPodUID="5dbdd08d-1178-4238-98b5-bd30ce900b54" podUID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b"
Sep 07 13:13:22.815752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:22.815671    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dbdd08d-1178-4238-98b5-bd30ce900b54" path="/var/lib/kubelet/pods/5dbdd08d-1178-4238-98b5-bd30ce900b54/volumes"
Sep 07 13:13:23.095944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:23.095845    2570 generic.go:356] "Generic (PLEG): container finished" podID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" containerID="c826832eeea7e0491aed697e91e954ac831957646ed6d3ea0511f7a55a6a72fd" exitCode=0
Sep 07 13:13:23.096098 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:23.095930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7859-140021184428048" event={"ID":"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b","Type":"ContainerDied","Data":"c826832eeea7e0491aed697e91e954ac831957646ed6d3ea0511f7a55a6a72fd"}
Sep 07 13:13:24.245118 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.245090    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:24.271420 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.271383    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7859-140021184428048_3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b/test-curl-7859-140021184428048/0.log"
Sep 07 13:13:24.299423 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.299389    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:24.307824 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.307794    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7859-140021184428048"]
Sep 07 13:13:24.307977 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.307836    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-564c8\" (UniqueName: \"kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8\") pod \"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b\" (UID: \"3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b\") "
Sep 07 13:13:24.309964 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.309933    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8" (OuterVolumeSpecName: "kube-api-access-564c8") pod "3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" (UID: "3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b"). InnerVolumeSpecName "kube-api-access-564c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:13:24.408692 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.408656    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-564c8\" (UniqueName: \"kubernetes.io/projected/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b-kube-api-access-564c8\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:13:24.815668 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:24.815579    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" path="/var/lib/kubelet/pods/3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b/volumes"
Sep 07 13:13:25.115075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:25.114994    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7859-140021184428048"
Sep 07 13:13:25.115075 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:25.115007    2570 scope.go:117] "RemoveContainer" containerID="c826832eeea7e0491aed697e91e954ac831957646ed6d3ea0511f7a55a6a72fd"
Sep 07 13:13:29.930074 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.930040    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:13:29.930491 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.930478    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:29.930491 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.930492    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:29.930575 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.930556    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad48041-9a28-4f3f-ab7c-bfa8f0819f0b" containerName="test-curl-7859-140021184428048"
Sep 07 13:13:29.933690 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.933665    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:29.936257 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.936233    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0561b5ad-serving-cert\""
Sep 07 13:13:29.946880 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.946849    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:13:29.952576 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.952547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:29.952751 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.952651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:29.952751 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.952704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:29.952751 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:29.952723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkpb\" (UniqueName: \"kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.053329 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.053287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.053516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.053341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.053516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.053367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkpb\" (UniqueName: \"kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.053516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.053419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.054158 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.054135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.055890 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.055869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.056022 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.056000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.064022 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.063987    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkpb\" (UniqueName: \"kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb\") pod \"maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.245122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.245032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:30.523389 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:30.523362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:13:30.525296 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:13:30.525266    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b71616_3fb0_4670_95bb_71350862e8aa.slice/crio-f9db7dcc18d3d38cb7273f025f46fbf016b04150b72b9b3d8b73e2a4b703cc9c WatchSource:0}: Error finding container f9db7dcc18d3d38cb7273f025f46fbf016b04150b72b9b3d8b73e2a4b703cc9c: Status 404 returned error can't find the container with id f9db7dcc18d3d38cb7273f025f46fbf016b04150b72b9b3d8b73e2a4b703cc9c
Sep 07 13:13:31.157788 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:31.157747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" event={"ID":"83b71616-3fb0-4670-95bb-71350862e8aa","Type":"ContainerStarted","Data":"d3383fb7a761386cbdb74e2bee058893d8fa5faa7be89e9256235fbccaa153f9"}
Sep 07 13:13:31.158200 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:31.157813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" event={"ID":"83b71616-3fb0-4670-95bb-71350862e8aa","Type":"ContainerStarted","Data":"f9db7dcc18d3d38cb7273f025f46fbf016b04150b72b9b3d8b73e2a4b703cc9c"}
Sep 07 13:13:31.158200 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:31.157864    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:13:31.176971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:31.176905    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" podStartSLOduration=1.775702074 podStartE2EDuration="2.176886794s" totalImagesPullingTime="401.18472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:13:31.176225541 +0000 UTC m=+1234.883008493" watchObservedRunningTime="2026-09-07 13:13:31.176886794 +0000 UTC m=+1234.883669726"
Sep 07 13:13:37.169637 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:13:37.169589    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:14:59.444659 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.444602    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:14:59.445199 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.444905    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" podUID="83b71616-3fb0-4670-95bb-71350862e8aa" containerName="maas-api" containerID="cri-o://d3383fb7a761386cbdb74e2bee058893d8fa5faa7be89e9256235fbccaa153f9" gracePeriod=30
Sep 07 13:14:59.658072 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.658033    2570 generic.go:356] "Generic (PLEG): container finished" podID="83b71616-3fb0-4670-95bb-71350862e8aa" containerID="d3383fb7a761386cbdb74e2bee058893d8fa5faa7be89e9256235fbccaa153f9" exitCode=0
Sep 07 13:14:59.658231 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.658098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" event={"ID":"83b71616-3fb0-4670-95bb-71350862e8aa","Type":"ContainerDied","Data":"d3383fb7a761386cbdb74e2bee058893d8fa5faa7be89e9256235fbccaa153f9"}
Sep 07 13:14:59.709313 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.709243    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:14:59.892189 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.892154    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs\") pod \"83b71616-3fb0-4670-95bb-71350862e8aa\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") "
Sep 07 13:14:59.892370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.892212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls\") pod \"83b71616-3fb0-4670-95bb-71350862e8aa\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") "
Sep 07 13:14:59.892370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.892237    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca\") pod \"83b71616-3fb0-4670-95bb-71350862e8aa\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") "
Sep 07 13:14:59.892370 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.892293    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxkpb\" (UniqueName: \"kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb\") pod \"83b71616-3fb0-4670-95bb-71350862e8aa\" (UID: \"83b71616-3fb0-4670-95bb-71350862e8aa\") "
Sep 07 13:14:59.892696 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.892666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83b71616-3fb0-4670-95bb-71350862e8aa" (UID: "83b71616-3fb0-4670-95bb-71350862e8aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:14:59.894402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.894371    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83b71616-3fb0-4670-95bb-71350862e8aa" (UID: "83b71616-3fb0-4670-95bb-71350862e8aa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:14:59.894505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.894414    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83b71616-3fb0-4670-95bb-71350862e8aa" (UID: "83b71616-3fb0-4670-95bb-71350862e8aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:14:59.894505 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.894441    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb" (OuterVolumeSpecName: "kube-api-access-rxkpb") pod "83b71616-3fb0-4670-95bb-71350862e8aa" (UID: "83b71616-3fb0-4670-95bb-71350862e8aa"). InnerVolumeSpecName "kube-api-access-rxkpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:14:59.993738 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.993597    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:14:59.993738 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.993671    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83b71616-3fb0-4670-95bb-71350862e8aa-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:14:59.993738 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.993685    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b71616-3fb0-4670-95bb-71350862e8aa-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:14:59.993738 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:14:59.993699    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxkpb\" (UniqueName: \"kubernetes.io/projected/83b71616-3fb0-4670-95bb-71350862e8aa-kube-api-access-rxkpb\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:00.667731 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.667695    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"
Sep 07 13:15:00.668174 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.667726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc" event={"ID":"83b71616-3fb0-4670-95bb-71350862e8aa","Type":"ContainerDied","Data":"f9db7dcc18d3d38cb7273f025f46fbf016b04150b72b9b3d8b73e2a4b703cc9c"}
Sep 07 13:15:00.668174 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.667797    2570 scope.go:117] "RemoveContainer" containerID="d3383fb7a761386cbdb74e2bee058893d8fa5faa7be89e9256235fbccaa153f9"
Sep 07 13:15:00.694859 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.694824    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:15:00.699832 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.699802    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0561b5ad-57567d78bc-wjcqc"]
Sep 07 13:15:00.815385 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:00.815348    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b71616-3fb0-4670-95bb-71350862e8aa" path="/var/lib/kubelet/pods/83b71616-3fb0-4670-95bb-71350862e8aa/volumes"
Sep 07 13:15:16.494381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.494348    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7862-a793de"]
Sep 07 13:15:16.494893 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.494772    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b71616-3fb0-4670-95bb-71350862e8aa" containerName="maas-api"
Sep 07 13:15:16.494893 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.494787    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b71616-3fb0-4670-95bb-71350862e8aa" containerName="maas-api"
Sep 07 13:15:16.494893 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.494858    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b71616-3fb0-4670-95bb-71350862e8aa" containerName="maas-api"
Sep 07 13:15:16.499200 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.499182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:16.501775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.501733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2xgvq\""
Sep 07 13:15:16.508207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.508184    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-a793de"]
Sep 07 13:15:16.550217 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.550173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ccdh\" (UniqueName: \"kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh\") pod \"mt-curl-7862-a793de\" (UID: \"e2ec0ca8-b2ff-4278-b235-52391878c379\") " pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:16.651755 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.651719    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ccdh\" (UniqueName: \"kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh\") pod \"mt-curl-7862-a793de\" (UID: \"e2ec0ca8-b2ff-4278-b235-52391878c379\") " pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:16.662280 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.662241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ccdh\" (UniqueName: \"kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh\") pod \"mt-curl-7862-a793de\" (UID: \"e2ec0ca8-b2ff-4278-b235-52391878c379\") " pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:16.808756 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:16.808657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:17.093968 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:17.093937    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-a793de"]
Sep 07 13:15:17.095481 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:15:17.095455    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ec0ca8_b2ff_4278_b235_52391878c379.slice/crio-06837048f52fb80af17fd022f2728b5436b84ca40f25960637517a89e799b6b2 WatchSource:0}: Error finding container 06837048f52fb80af17fd022f2728b5436b84ca40f25960637517a89e799b6b2: Status 404 returned error can't find the container with id 06837048f52fb80af17fd022f2728b5436b84ca40f25960637517a89e799b6b2
Sep 07 13:15:17.096865 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:17.096847    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:15:17.761914 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:17.761877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-a793de" event={"ID":"e2ec0ca8-b2ff-4278-b235-52391878c379","Type":"ContainerStarted","Data":"06837048f52fb80af17fd022f2728b5436b84ca40f25960637517a89e799b6b2"}
Sep 07 13:15:18.768589 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:18.768553    2570 generic.go:356] "Generic (PLEG): container finished" podID="e2ec0ca8-b2ff-4278-b235-52391878c379" containerID="53ee2f26e9b0d6338a72bc11d1035af4b6909f490ac955dd36bc17cccaf68c9c" exitCode=0
Sep 07 13:15:18.768995 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:18.768661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-a793de" event={"ID":"e2ec0ca8-b2ff-4278-b235-52391878c379","Type":"ContainerDied","Data":"53ee2f26e9b0d6338a72bc11d1035af4b6909f490ac955dd36bc17cccaf68c9c"}
Sep 07 13:15:19.903972 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.903947    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:19.947790 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.947755    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7862-a793de_e2ec0ca8-b2ff-4278-b235-52391878c379/mt-curl-7862-a793de/0.log"
Sep 07 13:15:19.974947 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.974912    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7862-a793de"]
Sep 07 13:15:19.979062 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.979034    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7862-a793de"]
Sep 07 13:15:19.984902 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.984885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ccdh\" (UniqueName: \"kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh\") pod \"e2ec0ca8-b2ff-4278-b235-52391878c379\" (UID: \"e2ec0ca8-b2ff-4278-b235-52391878c379\") "
Sep 07 13:15:19.986943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:19.986917    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh" (OuterVolumeSpecName: "kube-api-access-8ccdh") pod "e2ec0ca8-b2ff-4278-b235-52391878c379" (UID: "e2ec0ca8-b2ff-4278-b235-52391878c379"). InnerVolumeSpecName "kube-api-access-8ccdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:15:20.086453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:20.086359    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ccdh\" (UniqueName: \"kubernetes.io/projected/e2ec0ca8-b2ff-4278-b235-52391878c379-kube-api-access-8ccdh\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:20.781403 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:20.781374    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:20.781403 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:20.781386    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06837048f52fb80af17fd022f2728b5436b84ca40f25960637517a89e799b6b2"
Sep 07 13:15:20.792298 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:15:20.792258    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7862-a793de\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="e2ec0ca8-b2ff-4278-b235-52391878c379" pod="opendatahub/mt-curl-7862-a793de"
Sep 07 13:15:20.815482 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:20.815451    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ec0ca8-b2ff-4278-b235-52391878c379" path="/var/lib/kubelet/pods/e2ec0ca8-b2ff-4278-b235-52391878c379/volumes"
Sep 07 13:15:22.800454 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:22.800417    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:15:37.822362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:37.822318    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" podUID="258abd28-361e-4645-9e46-591003f811cd" containerName="main" containerID="cri-o://b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3" gracePeriod=45
Sep 07 13:15:38.082541 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.082471    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:15:38.256567 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256524    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-525f5\" (UniqueName: \"kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256611    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256703    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256775 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256998 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256779    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm\") pod \"258abd28-361e-4645-9e46-591003f811cd\" (UID: \"258abd28-361e-4645-9e46-591003f811cd\") "
Sep 07 13:15:38.256998 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256930    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home" (OuterVolumeSpecName: "home") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:38.256998 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.256972    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:38.257157 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.257018    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:38.257157 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.257142    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.257252 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.257161    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.257252 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.257177    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.259018 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.258991    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:15:38.259114 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.258996    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5" (OuterVolumeSpecName: "kube-api-access-525f5") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "kube-api-access-525f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:15:38.259156 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.259142    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm" (OuterVolumeSpecName: "dshm") pod "258abd28-361e-4645-9e46-591003f811cd" (UID: "258abd28-361e-4645-9e46-591003f811cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:38.358378 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.358292    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-525f5\" (UniqueName: \"kubernetes.io/projected/258abd28-361e-4645-9e46-591003f811cd-kube-api-access-525f5\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.358378 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.358322    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/258abd28-361e-4645-9e46-591003f811cd-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.358378 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.358333    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/258abd28-361e-4645-9e46-591003f811cd-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:15:38.887692 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.887655    2570 generic.go:356] "Generic (PLEG): container finished" podID="258abd28-361e-4645-9e46-591003f811cd" containerID="b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3" exitCode=0
Sep 07 13:15:38.888144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.887708    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" event={"ID":"258abd28-361e-4645-9e46-591003f811cd","Type":"ContainerDied","Data":"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"}
Sep 07 13:15:38.888144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.887723    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"
Sep 07 13:15:38.888144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.887749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6" event={"ID":"258abd28-361e-4645-9e46-591003f811cd","Type":"ContainerDied","Data":"5c09a58c2252f2e791e20aad9d8c2e4952d2b587d2cae6289adb150113b12926"}
Sep 07 13:15:38.888144 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.887772    2570 scope.go:117] "RemoveContainer" containerID="b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"
Sep 07 13:15:38.896876 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.896853    2570 scope.go:117] "RemoveContainer" containerID="b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"
Sep 07 13:15:38.897170 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:15:38.897150    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3\": container with ID starting with b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3 not found: ID does not exist" containerID="b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"
Sep 07 13:15:38.897225 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.897180    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3"} err="failed to get container status \"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3\": rpc error: code = NotFound desc = could not find container \"b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3\": container with ID starting with b4e206bb4db71365843ebe5aab442d728f63888003d66f32c0cbb6c7cf9592e3 not found: ID does not exist"
Sep 07 13:15:38.918977 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.918948    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:15:38.922875 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:38.922850    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/auth-test-model-ae93b0-kserve-59798d8f47-lssk6"]
Sep 07 13:15:40.817177 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:40.817132    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="258abd28-361e-4645-9e46-591003f811cd" path="/var/lib/kubelet/pods/258abd28-361e-4645-9e46-591003f811cd/volumes"
Sep 07 13:15:52.329249 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329211    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:15:52.329748 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329674    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258abd28-361e-4645-9e46-591003f811cd" containerName="main"
Sep 07 13:15:52.329748 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329688    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="258abd28-361e-4645-9e46-591003f811cd" containerName="main"
Sep 07 13:15:52.329748 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329698    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ec0ca8-b2ff-4278-b235-52391878c379" containerName="mt-curl-7862-a793de"
Sep 07 13:15:52.329748 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329705    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ec0ca8-b2ff-4278-b235-52391878c379" containerName="mt-curl-7862-a793de"
Sep 07 13:15:52.329889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329761    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="258abd28-361e-4645-9e46-591003f811cd" containerName="main"
Sep 07 13:15:52.329889 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.329769    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ec0ca8-b2ff-4278-b235-52391878c379" containerName="mt-curl-7862-a793de"
Sep 07 13:15:52.333059 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.333039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.335945 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.335918    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"default-dockercfg-fzswr\""
Sep 07 13:15:52.337205 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.337181    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"kube-root-ca.crt\""
Sep 07 13:15:52.337328 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.337208    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"openshift-service-ca.crt\""
Sep 07 13:15:52.337416 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.337396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"sub-test-model-ae93b0-kserve-self-signed-certs\""
Sep 07 13:15:52.347861 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.347832    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:15:52.376653 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.376653 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.376874 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.376874 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376717    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.376874 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376737    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtct\" (UniqueName: \"kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.376874 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.376861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.477985 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.477942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.477985 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.477989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478247 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478247 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478247 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478424 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtct\" (UniqueName: \"kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478424 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478533 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.478578 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.478566    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.480395 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.480371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.480662 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.480646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.494557 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.494520    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtct\" (UniqueName: \"kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct\") pod \"sub-test-model-ae93b0-kserve-6b5b646999-xtt2q\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.642752 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.642611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:15:52.929130 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.929100    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:15:52.930359 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:15:52.930328    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b9a8f68_af44_4a46_854f_a24af06656c6.slice/crio-abbd91bd482fea6374c3757245658281e8480db28461769ad41ed7cc2b632aa7 WatchSource:0}: Error finding container abbd91bd482fea6374c3757245658281e8480db28461769ad41ed7cc2b632aa7: Status 404 returned error can't find the container with id abbd91bd482fea6374c3757245658281e8480db28461769ad41ed7cc2b632aa7
Sep 07 13:15:52.968474 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:52.968441    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" event={"ID":"3b9a8f68-af44-4a46-854f-a24af06656c6","Type":"ContainerStarted","Data":"abbd91bd482fea6374c3757245658281e8480db28461769ad41ed7cc2b632aa7"}
Sep 07 13:15:53.977407 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:53.977368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" event={"ID":"3b9a8f68-af44-4a46-854f-a24af06656c6","Type":"ContainerStarted","Data":"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"}
Sep 07 13:15:53.999825 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:15:53.999764    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" podStartSLOduration=1.999745909 podStartE2EDuration="1.999745909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:53.997383847 +0000 UTC m=+1377.704166781" watchObservedRunningTime="2026-09-07 13:15:53.999745909 +0000 UTC m=+1377.706528840"
Sep 07 13:16:02.643309 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:02.642980    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:02.643309 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:02.643049    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:02.657022 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:02.656987    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:03.038230 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:03.038196    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:30.821797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:30.821764    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7862-1d38af"]
Sep 07 13:16:30.825345 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:30.825328    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:30.828030 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:30.828009    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2xgvq\""
Sep 07 13:16:30.832761 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:30.832738    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-1d38af"]
Sep 07 13:16:30.933777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:30.933740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfnzh\" (UniqueName: \"kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh\") pod \"mt-curl-7862-1d38af\" (UID: \"7a841bf6-ab71-4da4-8060-8faf3db6468f\") " pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:31.034559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:31.034519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfnzh\" (UniqueName: \"kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh\") pod \"mt-curl-7862-1d38af\" (UID: \"7a841bf6-ab71-4da4-8060-8faf3db6468f\") " pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:31.044757 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:31.044728    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfnzh\" (UniqueName: \"kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh\") pod \"mt-curl-7862-1d38af\" (UID: \"7a841bf6-ab71-4da4-8060-8faf3db6468f\") " pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:31.135240 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:31.135147    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:31.411202 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:31.411173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-1d38af"]
Sep 07 13:16:31.412768 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:16:31.412739    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a841bf6_ab71_4da4_8060_8faf3db6468f.slice/crio-d062d9c0dc4fdb81418eb0360be7d46759e317d558daaa32ccb2d47ea77b36b6 WatchSource:0}: Error finding container d062d9c0dc4fdb81418eb0360be7d46759e317d558daaa32ccb2d47ea77b36b6: Status 404 returned error can't find the container with id d062d9c0dc4fdb81418eb0360be7d46759e317d558daaa32ccb2d47ea77b36b6
Sep 07 13:16:32.191157 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:32.191118    2570 generic.go:356] "Generic (PLEG): container finished" podID="7a841bf6-ab71-4da4-8060-8faf3db6468f" containerID="4abed30e8fdbc2430b6ceb8d53a19a9e7d166bf6d234b2061acb9e24fa7249f0" exitCode=0
Sep 07 13:16:32.191587 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:32.191165    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-1d38af" event={"ID":"7a841bf6-ab71-4da4-8060-8faf3db6468f","Type":"ContainerDied","Data":"4abed30e8fdbc2430b6ceb8d53a19a9e7d166bf6d234b2061acb9e24fa7249f0"}
Sep 07 13:16:32.191587 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:32.191212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-1d38af" event={"ID":"7a841bf6-ab71-4da4-8060-8faf3db6468f","Type":"ContainerStarted","Data":"d062d9c0dc4fdb81418eb0360be7d46759e317d558daaa32ccb2d47ea77b36b6"}
Sep 07 13:16:33.335680 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.335655    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:33.359229 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.359201    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7862-1d38af_7a841bf6-ab71-4da4-8060-8faf3db6468f/mt-curl-7862-1d38af/0.log"
Sep 07 13:16:33.384547 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.384517    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7862-1d38af"]
Sep 07 13:16:33.386839 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.386817    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7862-1d38af"]
Sep 07 13:16:33.455433 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.455337    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfnzh\" (UniqueName: \"kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh\") pod \"7a841bf6-ab71-4da4-8060-8faf3db6468f\" (UID: \"7a841bf6-ab71-4da4-8060-8faf3db6468f\") "
Sep 07 13:16:33.457493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.457458    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh" (OuterVolumeSpecName: "kube-api-access-kfnzh") pod "7a841bf6-ab71-4da4-8060-8faf3db6468f" (UID: "7a841bf6-ab71-4da4-8060-8faf3db6468f"). InnerVolumeSpecName "kube-api-access-kfnzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:33.523843 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.523808    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7862-266d1a"]
Sep 07 13:16:33.524244 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.524228    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a841bf6-ab71-4da4-8060-8faf3db6468f" containerName="mt-curl-7862-1d38af"
Sep 07 13:16:33.524244 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.524244    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a841bf6-ab71-4da4-8060-8faf3db6468f" containerName="mt-curl-7862-1d38af"
Sep 07 13:16:33.524367 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.524322    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a841bf6-ab71-4da4-8060-8faf3db6468f" containerName="mt-curl-7862-1d38af"
Sep 07 13:16:33.527470 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.527449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:33.535894 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.535868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-266d1a"]
Sep 07 13:16:33.556934 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.556904    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfnzh\" (UniqueName: \"kubernetes.io/projected/7a841bf6-ab71-4da4-8060-8faf3db6468f-kube-api-access-kfnzh\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:33.658329 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.658283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbtt\" (UniqueName: \"kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt\") pod \"mt-curl-7862-266d1a\" (UID: \"554636ff-727b-45c8-863e-a1cff86c2ea2\") " pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:33.759352 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.759258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbtt\" (UniqueName: \"kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt\") pod \"mt-curl-7862-266d1a\" (UID: \"554636ff-727b-45c8-863e-a1cff86c2ea2\") " pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:33.769912 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.769887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbtt\" (UniqueName: \"kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt\") pod \"mt-curl-7862-266d1a\" (UID: \"554636ff-727b-45c8-863e-a1cff86c2ea2\") " pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:33.836904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:33.836867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:34.111982 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:34.111957    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7862-266d1a"]
Sep 07 13:16:34.113694 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:16:34.113661    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod554636ff_727b_45c8_863e_a1cff86c2ea2.slice/crio-589fe146bc0d1e4ff7f66972a5a6480507972f8cda8b3b2af7a4eea13c97bd7f WatchSource:0}: Error finding container 589fe146bc0d1e4ff7f66972a5a6480507972f8cda8b3b2af7a4eea13c97bd7f: Status 404 returned error can't find the container with id 589fe146bc0d1e4ff7f66972a5a6480507972f8cda8b3b2af7a4eea13c97bd7f
Sep 07 13:16:34.203143 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:34.203114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-266d1a" event={"ID":"554636ff-727b-45c8-863e-a1cff86c2ea2","Type":"ContainerStarted","Data":"589fe146bc0d1e4ff7f66972a5a6480507972f8cda8b3b2af7a4eea13c97bd7f"}
Sep 07 13:16:34.204391 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:34.204374    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:34.204515 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:34.204397    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d062d9c0dc4fdb81418eb0360be7d46759e317d558daaa32ccb2d47ea77b36b6"
Sep 07 13:16:34.215133 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:16:34.215107    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7862-1d38af\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="7a841bf6-ab71-4da4-8060-8faf3db6468f" pod="opendatahub/mt-curl-7862-1d38af"
Sep 07 13:16:34.814781 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:34.814698    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a841bf6-ab71-4da4-8060-8faf3db6468f" path="/var/lib/kubelet/pods/7a841bf6-ab71-4da4-8060-8faf3db6468f/volumes"
Sep 07 13:16:35.211507 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:35.211469    2570 generic.go:356] "Generic (PLEG): container finished" podID="554636ff-727b-45c8-863e-a1cff86c2ea2" containerID="6b372908ba9fb0790e631ccf4c0333739c66e55d25bd492939a3bc9c631e89d6" exitCode=0
Sep 07 13:16:35.211713 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:35.211550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7862-266d1a" event={"ID":"554636ff-727b-45c8-863e-a1cff86c2ea2","Type":"ContainerDied","Data":"6b372908ba9fb0790e631ccf4c0333739c66e55d25bd492939a3bc9c631e89d6"}
Sep 07 13:16:36.354562 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.354531    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:36.379233 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.379205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7862-266d1a_554636ff-727b-45c8-863e-a1cff86c2ea2/mt-curl-7862-266d1a/0.log"
Sep 07 13:16:36.407905 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.407871    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7862-266d1a"]
Sep 07 13:16:36.413027 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.413000    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7862-266d1a"]
Sep 07 13:16:36.486858 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.486774    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnbtt\" (UniqueName: \"kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt\") pod \"554636ff-727b-45c8-863e-a1cff86c2ea2\" (UID: \"554636ff-727b-45c8-863e-a1cff86c2ea2\") "
Sep 07 13:16:36.488884 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.488855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt" (OuterVolumeSpecName: "kube-api-access-pnbtt") pod "554636ff-727b-45c8-863e-a1cff86c2ea2" (UID: "554636ff-727b-45c8-863e-a1cff86c2ea2"). InnerVolumeSpecName "kube-api-access-pnbtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:36.588090 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.588049    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnbtt\" (UniqueName: \"kubernetes.io/projected/554636ff-727b-45c8-863e-a1cff86c2ea2-kube-api-access-pnbtt\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:36.816371 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:36.816287    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="554636ff-727b-45c8-863e-a1cff86c2ea2" path="/var/lib/kubelet/pods/554636ff-727b-45c8-863e-a1cff86c2ea2/volumes"
Sep 07 13:16:37.224828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:37.224802    2570 scope.go:117] "RemoveContainer" containerID="6b372908ba9fb0790e631ccf4c0333739c66e55d25bd492939a3bc9c631e89d6"
Sep 07 13:16:37.224828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:37.224828    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7862-266d1a"
Sep 07 13:16:39.708356 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:39.708318    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:16:54.728241 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:54.728132    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" podUID="3b9a8f68-af44-4a46-854f-a24af06656c6" containerName="main" containerID="cri-o://8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3" gracePeriod=45
Sep 07 13:16:54.987374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:54.987310    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:55.047529 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047498    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.047746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047540    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.047746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047561    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.047746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047584    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.047746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047633    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgtct\" (UniqueName: \"kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.047746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir\") pod \"3b9a8f68-af44-4a46-854f-a24af06656c6\" (UID: \"3b9a8f68-af44-4a46-854f-a24af06656c6\") "
Sep 07 13:16:55.048117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047815    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:55.048117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.047846    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home" (OuterVolumeSpecName: "home") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:55.048117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.048001    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.048117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.048022    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.048117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.048026    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:55.049774 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.049743    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm" (OuterVolumeSpecName: "dshm") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:55.049878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.049855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:16:55.049938 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.049911    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct" (OuterVolumeSpecName: "kube-api-access-vgtct") pod "3b9a8f68-af44-4a46-854f-a24af06656c6" (UID: "3b9a8f68-af44-4a46-854f-a24af06656c6"). InnerVolumeSpecName "kube-api-access-vgtct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:55.149045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.149007    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.149045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.149037    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b9a8f68-af44-4a46-854f-a24af06656c6-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.149045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.149048    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgtct\" (UniqueName: \"kubernetes.io/projected/3b9a8f68-af44-4a46-854f-a24af06656c6-kube-api-access-vgtct\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.149045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.149056    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b9a8f68-af44-4a46-854f-a24af06656c6-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:16:55.326530 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.326433    2570 generic.go:356] "Generic (PLEG): container finished" podID="3b9a8f68-af44-4a46-854f-a24af06656c6" containerID="8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3" exitCode=0
Sep 07 13:16:55.326530 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.326484    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"
Sep 07 13:16:55.326530 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.326496    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" event={"ID":"3b9a8f68-af44-4a46-854f-a24af06656c6","Type":"ContainerDied","Data":"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"}
Sep 07 13:16:55.326838 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.326546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q" event={"ID":"3b9a8f68-af44-4a46-854f-a24af06656c6","Type":"ContainerDied","Data":"abbd91bd482fea6374c3757245658281e8480db28461769ad41ed7cc2b632aa7"}
Sep 07 13:16:55.326838 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.326571    2570 scope.go:117] "RemoveContainer" containerID="8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"
Sep 07 13:16:55.336849 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.336832    2570 scope.go:117] "RemoveContainer" containerID="8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"
Sep 07 13:16:55.337136 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:16:55.337103    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3\": container with ID starting with 8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3 not found: ID does not exist" containerID="8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"
Sep 07 13:16:55.337188 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.337143    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3"} err="failed to get container status \"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3\": rpc error: code = NotFound desc = could not find container \"8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3\": container with ID starting with 8d6321cb00afeb9c357b5a85e77bb60744536e675d8c5189d5863bad8ba44ff3 not found: ID does not exist"
Sep 07 13:16:55.351707 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.351671    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:16:55.362955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:55.362924    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/sub-test-model-ae93b0-kserve-6b5b646999-xtt2q"]
Sep 07 13:16:56.815802 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:16:56.815765    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9a8f68-af44-4a46-854f-a24af06656c6" path="/var/lib/kubelet/pods/3b9a8f68-af44-4a46-854f-a24af06656c6/volumes"
Sep 07 13:17:03.414601 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.414568    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.414995    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="554636ff-727b-45c8-863e-a1cff86c2ea2" containerName="mt-curl-7862-266d1a"
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.415008    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="554636ff-727b-45c8-863e-a1cff86c2ea2" containerName="mt-curl-7862-266d1a"
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.415022    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9a8f68-af44-4a46-854f-a24af06656c6" containerName="main"
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.415029    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9a8f68-af44-4a46-854f-a24af06656c6" containerName="main"
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.415091    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9a8f68-af44-4a46-854f-a24af06656c6" containerName="main"
Sep 07 13:17:03.415259 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.415100    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="554636ff-727b-45c8-863e-a1cff86c2ea2" containerName="mt-curl-7862-266d1a"
Sep 07 13:17:03.418301 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.418280    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.420920 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.420898    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ddb9ca-serving-cert\""
Sep 07 13:17:03.433668 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.433640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:17:03.528139 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.528104    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngsj\" (UniqueName: \"kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.528308 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.528150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.528308 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.528224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.528308 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.528286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.629051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.629011    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngsj\" (UniqueName: \"kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.629051 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.629053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.629295 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.629081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.629295 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:17:03.629184    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-serving-cert: secret "maas-api-e2e-api-a-ddb9ca-serving-cert" not found
Sep 07 13:17:03.629295 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:17:03.629254    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls podName:b7ef754c-148f-4599-9d43-e01942e3b38e nodeName:}" failed. No retries permitted until 2026-09-07 13:17:04.129233478 +0000 UTC m=+1447.836016392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls") pod "maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" (UID: "b7ef754c-148f-4599-9d43-e01942e3b38e") : secret "maas-api-e2e-api-a-ddb9ca-serving-cert" not found
Sep 07 13:17:03.629295 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.629277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.629815 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.629791    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.631685 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.631666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:03.640006 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:03.639978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngsj\" (UniqueName: \"kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:04.133532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:04.133491    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:04.136121 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:04.136091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") pod \"maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:04.329061 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:04.329019    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:04.613658 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:04.613630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:17:04.615124 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:17:04.615099    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ef754c_148f_4599_9d43_e01942e3b38e.slice/crio-4e427cb37999e13d6d3a2ad64d4bc7f7447f88a986a6180acdb37c897ffd9ed7 WatchSource:0}: Error finding container 4e427cb37999e13d6d3a2ad64d4bc7f7447f88a986a6180acdb37c897ffd9ed7: Status 404 returned error can't find the container with id 4e427cb37999e13d6d3a2ad64d4bc7f7447f88a986a6180acdb37c897ffd9ed7
Sep 07 13:17:05.389706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:05.389596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" event={"ID":"b7ef754c-148f-4599-9d43-e01942e3b38e","Type":"ContainerStarted","Data":"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"}
Sep 07 13:17:05.389706 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:05.389676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" event={"ID":"b7ef754c-148f-4599-9d43-e01942e3b38e","Type":"ContainerStarted","Data":"4e427cb37999e13d6d3a2ad64d4bc7f7447f88a986a6180acdb37c897ffd9ed7"}
Sep 07 13:17:05.389907 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:05.389748    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:05.432331 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:05.432274    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" podStartSLOduration=1.986342632 podStartE2EDuration="2.432254529s" totalImagesPullingTime="445.911897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:17:05.429900198 +0000 UTC m=+1449.136683124" watchObservedRunningTime="2026-09-07 13:17:05.432254529 +0000 UTC m=+1449.139037461"
Sep 07 13:17:11.401271 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:11.401241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:17:30.591769 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.591722    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:17:30.595312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.595287    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.599301 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.599270    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"kube-root-ca.crt\""
Sep 07 13:17:30.599473 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.599269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"rate-test-model-ae93b0-kserve-self-signed-certs\""
Sep 07 13:17:30.599473 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.599348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"default-dockercfg-fzswr\""
Sep 07 13:17:30.599473 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.599357    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae93b0\"/\"openshift-service-ca.crt\""
Sep 07 13:17:30.609167 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.609140    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:17:30.785031 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.784990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.785215 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.785040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.785215 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.785125    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.785215 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.785180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxd4d\" (UniqueName: \"kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.785328 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.785238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.785328 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.785265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886538 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxd4d\" (UniqueName: \"kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886538 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886538 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886871 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886549    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886871 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.886871 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.886611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.887038 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.887007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.887078 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.887049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.887119 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.887077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.888944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.888921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.889203 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.889185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.896517 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.896491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxd4d\" (UniqueName: \"kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d\") pod \"rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") " pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:30.905340 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:30.905309    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:31.190062 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:17:31.190022    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4621c2d_fa32_41c6_a4fa_cb7a64a79a3a.slice/crio-d1722d604a309e61eab2c95a169fc59a0ee1ce139c7eb847efe3f999ac275eea WatchSource:0}: Error finding container d1722d604a309e61eab2c95a169fc59a0ee1ce139c7eb847efe3f999ac275eea: Status 404 returned error can't find the container with id d1722d604a309e61eab2c95a169fc59a0ee1ce139c7eb847efe3f999ac275eea
Sep 07 13:17:31.193469 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:31.193447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:17:31.541676 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:31.541567    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" event={"ID":"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a","Type":"ContainerStarted","Data":"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"}
Sep 07 13:17:31.541676 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:31.541638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" event={"ID":"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a","Type":"ContainerStarted","Data":"d1722d604a309e61eab2c95a169fc59a0ee1ce139c7eb847efe3f999ac275eea"}
Sep 07 13:17:31.568418 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:31.568369    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" podStartSLOduration=1.5683522650000001 podStartE2EDuration="1.568352265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:17:31.566397885 +0000 UTC m=+1475.273180817" watchObservedRunningTime="2026-09-07 13:17:31.568352265 +0000 UTC m=+1475.275135196"
Sep 07 13:17:32.537883 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.537835    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:17:32.541469 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.541451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.547681 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.546982    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0d2b4b-serving-cert\""
Sep 07 13:17:32.564391 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.564358    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:17:32.599666 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.599609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhtj\" (UniqueName: \"kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.599879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.599712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.599879 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.599758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.599996 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.599945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.700653 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.700587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhtj\" (UniqueName: \"kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.700852 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.700696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.700852 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.700837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.700975 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:17:32.700875    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-serving-cert: secret "maas-api-e2e-api-b-0d2b4b-serving-cert" not found
Sep 07 13:17:32.700975 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.700931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.700975 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:17:32.700951    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls podName:f08100da-a8f8-4d02-81d8-438c429e5fa3 nodeName:}" failed. No retries permitted until 2026-09-07 13:17:33.200927862 +0000 UTC m=+1476.907710794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls") pod "maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" (UID: "f08100da-a8f8-4d02-81d8-438c429e5fa3") : secret "maas-api-e2e-api-b-0d2b4b-serving-cert" not found
Sep 07 13:17:32.701718 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.701687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.703503 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.703477    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:32.713685 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:32.713654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhtj\" (UniqueName: \"kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:33.205009 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:33.204975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:33.207432 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:33.207410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") pod \"maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:33.456814 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:33.456720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:33.738245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:33.738221    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:17:33.740549 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:17:33.740519    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08100da_a8f8_4d02_81d8_438c429e5fa3.slice/crio-13c29e5233a73d9e1ab48b36033d6b556a2183b2c1d148050e0bc243fd2998ad WatchSource:0}: Error finding container 13c29e5233a73d9e1ab48b36033d6b556a2183b2c1d148050e0bc243fd2998ad: Status 404 returned error can't find the container with id 13c29e5233a73d9e1ab48b36033d6b556a2183b2c1d148050e0bc243fd2998ad
Sep 07 13:17:34.568569 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:34.568485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" event={"ID":"f08100da-a8f8-4d02-81d8-438c429e5fa3","Type":"ContainerStarted","Data":"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"}
Sep 07 13:17:34.568569 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:34.568541    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" event={"ID":"f08100da-a8f8-4d02-81d8-438c429e5fa3","Type":"ContainerStarted","Data":"13c29e5233a73d9e1ab48b36033d6b556a2183b2c1d148050e0bc243fd2998ad"}
Sep 07 13:17:34.568857 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:34.568575    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:34.592790 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:34.592732    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" podStartSLOduration=2.156481371 podStartE2EDuration="2.59271505s" totalImagesPullingTime="436.233679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:17:34.592003237 +0000 UTC m=+1478.298786170" watchObservedRunningTime="2026-09-07 13:17:34.59271505 +0000 UTC m=+1478.299497981"
Sep 07 13:17:40.580682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:40.580653    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:17:40.905591 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:40.905546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:40.905820 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:40.905607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:40.918726 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:40.918699    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:17:41.619527 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:17:41.619492    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:18:16.199043 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.199006    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:18:16.201557 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.199245    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerName="maas-api" containerID="cri-o://d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2" gracePeriod=30
Sep 07 13:18:16.449571 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.449487    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:18:16.515429 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.515393    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") pod \"b7ef754c-148f-4599-9d43-e01942e3b38e\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") "
Sep 07 13:18:16.515429 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.515435    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca\") pod \"b7ef754c-148f-4599-9d43-e01942e3b38e\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") "
Sep 07 13:18:16.515669 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.515473    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngsj\" (UniqueName: \"kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj\") pod \"b7ef754c-148f-4599-9d43-e01942e3b38e\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") "
Sep 07 13:18:16.515669 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.515499    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs\") pod \"b7ef754c-148f-4599-9d43-e01942e3b38e\" (UID: \"b7ef754c-148f-4599-9d43-e01942e3b38e\") "
Sep 07 13:18:16.515878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.515846    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7ef754c-148f-4599-9d43-e01942e3b38e" (UID: "b7ef754c-148f-4599-9d43-e01942e3b38e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:16.517590 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.517562    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b7ef754c-148f-4599-9d43-e01942e3b38e" (UID: "b7ef754c-148f-4599-9d43-e01942e3b38e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:16.517739 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.517589    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7ef754c-148f-4599-9d43-e01942e3b38e" (UID: "b7ef754c-148f-4599-9d43-e01942e3b38e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:16.517739 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.517641    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj" (OuterVolumeSpecName: "kube-api-access-mngsj") pod "b7ef754c-148f-4599-9d43-e01942e3b38e" (UID: "b7ef754c-148f-4599-9d43-e01942e3b38e"). InnerVolumeSpecName "kube-api-access-mngsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:16.616989 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.616957    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.616989 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.616986    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7ef754c-148f-4599-9d43-e01942e3b38e-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.616989 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.616996    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngsj\" (UniqueName: \"kubernetes.io/projected/b7ef754c-148f-4599-9d43-e01942e3b38e-kube-api-access-mngsj\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.617226 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.617008    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7ef754c-148f-4599-9d43-e01942e3b38e-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.824732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.824606    2570 generic.go:356] "Generic (PLEG): container finished" podID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerID="d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2" exitCode=0
Sep 07 13:18:16.824732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.824673    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"
Sep 07 13:18:16.824732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.824690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" event={"ID":"b7ef754c-148f-4599-9d43-e01942e3b38e","Type":"ContainerDied","Data":"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"}
Sep 07 13:18:16.825029 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.824753    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" event={"ID":"b7ef754c-148f-4599-9d43-e01942e3b38e","Type":"ContainerDied","Data":"4e427cb37999e13d6d3a2ad64d4bc7f7447f88a986a6180acdb37c897ffd9ed7"}
Sep 07 13:18:16.825029 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.824780    2570 scope.go:117] "RemoveContainer" containerID="d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"
Sep 07 13:18:16.834845 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.834829    2570 scope.go:117] "RemoveContainer" containerID="d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"
Sep 07 13:18:16.835132 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:18:16.835113    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2\": container with ID starting with d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2 not found: ID does not exist" containerID="d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"
Sep 07 13:18:16.835201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.835138    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2"} err="failed to get container status \"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2\": rpc error: code = NotFound desc = could not find container \"d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2\": container with ID starting with d1af8350d20280a29fcfc8d4443d037a51e31405ef395961311ca85b4eea19a2 not found: ID does not exist"
Sep 07 13:18:16.848284 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.848258    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:18:16.858556 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:16.858532    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4"]
Sep 07 13:18:18.816165 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:18.816130    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" path="/var/lib/kubelet/pods/b7ef754c-148f-4599-9d43-e01942e3b38e/volumes"
Sep 07 13:18:19.397007 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:19.396961    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ddb9ca-67dbf5c995-smkl4" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.83:8443/health\": context deadline exceeded"
Sep 07 13:18:24.994134 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:24.994097    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:18:30.372064 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.372029    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:18:30.372559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.372447    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerName="maas-api"
Sep 07 13:18:30.372559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.372459    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerName="maas-api"
Sep 07 13:18:30.372559 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.372517    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7ef754c-148f-4599-9d43-e01942e3b38e" containerName="maas-api"
Sep 07 13:18:30.375763 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.375739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.379083 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.379060    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-ec10ff-serving-cert\""
Sep 07 13:18:30.389531 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.389505    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:18:30.451924 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.451887    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqm52\" (UniqueName: \"kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.451924 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.451938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.452182 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.451960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.452182 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.452052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.553122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.553082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqm52\" (UniqueName: \"kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.553122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.553130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.553380 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.553234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.553380 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.553270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.553485 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:18:30.553435    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-serving-cert: secret "maas-api-e2e-ipp-a-ec10ff-serving-cert" not found
Sep 07 13:18:30.553538 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:18:30.553502    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls podName:f1be0690-a510-4040-9ddb-f39f9ecde530 nodeName:}" failed. No retries permitted until 2026-09-07 13:18:31.053486902 +0000 UTC m=+1534.760269817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls") pod "maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" (UID: "f1be0690-a510-4040-9ddb-f39f9ecde530") : secret "maas-api-e2e-ipp-a-ec10ff-serving-cert" not found
Sep 07 13:18:30.554017 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.553993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.555875 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.555852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:30.567928 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:30.567902    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqm52\" (UniqueName: \"kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:31.058127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:31.058090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:31.060425 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:31.060397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") pod \"maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:31.288964 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:31.288925    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:31.578271 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:31.578240    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:18:31.580689 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:18:31.580664    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1be0690_a510_4040_9ddb_f39f9ecde530.slice/crio-d7d89ca67cd378d1dce58c34b9fbca9e332a9cd5041cb39b1713810be6e01ef5 WatchSource:0}: Error finding container d7d89ca67cd378d1dce58c34b9fbca9e332a9cd5041cb39b1713810be6e01ef5: Status 404 returned error can't find the container with id d7d89ca67cd378d1dce58c34b9fbca9e332a9cd5041cb39b1713810be6e01ef5
Sep 07 13:18:31.916261 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:31.916228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" event={"ID":"f1be0690-a510-4040-9ddb-f39f9ecde530","Type":"ContainerStarted","Data":"d7d89ca67cd378d1dce58c34b9fbca9e332a9cd5041cb39b1713810be6e01ef5"}
Sep 07 13:18:32.923014 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:32.922979    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" event={"ID":"f1be0690-a510-4040-9ddb-f39f9ecde530","Type":"ContainerStarted","Data":"3e597284d9a70eaae48ea495c217a0516ce389fd0dc531762c3c45ff13852bda"}
Sep 07 13:18:32.923419 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:32.923086    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:32.952943 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:32.952886    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" podStartSLOduration=2.408590232 podStartE2EDuration="2.952869028s" totalImagesPullingTime="544.278796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:18:32.950953957 +0000 UTC m=+1536.657736915" watchObservedRunningTime="2026-09-07 13:18:32.952869028 +0000 UTC m=+1536.659651956"
Sep 07 13:18:38.934174 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:38.934143    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:18:40.013759 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.013718    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" podUID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" containerName="main" containerID="cri-o://9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52" gracePeriod=45
Sep 07 13:18:40.265719 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.265659    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:18:40.346032 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346001    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346206 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346044    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346206 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346083    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346206 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346191    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346229    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxd4d\" (UniqueName: \"kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d\") pod \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\" (UID: \"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a\") "
Sep 07 13:18:40.346381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346345    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:40.346545 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346481    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home" (OuterVolumeSpecName: "home") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:40.346545 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346493    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:40.346691 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346675    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.346746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346697    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tmp-dir\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.346746 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.346711    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-home\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.348318 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.348294    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm" (OuterVolumeSpecName: "dshm") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:40.348432 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.348312    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:40.348432 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.348338    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d" (OuterVolumeSpecName: "kube-api-access-sxd4d") pod "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" (UID: "a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a"). InnerVolumeSpecName "kube-api-access-sxd4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:40.448021 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.447992    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-dshm\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.448021 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.448018    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxd4d\" (UniqueName: \"kubernetes.io/projected/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-kube-api-access-sxd4d\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.448221 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.448030    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a-tls-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.478931 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.478895    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:18:40.479190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.479160    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerName="maas-api" containerID="cri-o://80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae" gracePeriod=30
Sep 07 13:18:40.575969 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.575873    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.85:8443/health\": dial tcp 10.133.0.85:8443: connect: connection refused"
Sep 07 13:18:40.721970 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.721943    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:18:40.852555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.852470    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs\") pod \"f08100da-a8f8-4d02-81d8-438c429e5fa3\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") "
Sep 07 13:18:40.852555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.852516    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmhtj\" (UniqueName: \"kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj\") pod \"f08100da-a8f8-4d02-81d8-438c429e5fa3\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") "
Sep 07 13:18:40.852555 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.852543    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") pod \"f08100da-a8f8-4d02-81d8-438c429e5fa3\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") "
Sep 07 13:18:40.852936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.852582    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca\") pod \"f08100da-a8f8-4d02-81d8-438c429e5fa3\" (UID: \"f08100da-a8f8-4d02-81d8-438c429e5fa3\") "
Sep 07 13:18:40.853009 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.852987    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f08100da-a8f8-4d02-81d8-438c429e5fa3" (UID: "f08100da-a8f8-4d02-81d8-438c429e5fa3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:40.854797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.854763    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f08100da-a8f8-4d02-81d8-438c429e5fa3" (UID: "f08100da-a8f8-4d02-81d8-438c429e5fa3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:40.854797 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.854792    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f08100da-a8f8-4d02-81d8-438c429e5fa3" (UID: "f08100da-a8f8-4d02-81d8-438c429e5fa3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:40.854949 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.854768    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj" (OuterVolumeSpecName: "kube-api-access-vmhtj") pod "f08100da-a8f8-4d02-81d8-438c429e5fa3" (UID: "f08100da-a8f8-4d02-81d8-438c429e5fa3"). InnerVolumeSpecName "kube-api-access-vmhtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:40.954004 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.953969    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f08100da-a8f8-4d02-81d8-438c429e5fa3-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.954004 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.954000    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.954004 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.954009    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmhtj\" (UniqueName: \"kubernetes.io/projected/f08100da-a8f8-4d02-81d8-438c429e5fa3-kube-api-access-vmhtj\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.954246 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.954017    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f08100da-a8f8-4d02-81d8-438c429e5fa3-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:18:40.972562 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.972529    2570 generic.go:356] "Generic (PLEG): container finished" podID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" containerID="9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52" exitCode=0
Sep 07 13:18:40.972785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.972583    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"
Sep 07 13:18:40.972785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.972638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" event={"ID":"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a","Type":"ContainerDied","Data":"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"}
Sep 07 13:18:40.972785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.972684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj" event={"ID":"a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a","Type":"ContainerDied","Data":"d1722d604a309e61eab2c95a169fc59a0ee1ce139c7eb847efe3f999ac275eea"}
Sep 07 13:18:40.972785 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.972708    2570 scope.go:117] "RemoveContainer" containerID="9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"
Sep 07 13:18:40.974293 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.974268    2570 generic.go:356] "Generic (PLEG): container finished" podID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerID="80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae" exitCode=0
Sep 07 13:18:40.974417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.974308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" event={"ID":"f08100da-a8f8-4d02-81d8-438c429e5fa3","Type":"ContainerDied","Data":"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"}
Sep 07 13:18:40.974417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.974331    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"
Sep 07 13:18:40.974417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.974362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp" event={"ID":"f08100da-a8f8-4d02-81d8-438c429e5fa3","Type":"ContainerDied","Data":"13c29e5233a73d9e1ab48b36033d6b556a2183b2c1d148050e0bc243fd2998ad"}
Sep 07 13:18:40.985341 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.985324    2570 scope.go:117] "RemoveContainer" containerID="9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"
Sep 07 13:18:40.985607 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:18:40.985590    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52\": container with ID starting with 9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52 not found: ID does not exist" containerID="9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"
Sep 07 13:18:40.985675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.985634    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52"} err="failed to get container status \"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52\": rpc error: code = NotFound desc = could not find container \"9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52\": container with ID starting with 9a3db4fde4ec8c42d4c0d0d143809bcd6b18a69ab685eff89252cc69739dba52 not found: ID does not exist"
Sep 07 13:18:40.985675 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.985653    2570 scope.go:117] "RemoveContainer" containerID="80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"
Sep 07 13:18:40.994109 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.994092    2570 scope.go:117] "RemoveContainer" containerID="80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"
Sep 07 13:18:40.994393 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:18:40.994374    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae\": container with ID starting with 80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae not found: ID does not exist" containerID="80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"
Sep 07 13:18:40.994448 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.994399    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae"} err="failed to get container status \"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae\": rpc error: code = NotFound desc = could not find container \"80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae\": container with ID starting with 80831be4609f49bb1c58bb609c25cb37982149800338bba045b186009d03cdae not found: ID does not exist"
Sep 07 13:18:40.995989 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:40.995968    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:18:41.002611 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:41.002591    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae93b0/rate-test-model-ae93b0-kserve-9cdc8d6ff-h7bpj"]
Sep 07 13:18:41.022977 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:41.022952    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:18:41.029104 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:41.029085    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d2b4b-8579c7d96c-p24tp"]
Sep 07 13:18:42.815828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:42.815791    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" path="/var/lib/kubelet/pods/a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a/volumes"
Sep 07 13:18:42.816224 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:18:42.816209    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" path="/var/lib/kubelet/pods/f08100da-a8f8-4d02-81d8-438c429e5fa3/volumes"
Sep 07 13:19:00.252127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252085    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:19:00.252676 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252658    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" containerName="main"
Sep 07 13:19:00.252773 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252678    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" containerName="main"
Sep 07 13:19:00.252773 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252704    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerName="maas-api"
Sep 07 13:19:00.252773 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252712    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerName="maas-api"
Sep 07 13:19:00.252936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252808    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08100da-a8f8-4d02-81d8-438c429e5fa3" containerName="maas-api"
Sep 07 13:19:00.252936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.252818    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4621c2d-fa32-41c6-a4fa-cb7a64a79a3a" containerName="main"
Sep 07 13:19:00.256281 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.256256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.259100 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.259077    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-688b44-serving-cert\""
Sep 07 13:19:00.272544 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.272520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:19:00.420767 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.420728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.420978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.420900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.420978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.420935    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.420978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.420951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9ks\" (UniqueName: \"kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.522241 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.522131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.522241 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.522242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.522485 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.522259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.522485 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.522274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9ks\" (UniqueName: \"kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.522956 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.522927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.524779 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.524749    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.524898 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.524793    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.531902 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.531876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9ks\" (UniqueName: \"kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks\") pod \"maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.567192 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.567157    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:00.847472 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:00.847443    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:19:00.849230 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:19:00.849198    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca99cd72_b037_445d_8e5b_01c7ea7fe832.slice/crio-0fb5118ef19a5107d9a4dcbc447581c96c04a5fde178c7e79fa46ed526b205de WatchSource:0}: Error finding container 0fb5118ef19a5107d9a4dcbc447581c96c04a5fde178c7e79fa46ed526b205de: Status 404 returned error can't find the container with id 0fb5118ef19a5107d9a4dcbc447581c96c04a5fde178c7e79fa46ed526b205de
Sep 07 13:19:01.100404 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.100319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" event={"ID":"ca99cd72-b037-445d-8e5b-01c7ea7fe832","Type":"ContainerStarted","Data":"0fb5118ef19a5107d9a4dcbc447581c96c04a5fde178c7e79fa46ed526b205de"}
Sep 07 13:19:01.149279 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.149240    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:19:01.149537 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.149507    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" podUID="31e4e590-5372-4647-812e-b803ca2b4727" containerName="maas-api" containerID="cri-o://a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9" gracePeriod=30
Sep 07 13:19:01.400272 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.400250    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:19:01.430517 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.430493    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdpgv\" (UniqueName: \"kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv\") pod \"31e4e590-5372-4647-812e-b803ca2b4727\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") "
Sep 07 13:19:01.430680 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.430528    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls\") pod \"31e4e590-5372-4647-812e-b803ca2b4727\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") "
Sep 07 13:19:01.430680 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.430555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs\") pod \"31e4e590-5372-4647-812e-b803ca2b4727\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") "
Sep 07 13:19:01.430680 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.430593    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca\") pod \"31e4e590-5372-4647-812e-b803ca2b4727\" (UID: \"31e4e590-5372-4647-812e-b803ca2b4727\") "
Sep 07 13:19:01.431307 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.431263    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31e4e590-5372-4647-812e-b803ca2b4727" (UID: "31e4e590-5372-4647-812e-b803ca2b4727"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:19:01.432979 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.432922    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv" (OuterVolumeSpecName: "kube-api-access-jdpgv") pod "31e4e590-5372-4647-812e-b803ca2b4727" (UID: "31e4e590-5372-4647-812e-b803ca2b4727"). InnerVolumeSpecName "kube-api-access-jdpgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:19:01.433187 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.433148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31e4e590-5372-4647-812e-b803ca2b4727" (UID: "31e4e590-5372-4647-812e-b803ca2b4727"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:19:01.433412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.433388    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31e4e590-5372-4647-812e-b803ca2b4727" (UID: "31e4e590-5372-4647-812e-b803ca2b4727"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:19:01.531917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.531891    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdpgv\" (UniqueName: \"kubernetes.io/projected/31e4e590-5372-4647-812e-b803ca2b4727-kube-api-access-jdpgv\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:01.532066 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.531921    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:01.532066 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.531935    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e4e590-5372-4647-812e-b803ca2b4727-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:01.532066 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:01.531949    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4e590-5372-4647-812e-b803ca2b4727-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:02.107380 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.107341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" event={"ID":"ca99cd72-b037-445d-8e5b-01c7ea7fe832","Type":"ContainerStarted","Data":"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"}
Sep 07 13:19:02.107572 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.107406    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:02.108709 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.108680    2570 generic.go:356] "Generic (PLEG): container finished" podID="31e4e590-5372-4647-812e-b803ca2b4727" containerID="a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9" exitCode=0
Sep 07 13:19:02.108808 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.108719    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"
Sep 07 13:19:02.108808 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.108763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" event={"ID":"31e4e590-5372-4647-812e-b803ca2b4727","Type":"ContainerDied","Data":"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"}
Sep 07 13:19:02.108887 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.108812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9" event={"ID":"31e4e590-5372-4647-812e-b803ca2b4727","Type":"ContainerDied","Data":"3ec8257b1785d9c97c9bdfbb03016a9d64e471a6bd10dfc39936f8ecee8c5f0e"}
Sep 07 13:19:02.108887 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.108836    2570 scope.go:117] "RemoveContainer" containerID="a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"
Sep 07 13:19:02.118102 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.118087    2570 scope.go:117] "RemoveContainer" containerID="a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"
Sep 07 13:19:02.118367 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:19:02.118346    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9\": container with ID starting with a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9 not found: ID does not exist" containerID="a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"
Sep 07 13:19:02.118444 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.118376    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9"} err="failed to get container status \"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9\": rpc error: code = NotFound desc = could not find container \"a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9\": container with ID starting with a3e1756e9cb29535157b546999ce69cdecabf4d0da20d3e5e1a012fe1c276bc9 not found: ID does not exist"
Sep 07 13:19:02.131976 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.131936    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" podStartSLOduration=1.570018058 podStartE2EDuration="2.13192067s" totalImagesPullingTime="561.902612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:19:02.130328326 +0000 UTC m=+1565.837111260" watchObservedRunningTime="2026-09-07 13:19:02.13192067 +0000 UTC m=+1565.838703651"
Sep 07 13:19:02.155186 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.155143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:19:02.159666 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.159634    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-bc4b05-8465746779-k5ng9"]
Sep 07 13:19:02.815214 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:02.815177    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e4e590-5372-4647-812e-b803ca2b4727" path="/var/lib/kubelet/pods/31e4e590-5372-4647-812e-b803ca2b4727/volumes"
Sep 07 13:19:08.122039 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:08.121999    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:19:19.831518 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:19.831480    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:19:19.832125 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:19.831737    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" podUID="5eb22175-c848-4315-aa9d-370bffd08792" containerName="maas-api" containerID="cri-o://8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62" gracePeriod=30
Sep 07 13:19:20.104570 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.104546    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:19:20.201433 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.201403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs\") pod \"5eb22175-c848-4315-aa9d-370bffd08792\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") "
Sep 07 13:19:20.201644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.201441    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca\") pod \"5eb22175-c848-4315-aa9d-370bffd08792\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") "
Sep 07 13:19:20.201644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.201483    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7hh7\" (UniqueName: \"kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7\") pod \"5eb22175-c848-4315-aa9d-370bffd08792\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") "
Sep 07 13:19:20.201644 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.201499    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") pod \"5eb22175-c848-4315-aa9d-370bffd08792\" (UID: \"5eb22175-c848-4315-aa9d-370bffd08792\") "
Sep 07 13:19:20.201890 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.201861    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5eb22175-c848-4315-aa9d-370bffd08792" (UID: "5eb22175-c848-4315-aa9d-370bffd08792"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:19:20.203649 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.203601    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5eb22175-c848-4315-aa9d-370bffd08792" (UID: "5eb22175-c848-4315-aa9d-370bffd08792"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:19:20.203762 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.203717    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7" (OuterVolumeSpecName: "kube-api-access-d7hh7") pod "5eb22175-c848-4315-aa9d-370bffd08792" (UID: "5eb22175-c848-4315-aa9d-370bffd08792"). InnerVolumeSpecName "kube-api-access-d7hh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:19:20.203952 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.203926    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5eb22175-c848-4315-aa9d-370bffd08792" (UID: "5eb22175-c848-4315-aa9d-370bffd08792"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:19:20.215225 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.215191    2570 generic.go:356] "Generic (PLEG): container finished" podID="5eb22175-c848-4315-aa9d-370bffd08792" containerID="8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62" exitCode=0
Sep 07 13:19:20.215325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.215236    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"
Sep 07 13:19:20.215325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.215264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" event={"ID":"5eb22175-c848-4315-aa9d-370bffd08792","Type":"ContainerDied","Data":"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"}
Sep 07 13:19:20.215325 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.215317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct" event={"ID":"5eb22175-c848-4315-aa9d-370bffd08792","Type":"ContainerDied","Data":"354b6e866c0e602dc8061ca74b1643d56c48a897e47ae46a6f3f2c25d85791d9"}
Sep 07 13:19:20.215448 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.215340    2570 scope.go:117] "RemoveContainer" containerID="8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"
Sep 07 13:19:20.226712 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.226661    2570 scope.go:117] "RemoveContainer" containerID="8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"
Sep 07 13:19:20.227214 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:19:20.227191    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62\": container with ID starting with 8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62 not found: ID does not exist" containerID="8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"
Sep 07 13:19:20.227288 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.227225    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62"} err="failed to get container status \"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62\": rpc error: code = NotFound desc = could not find container \"8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62\": container with ID starting with 8f2e75e5bcd14e9de94ce1b05eec5d71ef91c4e8ee14f5ce4c134d94d4a63c62 not found: ID does not exist"
Sep 07 13:19:20.242402 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.242382    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:19:20.247394 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.247370    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-45d721-6bb68487bc-rbdct"]
Sep 07 13:19:20.302549 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.302524    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7hh7\" (UniqueName: \"kubernetes.io/projected/5eb22175-c848-4315-aa9d-370bffd08792-kube-api-access-d7hh7\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:20.302549 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.302550    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:20.302745 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.302561    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5eb22175-c848-4315-aa9d-370bffd08792-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:20.302745 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.302569    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb22175-c848-4315-aa9d-370bffd08792-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:19:20.815217 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:20.815186    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb22175-c848-4315-aa9d-370bffd08792" path="/var/lib/kubelet/pods/5eb22175-c848-4315-aa9d-370bffd08792/volumes"
Sep 07 13:19:57.096029 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:57.095955    2570 scope.go:117] "RemoveContainer" containerID="a11bd8fed48a9ba05cc2b19c43af87a1f1d45b05af7a28f464ab6e4a32cce5e1"
Sep 07 13:19:57.107482 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:19:57.107059    2570 scope.go:117] "RemoveContainer" containerID="2aa27ea1b85cc6d919363d77e566141c91df33ccc9456dab78d2dd22292b02cc"
Sep 07 13:20:06.477174 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477138    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:06.477722 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477680    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e4e590-5372-4647-812e-b803ca2b4727" containerName="maas-api"
Sep 07 13:20:06.477722 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477699    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e4e590-5372-4647-812e-b803ca2b4727" containerName="maas-api"
Sep 07 13:20:06.477828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477734    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb22175-c848-4315-aa9d-370bffd08792" containerName="maas-api"
Sep 07 13:20:06.477828 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477744    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb22175-c848-4315-aa9d-370bffd08792" containerName="maas-api"
Sep 07 13:20:06.477901 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477843    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb22175-c848-4315-aa9d-370bffd08792" containerName="maas-api"
Sep 07 13:20:06.477901 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.477860    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e4e590-5372-4647-812e-b803ca2b4727" containerName="maas-api"
Sep 07 13:20:06.486306 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.486283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.494888 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.494864    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-a2a8d5-serving-cert\""
Sep 07 13:20:06.500941 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.500914    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:06.516192 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.516160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.516382 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.516230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72g2p\" (UniqueName: \"kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.516463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.516404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.516463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.516448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.617696 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.617655    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.617696 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.617698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.617971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.617733    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.617971 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.617802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72g2p\" (UniqueName: \"kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.617971 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:20:06.617885    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-serving-cert: secret "maas-api-e2e-ipp-cleanup-a2a8d5-serving-cert" not found
Sep 07 13:20:06.618119 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:20:06.617978    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls podName:bb41f7f5-9a03-49b1-b54c-4e971ed6264a nodeName:}" failed. No retries permitted until 2026-09-07 13:20:07.117957342 +0000 UTC m=+1630.824740274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" (UID: "bb41f7f5-9a03-49b1-b54c-4e971ed6264a") : secret "maas-api-e2e-ipp-cleanup-a2a8d5-serving-cert" not found
Sep 07 13:20:06.618638 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.618591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.620429 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.620404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:06.644604 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:06.644562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72g2p\" (UniqueName: \"kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:07.123362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:07.123326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:07.125817 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:07.125787    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:07.396554 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:07.396459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:07.691163 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:07.691134    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:07.693444 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:20:07.693406    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb41f7f5_9a03_49b1_b54c_4e971ed6264a.slice/crio-9e574f52b3ca3b37048f05bf4386ef24c22e98aff3d23a3513636452c26a27b9 WatchSource:0}: Error finding container 9e574f52b3ca3b37048f05bf4386ef24c22e98aff3d23a3513636452c26a27b9: Status 404 returned error can't find the container with id 9e574f52b3ca3b37048f05bf4386ef24c22e98aff3d23a3513636452c26a27b9
Sep 07 13:20:08.494577 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:08.494474    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" event={"ID":"bb41f7f5-9a03-49b1-b54c-4e971ed6264a","Type":"ContainerStarted","Data":"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"}
Sep 07 13:20:08.494577 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:08.494540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:08.494577 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:08.494562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" event={"ID":"bb41f7f5-9a03-49b1-b54c-4e971ed6264a","Type":"ContainerStarted","Data":"9e574f52b3ca3b37048f05bf4386ef24c22e98aff3d23a3513636452c26a27b9"}
Sep 07 13:20:14.506410 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:14.506370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:14.533628 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:14.533558    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" podStartSLOduration=8.054699865 podStartE2EDuration="8.533543695s" totalImagesPullingTime="478.84383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:20:08.524742821 +0000 UTC m=+1632.231525764" watchObservedRunningTime="2026-09-07 13:20:14.533543695 +0000 UTC m=+1638.240326626"
Sep 07 13:20:37.092042 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.092007    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:37.092591 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.092233    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" podUID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" containerName="maas-api" containerID="cri-o://c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19" gracePeriod=30
Sep 07 13:20:37.347146 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.347081    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:37.505938 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.505897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") pod \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") "
Sep 07 13:20:37.506127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.505954    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs\") pod \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") "
Sep 07 13:20:37.506127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.506011    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72g2p\" (UniqueName: \"kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p\") pod \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") "
Sep 07 13:20:37.506127 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.506048    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca\") pod \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\" (UID: \"bb41f7f5-9a03-49b1-b54c-4e971ed6264a\") "
Sep 07 13:20:37.506488 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.506456    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb41f7f5-9a03-49b1-b54c-4e971ed6264a" (UID: "bb41f7f5-9a03-49b1-b54c-4e971ed6264a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:20:37.508188 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.508153    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bb41f7f5-9a03-49b1-b54c-4e971ed6264a" (UID: "bb41f7f5-9a03-49b1-b54c-4e971ed6264a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:20:37.508283 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.508191    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb41f7f5-9a03-49b1-b54c-4e971ed6264a" (UID: "bb41f7f5-9a03-49b1-b54c-4e971ed6264a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:20:37.508283 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.508218    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p" (OuterVolumeSpecName: "kube-api-access-72g2p") pod "bb41f7f5-9a03-49b1-b54c-4e971ed6264a" (UID: "bb41f7f5-9a03-49b1-b54c-4e971ed6264a"). InnerVolumeSpecName "kube-api-access-72g2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:20:37.607057 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.606960    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:20:37.607057 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.606995    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:20:37.607057 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.607005    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72g2p\" (UniqueName: \"kubernetes.io/projected/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-kube-api-access-72g2p\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:20:37.607057 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.607017    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb41f7f5-9a03-49b1-b54c-4e971ed6264a-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:20:37.660168 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.660129    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" containerID="c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19" exitCode=0
Sep 07 13:20:37.660354 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.660186    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"
Sep 07 13:20:37.660354 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.660208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" event={"ID":"bb41f7f5-9a03-49b1-b54c-4e971ed6264a","Type":"ContainerDied","Data":"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"}
Sep 07 13:20:37.660354 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.660299    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc" event={"ID":"bb41f7f5-9a03-49b1-b54c-4e971ed6264a","Type":"ContainerDied","Data":"9e574f52b3ca3b37048f05bf4386ef24c22e98aff3d23a3513636452c26a27b9"}
Sep 07 13:20:37.660354 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.660326    2570 scope.go:117] "RemoveContainer" containerID="c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"
Sep 07 13:20:37.669816 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.669798    2570 scope.go:117] "RemoveContainer" containerID="c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"
Sep 07 13:20:37.670146 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:20:37.670124    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19\": container with ID starting with c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19 not found: ID does not exist" containerID="c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"
Sep 07 13:20:37.670245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.670152    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19"} err="failed to get container status \"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19\": rpc error: code = NotFound desc = could not find container \"c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19\": container with ID starting with c3cde60384843d8a3457a13791452107b8c402107fee2c2321943bb43bc27d19 not found: ID does not exist"
Sep 07 13:20:37.684304 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.684272    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:37.688796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:37.688768    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a2a8d5-856b99555-mmvcc"]
Sep 07 13:20:38.814950 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:20:38.814914    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" path="/var/lib/kubelet/pods/bb41f7f5-9a03-49b1-b54c-4e971ed6264a/volumes"
Sep 07 13:21:04.580257 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.580224    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:21:04.580702 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.580442    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" podUID="f1be0690-a510-4040-9ddb-f39f9ecde530" containerName="maas-api" containerID="cri-o://3e597284d9a70eaae48ea495c217a0516ce389fd0dc531762c3c45ff13852bda" gracePeriod=30
Sep 07 13:21:04.813199 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.813166    2570 generic.go:356] "Generic (PLEG): container finished" podID="f1be0690-a510-4040-9ddb-f39f9ecde530" containerID="3e597284d9a70eaae48ea495c217a0516ce389fd0dc531762c3c45ff13852bda" exitCode=0
Sep 07 13:21:04.816072 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.816046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" event={"ID":"f1be0690-a510-4040-9ddb-f39f9ecde530","Type":"ContainerDied","Data":"3e597284d9a70eaae48ea495c217a0516ce389fd0dc531762c3c45ff13852bda"}
Sep 07 13:21:04.832487 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.832422    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:21:04.965548 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.965516    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca\") pod \"f1be0690-a510-4040-9ddb-f39f9ecde530\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") "
Sep 07 13:21:04.965768 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.965652    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") pod \"f1be0690-a510-4040-9ddb-f39f9ecde530\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") "
Sep 07 13:21:04.965768 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.965694    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs\") pod \"f1be0690-a510-4040-9ddb-f39f9ecde530\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") "
Sep 07 13:21:04.965768 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.965759    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqm52\" (UniqueName: \"kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52\") pod \"f1be0690-a510-4040-9ddb-f39f9ecde530\" (UID: \"f1be0690-a510-4040-9ddb-f39f9ecde530\") "
Sep 07 13:21:04.965936 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.965904    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1be0690-a510-4040-9ddb-f39f9ecde530" (UID: "f1be0690-a510-4040-9ddb-f39f9ecde530"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:21:04.966047 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.966027    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be0690-a510-4040-9ddb-f39f9ecde530-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:21:04.967860 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.967822    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1be0690-a510-4040-9ddb-f39f9ecde530" (UID: "f1be0690-a510-4040-9ddb-f39f9ecde530"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:21:04.967973 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.967900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1be0690-a510-4040-9ddb-f39f9ecde530" (UID: "f1be0690-a510-4040-9ddb-f39f9ecde530"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:21:04.967973 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:04.967941    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52" (OuterVolumeSpecName: "kube-api-access-kqm52") pod "f1be0690-a510-4040-9ddb-f39f9ecde530" (UID: "f1be0690-a510-4040-9ddb-f39f9ecde530"). InnerVolumeSpecName "kube-api-access-kqm52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:21:05.066493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.066456    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:21:05.066493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.066485    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1be0690-a510-4040-9ddb-f39f9ecde530-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:21:05.066493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.066495    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqm52\" (UniqueName: \"kubernetes.io/projected/f1be0690-a510-4040-9ddb-f39f9ecde530-kube-api-access-kqm52\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:21:05.819824 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.819794    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"
Sep 07 13:21:05.820254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.819830    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p" event={"ID":"f1be0690-a510-4040-9ddb-f39f9ecde530","Type":"ContainerDied","Data":"d7d89ca67cd378d1dce58c34b9fbca9e332a9cd5041cb39b1713810be6e01ef5"}
Sep 07 13:21:05.820254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.819889    2570 scope.go:117] "RemoveContainer" containerID="3e597284d9a70eaae48ea495c217a0516ce389fd0dc531762c3c45ff13852bda"
Sep 07 13:21:05.848381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.848341    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:21:05.856180 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:05.856144    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-ec10ff-566bc97544-km99p"]
Sep 07 13:21:06.815396 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:06.815361    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1be0690-a510-4040-9ddb-f39f9ecde530" path="/var/lib/kubelet/pods/f1be0690-a510-4040-9ddb-f39f9ecde530/volumes"
Sep 07 13:21:57.153081 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:21:57.153048    2570 scope.go:117] "RemoveContainer" containerID="53ee2f26e9b0d6338a72bc11d1035af4b6909f490ac955dd36bc17cccaf68c9c"
Sep 07 13:22:30.706468 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:30.706427    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:22:30.707070 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:30.706728    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" podUID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" containerName="maas-api" containerID="cri-o://b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49" gracePeriod=30
Sep 07 13:22:30.970947 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:30.970879    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:22:31.106871 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.106831    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k9ks\" (UniqueName: \"kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks\") pod \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") "
Sep 07 13:22:31.107045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.106932    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs\") pod \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") "
Sep 07 13:22:31.107045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.106950    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls\") pod \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") "
Sep 07 13:22:31.107045 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.106984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca\") pod \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\" (UID: \"ca99cd72-b037-445d-8e5b-01c7ea7fe832\") "
Sep 07 13:22:31.107453 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.107413    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca99cd72-b037-445d-8e5b-01c7ea7fe832" (UID: "ca99cd72-b037-445d-8e5b-01c7ea7fe832"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:22:31.109162 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.109124    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca99cd72-b037-445d-8e5b-01c7ea7fe832" (UID: "ca99cd72-b037-445d-8e5b-01c7ea7fe832"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:22:31.109272 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.109134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks" (OuterVolumeSpecName: "kube-api-access-4k9ks") pod "ca99cd72-b037-445d-8e5b-01c7ea7fe832" (UID: "ca99cd72-b037-445d-8e5b-01c7ea7fe832"). InnerVolumeSpecName "kube-api-access-4k9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:22:31.109272 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.109134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca99cd72-b037-445d-8e5b-01c7ea7fe832" (UID: "ca99cd72-b037-445d-8e5b-01c7ea7fe832"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:22:31.207777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.207737    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k9ks\" (UniqueName: \"kubernetes.io/projected/ca99cd72-b037-445d-8e5b-01c7ea7fe832-kube-api-access-4k9ks\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:31.207777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.207768    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:31.207777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.207778    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca99cd72-b037-445d-8e5b-01c7ea7fe832-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:31.207777 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.207786    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca99cd72-b037-445d-8e5b-01c7ea7fe832-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:31.283510 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.283424    2570 generic.go:356] "Generic (PLEG): container finished" podID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" containerID="b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49" exitCode=0
Sep 07 13:22:31.283510 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.283467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"
Sep 07 13:22:31.283729 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.283507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" event={"ID":"ca99cd72-b037-445d-8e5b-01c7ea7fe832","Type":"ContainerDied","Data":"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"}
Sep 07 13:22:31.283729 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.283562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr" event={"ID":"ca99cd72-b037-445d-8e5b-01c7ea7fe832","Type":"ContainerDied","Data":"0fb5118ef19a5107d9a4dcbc447581c96c04a5fde178c7e79fa46ed526b205de"}
Sep 07 13:22:31.283729 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.283579    2570 scope.go:117] "RemoveContainer" containerID="b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"
Sep 07 13:22:31.293192 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.293177    2570 scope.go:117] "RemoveContainer" containerID="b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"
Sep 07 13:22:31.293468 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:22:31.293449    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49\": container with ID starting with b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49 not found: ID does not exist" containerID="b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"
Sep 07 13:22:31.293507 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.293477    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49"} err="failed to get container status \"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49\": rpc error: code = NotFound desc = could not find container \"b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49\": container with ID starting with b353ffa2440608b823492172870f8f00ab7b9db01033421572205dd964461d49 not found: ID does not exist"
Sep 07 13:22:31.307927 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.307898    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:22:31.313317 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:31.313296    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-688b44-55ff6fd7d6-bz6jr"]
Sep 07 13:22:32.817245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:32.817197    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" path="/var/lib/kubelet/pods/ca99cd72-b037-445d-8e5b-01c7ea7fe832/volumes"
Sep 07 13:22:49.578141 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.578055    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:22:49.578634 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.578316    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" podUID="37454922-33b4-416e-9cff-fd17e81e8e31" containerName="maas-api" containerID="cri-o://d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c" gracePeriod=30
Sep 07 13:22:49.833312 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.833240    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:22:49.861800 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.861761    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs\") pod \"37454922-33b4-416e-9cff-fd17e81e8e31\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") "
Sep 07 13:22:49.861990 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.861844    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls\") pod \"37454922-33b4-416e-9cff-fd17e81e8e31\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") "
Sep 07 13:22:49.861990 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.861911    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca\") pod \"37454922-33b4-416e-9cff-fd17e81e8e31\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") "
Sep 07 13:22:49.861990 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.861936    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4xmw\" (UniqueName: \"kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw\") pod \"37454922-33b4-416e-9cff-fd17e81e8e31\" (UID: \"37454922-33b4-416e-9cff-fd17e81e8e31\") "
Sep 07 13:22:49.862381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.862292    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37454922-33b4-416e-9cff-fd17e81e8e31" (UID: "37454922-33b4-416e-9cff-fd17e81e8e31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:22:49.864227 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.864195    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "37454922-33b4-416e-9cff-fd17e81e8e31" (UID: "37454922-33b4-416e-9cff-fd17e81e8e31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:22:49.864338 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.864222    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37454922-33b4-416e-9cff-fd17e81e8e31" (UID: "37454922-33b4-416e-9cff-fd17e81e8e31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:22:49.864385 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.864335    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw" (OuterVolumeSpecName: "kube-api-access-t4xmw") pod "37454922-33b4-416e-9cff-fd17e81e8e31" (UID: "37454922-33b4-416e-9cff-fd17e81e8e31"). InnerVolumeSpecName "kube-api-access-t4xmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:22:49.963518 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.963476    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:49.963518 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.963513    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37454922-33b4-416e-9cff-fd17e81e8e31-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:49.963518 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.963525    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37454922-33b4-416e-9cff-fd17e81e8e31-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:49.963792 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:49.963540    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4xmw\" (UniqueName: \"kubernetes.io/projected/37454922-33b4-416e-9cff-fd17e81e8e31-kube-api-access-t4xmw\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:22:50.390149 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.390113    2570 generic.go:356] "Generic (PLEG): container finished" podID="37454922-33b4-416e-9cff-fd17e81e8e31" containerID="d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c" exitCode=0
Sep 07 13:22:50.390332 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.390155    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"
Sep 07 13:22:50.390332 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.390203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" event={"ID":"37454922-33b4-416e-9cff-fd17e81e8e31","Type":"ContainerDied","Data":"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"}
Sep 07 13:22:50.390332 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.390248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5" event={"ID":"37454922-33b4-416e-9cff-fd17e81e8e31","Type":"ContainerDied","Data":"dac257596811eb2c2095614bbe06dfff7bbd389afe552ec49105b74ecc365719"}
Sep 07 13:22:50.390332 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.390274    2570 scope.go:117] "RemoveContainer" containerID="d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"
Sep 07 13:22:50.400815 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.400794    2570 scope.go:117] "RemoveContainer" containerID="d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"
Sep 07 13:22:50.401181 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:22:50.401158    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c\": container with ID starting with d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c not found: ID does not exist" containerID="d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"
Sep 07 13:22:50.401248 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.401194    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c"} err="failed to get container status \"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c\": rpc error: code = NotFound desc = could not find container \"d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c\": container with ID starting with d7afdf952bfd52895cd67660cb5085749293b93ba4d426ba89ef7b7d3384455c not found: ID does not exist"
Sep 07 13:22:50.417812 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.417774    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:22:50.426891 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.426858    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-aa813e-65bd95d949-nkfc5"]
Sep 07 13:22:50.814502 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:50.814457    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37454922-33b4-416e-9cff-fd17e81e8e31" path="/var/lib/kubelet/pods/37454922-33b4-416e-9cff-fd17e81e8e31/volumes"
Sep 07 13:22:57.178169 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:22:57.178132    2570 scope.go:117] "RemoveContainer" containerID="4abed30e8fdbc2430b6ceb8d53a19a9e7d166bf6d234b2061acb9e24fa7249f0"
Sep 07 13:23:08.100819 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.100786    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:23:08.101284 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.101088    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" podUID="4463e6de-3d70-4272-a28f-e346b34eac6f" containerName="maas-api" containerID="cri-o://1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc" gracePeriod=30
Sep 07 13:23:08.345374 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.345294    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:23:08.426315 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426280    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs\") pod \"4463e6de-3d70-4272-a28f-e346b34eac6f\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") "
Sep 07 13:23:08.426493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426323    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca\") pod \"4463e6de-3d70-4272-a28f-e346b34eac6f\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") "
Sep 07 13:23:08.426493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426457    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls\") pod \"4463e6de-3d70-4272-a28f-e346b34eac6f\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") "
Sep 07 13:23:08.426662 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426506    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjg8\" (UniqueName: \"kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8\") pod \"4463e6de-3d70-4272-a28f-e346b34eac6f\" (UID: \"4463e6de-3d70-4272-a28f-e346b34eac6f\") "
Sep 07 13:23:08.426740 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426717    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4463e6de-3d70-4272-a28f-e346b34eac6f" (UID: "4463e6de-3d70-4272-a28f-e346b34eac6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:23:08.426819 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.426799    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4463e6de-3d70-4272-a28f-e346b34eac6f-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:08.428448 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.428423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4463e6de-3d70-4272-a28f-e346b34eac6f" (UID: "4463e6de-3d70-4272-a28f-e346b34eac6f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:23:08.428545 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.428484    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4463e6de-3d70-4272-a28f-e346b34eac6f" (UID: "4463e6de-3d70-4272-a28f-e346b34eac6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:23:08.428588 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.428563    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8" (OuterVolumeSpecName: "kube-api-access-7jjg8") pod "4463e6de-3d70-4272-a28f-e346b34eac6f" (UID: "4463e6de-3d70-4272-a28f-e346b34eac6f"). InnerVolumeSpecName "kube-api-access-7jjg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:08.489229 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.489198    2570 generic.go:356] "Generic (PLEG): container finished" podID="4463e6de-3d70-4272-a28f-e346b34eac6f" containerID="1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc" exitCode=0
Sep 07 13:23:08.489412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.489246    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"
Sep 07 13:23:08.489412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.489286    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" event={"ID":"4463e6de-3d70-4272-a28f-e346b34eac6f","Type":"ContainerDied","Data":"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"}
Sep 07 13:23:08.489412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.489345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd" event={"ID":"4463e6de-3d70-4272-a28f-e346b34eac6f","Type":"ContainerDied","Data":"b639c8104f9ba9e8097f2045f1f0cb9fa001b878f5396f61507270e652b61a33"}
Sep 07 13:23:08.489412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.489368    2570 scope.go:117] "RemoveContainer" containerID="1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"
Sep 07 13:23:08.499067 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.499046    2570 scope.go:117] "RemoveContainer" containerID="1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"
Sep 07 13:23:08.499337 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:23:08.499318    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc\": container with ID starting with 1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc not found: ID does not exist" containerID="1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"
Sep 07 13:23:08.499381 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.499347    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc"} err="failed to get container status \"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc\": rpc error: code = NotFound desc = could not find container \"1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc\": container with ID starting with 1c47fd188f0f2c90e45749f3e32785962e019bcf6e9ad075e993ab9da8c3dccc not found: ID does not exist"
Sep 07 13:23:08.516100 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.516064    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:23:08.520894 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.520865    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae93b0-757c67ffc7-x6fcd"]
Sep 07 13:23:08.527796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.527767    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:08.527796 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.527795    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjg8\" (UniqueName: \"kubernetes.io/projected/4463e6de-3d70-4272-a28f-e346b34eac6f-kube-api-access-7jjg8\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:08.527963 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.527809    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4463e6de-3d70-4272-a28f-e346b34eac6f-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:08.814955 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:08.814874    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4463e6de-3d70-4272-a28f-e346b34eac6f" path="/var/lib/kubelet/pods/4463e6de-3d70-4272-a28f-e346b34eac6f/volumes"
Sep 07 13:23:18.794205 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:18.794169    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:23:18.796610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:18.794369    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" podUID="19b678df-8266-4dfd-932a-30a380cca350" containerName="manager" containerID="cri-o://308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43" gracePeriod=30
Sep 07 13:23:19.046474 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.046391    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:23:19.122468 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.122433    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert\") pod \"19b678df-8266-4dfd-932a-30a380cca350\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") "
Sep 07 13:23:19.122682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.122489    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs\") pod \"19b678df-8266-4dfd-932a-30a380cca350\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") "
Sep 07 13:23:19.122682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.122531    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhnvb\" (UniqueName: \"kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb\") pod \"19b678df-8266-4dfd-932a-30a380cca350\" (UID: \"19b678df-8266-4dfd-932a-30a380cca350\") "
Sep 07 13:23:19.124747 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.124708    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19b678df-8266-4dfd-932a-30a380cca350" (UID: "19b678df-8266-4dfd-932a-30a380cca350"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:23:19.125114 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.125045    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "19b678df-8266-4dfd-932a-30a380cca350" (UID: "19b678df-8266-4dfd-932a-30a380cca350"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:23:19.125114 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.125102    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb" (OuterVolumeSpecName: "kube-api-access-qhnvb") pod "19b678df-8266-4dfd-932a-30a380cca350" (UID: "19b678df-8266-4dfd-932a-30a380cca350"). InnerVolumeSpecName "kube-api-access-qhnvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:19.223933 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.223894    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:19.223933 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.223927    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhnvb\" (UniqueName: \"kubernetes.io/projected/19b678df-8266-4dfd-932a-30a380cca350-kube-api-access-qhnvb\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:19.223933 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.223940    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19b678df-8266-4dfd-932a-30a380cca350-webhook-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:23:19.551297 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.551263    2570 generic.go:356] "Generic (PLEG): container finished" podID="19b678df-8266-4dfd-932a-30a380cca350" containerID="308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43" exitCode=0
Sep 07 13:23:19.551508 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.551307    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4"
Sep 07 13:23:19.551508 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.551352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" event={"ID":"19b678df-8266-4dfd-932a-30a380cca350","Type":"ContainerDied","Data":"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"}
Sep 07 13:23:19.551508 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.551414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-pv5d4" event={"ID":"19b678df-8266-4dfd-932a-30a380cca350","Type":"ContainerDied","Data":"4c446ec6331440bad5f41fcdf72b44ec64e14aedac0e1a28b3210fd13fce850b"}
Sep 07 13:23:19.551508 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.551444    2570 scope.go:117] "RemoveContainer" containerID="308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"
Sep 07 13:23:19.561692 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.561671    2570 scope.go:117] "RemoveContainer" containerID="308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"
Sep 07 13:23:19.561968 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:23:19.561948    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43\": container with ID starting with 308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43 not found: ID does not exist" containerID="308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"
Sep 07 13:23:19.562028 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.561981    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43"} err="failed to get container status \"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43\": rpc error: code = NotFound desc = could not find container \"308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43\": container with ID starting with 308c0a0515deeddae422d7a57d67a6c7b7876cdf461f7b2f6fdc7c69d3747f43 not found: ID does not exist"
Sep 07 13:23:19.575289 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.575266    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:23:19.577287 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:19.577260    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-pv5d4"]
Sep 07 13:23:20.815290 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:23:20.815256    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b678df-8266-4dfd-932a-30a380cca350" path="/var/lib/kubelet/pods/19b678df-8266-4dfd-932a-30a380cca350/volumes"
Sep 07 13:24:20.430496 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430413    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430832    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1be0690-a510-4040-9ddb-f39f9ecde530" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430847    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1be0690-a510-4040-9ddb-f39f9ecde530" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430855    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430861    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430871    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430877    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430884    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37454922-33b4-416e-9cff-fd17e81e8e31" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430890    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="37454922-33b4-416e-9cff-fd17e81e8e31" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b678df-8266-4dfd-932a-30a380cca350" containerName="manager"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430901    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b678df-8266-4dfd-932a-30a380cca350" containerName="manager"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430911    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4463e6de-3d70-4272-a28f-e346b34eac6f" containerName="maas-api"
Sep 07 13:24:20.430965 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430916    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4463e6de-3d70-4272-a28f-e346b34eac6f" containerName="maas-api"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430978    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="37454922-33b4-416e-9cff-fd17e81e8e31" containerName="maas-api"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430987    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b678df-8266-4dfd-932a-30a380cca350" containerName="manager"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430993    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4463e6de-3d70-4272-a28f-e346b34eac6f" containerName="maas-api"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.430998    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1be0690-a510-4040-9ddb-f39f9ecde530" containerName="maas-api"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.431003    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb41f7f5-9a03-49b1-b54c-4e971ed6264a" containerName="maas-api"
Sep 07 13:24:20.431326 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.431009    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca99cd72-b037-445d-8e5b-01c7ea7fe832" containerName="maas-api"
Sep 07 13:24:20.433960 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.433939    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.437788 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.437768    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 13:24:20.437788 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.437778    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 13:24:20.437940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.437769    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 13:24:20.437940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.437857    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjlz9\""
Sep 07 13:24:20.447118 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.447092    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:20.531060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.530994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.531245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.531079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.531245 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.531108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-829k5\" (UniqueName: \"kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.631663 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.631595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.631663 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.631661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.631892 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.631683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-829k5\" (UniqueName: \"kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.634338 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.634306    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.634338 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.634326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.640632 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.640593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-829k5\" (UniqueName: \"kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5\") pod \"maas-controller-7f4d8b5df-ltchz\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") " pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:20.743978 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:20.743887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:21.016961 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.016938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:21.019101 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:24:21.019070    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3716c124_1b59_47f9_b1ea_a249bbda6159.slice/crio-bd5ad753c25da5347877effd8cc834372c54ef1e839c3a4f368d53a539292b66 WatchSource:0}: Error finding container bd5ad753c25da5347877effd8cc834372c54ef1e839c3a4f368d53a539292b66: Status 404 returned error can't find the container with id bd5ad753c25da5347877effd8cc834372c54ef1e839c3a4f368d53a539292b66
Sep 07 13:24:21.020311 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.020295    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:24:21.885833 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.885728    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" event={"ID":"3716c124-1b59-47f9-b1ea-a249bbda6159","Type":"ContainerStarted","Data":"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"}
Sep 07 13:24:21.885833 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.885789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" event={"ID":"3716c124-1b59-47f9-b1ea-a249bbda6159","Type":"ContainerStarted","Data":"bd5ad753c25da5347877effd8cc834372c54ef1e839c3a4f368d53a539292b66"}
Sep 07 13:24:21.885833 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.885810    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:21.909309 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:21.909254    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" podStartSLOduration=1.349833118 podStartE2EDuration="1.909236161s" totalImagesPullingTime="559.403043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:24:21.90844957 +0000 UTC m=+1885.615232497" watchObservedRunningTime="2026-09-07 13:24:21.909236161 +0000 UTC m=+1885.616019091"
Sep 07 13:24:32.893317 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:32.893287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:44.569980 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.569946    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:44.570543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.570131    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" podUID="3716c124-1b59-47f9-b1ea-a249bbda6159" containerName="manager" containerID="cri-o://45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd" gracePeriod=30
Sep 07 13:24:44.809695 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.809666    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:44.927387 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.927360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert\") pod \"3716c124-1b59-47f9-b1ea-a249bbda6159\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") "
Sep 07 13:24:44.927564 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.927436    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs\") pod \"3716c124-1b59-47f9-b1ea-a249bbda6159\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") "
Sep 07 13:24:44.927564 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.927464    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-829k5\" (UniqueName: \"kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5\") pod \"3716c124-1b59-47f9-b1ea-a249bbda6159\" (UID: \"3716c124-1b59-47f9-b1ea-a249bbda6159\") "
Sep 07 13:24:44.929551 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.929509    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3716c124-1b59-47f9-b1ea-a249bbda6159" (UID: "3716c124-1b59-47f9-b1ea-a249bbda6159"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:24:44.929674 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.929578    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3716c124-1b59-47f9-b1ea-a249bbda6159" (UID: "3716c124-1b59-47f9-b1ea-a249bbda6159"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:24:44.929674 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:44.929594    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5" (OuterVolumeSpecName: "kube-api-access-829k5") pod "3716c124-1b59-47f9-b1ea-a249bbda6159" (UID: "3716c124-1b59-47f9-b1ea-a249bbda6159"). InnerVolumeSpecName "kube-api-access-829k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:24:45.004761 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.004725    2570 generic.go:356] "Generic (PLEG): container finished" podID="3716c124-1b59-47f9-b1ea-a249bbda6159" containerID="45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd" exitCode=0
Sep 07 13:24:45.004940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.004781    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-ltchz"
Sep 07 13:24:45.004940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.004819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" event={"ID":"3716c124-1b59-47f9-b1ea-a249bbda6159","Type":"ContainerDied","Data":"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"}
Sep 07 13:24:45.004940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.004884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-ltchz" event={"ID":"3716c124-1b59-47f9-b1ea-a249bbda6159","Type":"ContainerDied","Data":"bd5ad753c25da5347877effd8cc834372c54ef1e839c3a4f368d53a539292b66"}
Sep 07 13:24:45.004940 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.004908    2570 scope.go:117] "RemoveContainer" containerID="45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"
Sep 07 13:24:45.014218 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.014200    2570 scope.go:117] "RemoveContainer" containerID="45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"
Sep 07 13:24:45.014492 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:24:45.014474    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd\": container with ID starting with 45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd not found: ID does not exist" containerID="45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"
Sep 07 13:24:45.014542 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.014501    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd"} err="failed to get container status \"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd\": rpc error: code = NotFound desc = could not find container \"45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd\": container with ID starting with 45b833144b12397e5c94b3d254f207f36ac7b70d05cf91221098742eb50d8ebd not found: ID does not exist"
Sep 07 13:24:45.028262 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.028237    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-829k5\" (UniqueName: \"kubernetes.io/projected/3716c124-1b59-47f9-b1ea-a249bbda6159-kube-api-access-829k5\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:24:45.028262 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.028262    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-webhook-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:24:45.028407 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.028271    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3716c124-1b59-47f9-b1ea-a249bbda6159-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:24:45.029455 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.029436    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:45.034252 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.034227    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-ltchz"]
Sep 07 13:24:45.936815 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.936779    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-czjcp"]
Sep 07 13:24:45.937190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.937097    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3716c124-1b59-47f9-b1ea-a249bbda6159" containerName="manager"
Sep 07 13:24:45.937190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.937108    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3716c124-1b59-47f9-b1ea-a249bbda6159" containerName="manager"
Sep 07 13:24:45.937190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.937173    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3716c124-1b59-47f9-b1ea-a249bbda6159" containerName="manager"
Sep 07 13:24:45.940058 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.940041    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:45.944250 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.944225    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 13:24:45.944436 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.944249    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 13:24:45.944565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.944249    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pjlz9\""
Sep 07 13:24:45.944565 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.944247    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 13:24:45.952676 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:45.952650    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-czjcp"]
Sep 07 13:24:46.036412 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.036372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-metrics-certs\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.036603 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.036461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n2nt\" (UniqueName: \"kubernetes.io/projected/f89af3c1-4c36-413d-adc0-04c963e34c20-kube-api-access-8n2nt\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.036603 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.036492    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-webhook-cert\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.137534 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.137482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n2nt\" (UniqueName: \"kubernetes.io/projected/f89af3c1-4c36-413d-adc0-04c963e34c20-kube-api-access-8n2nt\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.137534 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.137546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-webhook-cert\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.137812 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.137614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-metrics-certs\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.140137 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.140105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-metrics-certs\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.140254 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.140155    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f89af3c1-4c36-413d-adc0-04c963e34c20-webhook-cert\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.147293 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.147268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n2nt\" (UniqueName: \"kubernetes.io/projected/f89af3c1-4c36-413d-adc0-04c963e34c20-kube-api-access-8n2nt\") pod \"maas-controller-7f4d8b5df-czjcp\" (UID: \"f89af3c1-4c36-413d-adc0-04c963e34c20\") " pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.253307 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.253215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:46.535198 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.535171    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f4d8b5df-czjcp"]
Sep 07 13:24:46.537160 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:24:46.537134    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89af3c1_4c36_413d_adc0_04c963e34c20.slice/crio-f9119eb6a743887bd228ce1ac0dfba66fc563935250fc2cd5be8fa7f7ca3bf05 WatchSource:0}: Error finding container f9119eb6a743887bd228ce1ac0dfba66fc563935250fc2cd5be8fa7f7ca3bf05: Status 404 returned error can't find the container with id f9119eb6a743887bd228ce1ac0dfba66fc563935250fc2cd5be8fa7f7ca3bf05
Sep 07 13:24:46.814583 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:46.814502    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3716c124-1b59-47f9-b1ea-a249bbda6159" path="/var/lib/kubelet/pods/3716c124-1b59-47f9-b1ea-a249bbda6159/volumes"
Sep 07 13:24:47.019803 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:47.019769    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-czjcp" event={"ID":"f89af3c1-4c36-413d-adc0-04c963e34c20","Type":"ContainerStarted","Data":"7900d06a6ad80102ea419764738979eeefb202ee8147e58c7c92d0f6219e93fb"}
Sep 07 13:24:47.020214 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:47.019825    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f4d8b5df-czjcp" event={"ID":"f89af3c1-4c36-413d-adc0-04c963e34c20","Type":"ContainerStarted","Data":"f9119eb6a743887bd228ce1ac0dfba66fc563935250fc2cd5be8fa7f7ca3bf05"}
Sep 07 13:24:47.020214 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:47.019862    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:24:47.049536 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:47.049463    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f4d8b5df-czjcp" podStartSLOduration=1.657726733 podStartE2EDuration="2.049444798s" totalImagesPullingTime="391.718065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:24:47.048452082 +0000 UTC m=+1910.755235041" watchObservedRunningTime="2026-09-07 13:24:47.049444798 +0000 UTC m=+1910.756227744"
Sep 07 13:24:58.027181 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:24:58.027143    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f4d8b5df-czjcp"
Sep 07 13:26:00.135365 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.135271    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:26:00.135882 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.135512    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" podUID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" containerName="manager" containerID="cri-o://ced1faaefe05f4697c40b06fef76ccbee3729bb1a99a3d97ea336edb28f9f7c4" gracePeriod=10
Sep 07 13:26:00.410286 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.410249    2570 generic.go:356] "Generic (PLEG): container finished" podID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" containerID="ced1faaefe05f4697c40b06fef76ccbee3729bb1a99a3d97ea336edb28f9f7c4" exitCode=0
Sep 07 13:26:00.410426 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.410319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" event={"ID":"b4308a5a-1fc1-46e2-bea2-04dd2b60e054","Type":"ContainerDied","Data":"ced1faaefe05f4697c40b06fef76ccbee3729bb1a99a3d97ea336edb28f9f7c4"}
Sep 07 13:26:00.494579 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.494550    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:26:00.572207 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.572171    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume\") pod \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") "
Sep 07 13:26:00.572367 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.572261    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7jml\" (UniqueName: \"kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml\") pod \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\" (UID: \"b4308a5a-1fc1-46e2-bea2-04dd2b60e054\") "
Sep 07 13:26:00.572516 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.572494    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b4308a5a-1fc1-46e2-bea2-04dd2b60e054" (UID: "b4308a5a-1fc1-46e2-bea2-04dd2b60e054"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:00.574390 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.574369    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml" (OuterVolumeSpecName: "kube-api-access-l7jml") pod "b4308a5a-1fc1-46e2-bea2-04dd2b60e054" (UID: "b4308a5a-1fc1-46e2-bea2-04dd2b60e054"). InnerVolumeSpecName "kube-api-access-l7jml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:00.673181 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.673095    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-extensions-socket-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:26:00.673181 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:00.673125    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7jml\" (UniqueName: \"kubernetes.io/projected/b4308a5a-1fc1-46e2-bea2-04dd2b60e054-kube-api-access-l7jml\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:26:01.418156 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:01.418121    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"
Sep 07 13:26:01.418156 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:01.418137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms" event={"ID":"b4308a5a-1fc1-46e2-bea2-04dd2b60e054","Type":"ContainerDied","Data":"dfce80b7ce41ab5266d2a26ea4b7b739f157971bc2d22987761c4bd4ce6bf385"}
Sep 07 13:26:01.418672 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:01.418208    2570 scope.go:117] "RemoveContainer" containerID="ced1faaefe05f4697c40b06fef76ccbee3729bb1a99a3d97ea336edb28f9f7c4"
Sep 07 13:26:01.442449 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:01.442421    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:26:01.451272 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:01.451250    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g7zms"]
Sep 07 13:26:02.814743 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:26:02.814709    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" path="/var/lib/kubelet/pods/b4308a5a-1fc1-46e2-bea2-04dd2b60e054/volumes"
Sep 07 13:27:00.874118 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.874087    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"]
Sep 07 13:27:00.874543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.874407    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" containerName="manager"
Sep 07 13:27:00.874543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.874417    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" containerName="manager"
Sep 07 13:27:00.874543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.874489    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4308a5a-1fc1-46e2-bea2-04dd2b60e054" containerName="manager"
Sep 07 13:27:00.878737 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.878714    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:00.881610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.881589    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nqg55\""
Sep 07 13:27:00.892896 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.892874    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"]
Sep 07 13:27:00.974764 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.974727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6edd2b42-b521-4020-b3b7-1b9938a76673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:00.974944 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:00.974820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgpfs\" (UniqueName: \"kubernetes.io/projected/6edd2b42-b521-4020-b3b7-1b9938a76673-kube-api-access-wgpfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.075434 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.075395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgpfs\" (UniqueName: \"kubernetes.io/projected/6edd2b42-b521-4020-b3b7-1b9938a76673-kube-api-access-wgpfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.075679 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.075458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6edd2b42-b521-4020-b3b7-1b9938a76673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.075846 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.075829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6edd2b42-b521-4020-b3b7-1b9938a76673-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.089732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.089711    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgpfs\" (UniqueName: \"kubernetes.io/projected/6edd2b42-b521-4020-b3b7-1b9938a76673-kube-api-access-wgpfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-mgl95\" (UID: \"6edd2b42-b521-4020-b3b7-1b9938a76673\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.189094 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.189062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.479191 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.479101    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"]
Sep 07 13:27:01.481593 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:27:01.481561    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edd2b42_b521_4020_b3b7_1b9938a76673.slice/crio-c8fa7a10c87cd920b287798115df907830a9dfbc237e7c981b3ff67653c05f93 WatchSource:0}: Error finding container c8fa7a10c87cd920b287798115df907830a9dfbc237e7c981b3ff67653c05f93: Status 404 returned error can't find the container with id c8fa7a10c87cd920b287798115df907830a9dfbc237e7c981b3ff67653c05f93
Sep 07 13:27:01.730416 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.730319    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95" event={"ID":"6edd2b42-b521-4020-b3b7-1b9938a76673","Type":"ContainerStarted","Data":"d1a02a704b6e5c29d9bff912dbd1d7a6eef981f4d9d4b7f53dded0691a80e8bd"}
Sep 07 13:27:01.730416 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.730380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:27:01.730416 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.730398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95" event={"ID":"6edd2b42-b521-4020-b3b7-1b9938a76673","Type":"ContainerStarted","Data":"c8fa7a10c87cd920b287798115df907830a9dfbc237e7c981b3ff67653c05f93"}
Sep 07 13:27:01.762948 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:01.762895    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95" podStartSLOduration=1.7628768670000001 podStartE2EDuration="1.762876867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:27:01.761373132 +0000 UTC m=+2045.468156065" watchObservedRunningTime="2026-09-07 13:27:01.762876867 +0000 UTC m=+2045.469659798"
Sep 07 13:27:12.738532 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:27:12.738497    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-mgl95"
Sep 07 13:28:51.443709 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.443610    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"]
Sep 07 13:28:51.447732 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.447708    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.460352 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.460326    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"]
Sep 07 13:28:51.516086 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.516047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/910cffa0-9a97-4744-8c2c-5bb8c7599064-openshift-service-ca\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.516268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.516099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn7sr\" (UniqueName: \"kubernetes.io/projected/910cffa0-9a97-4744-8c2c-5bb8c7599064-kube-api-access-wn7sr\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.516268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.516149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-metrics-certs\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.516268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.516171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-maas-api-tls\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.617037 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.616997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-maas-api-tls\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.617212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.617083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/910cffa0-9a97-4744-8c2c-5bb8c7599064-openshift-service-ca\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.617212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.617113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn7sr\" (UniqueName: \"kubernetes.io/projected/910cffa0-9a97-4744-8c2c-5bb8c7599064-kube-api-access-wn7sr\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.617212 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.617136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-metrics-certs\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.617878 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.617848    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/910cffa0-9a97-4744-8c2c-5bb8c7599064-openshift-service-ca\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.619416 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.619394    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-metrics-certs\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.619573 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.619550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/910cffa0-9a97-4744-8c2c-5bb8c7599064-maas-api-tls\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.626799 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.626774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn7sr\" (UniqueName: \"kubernetes.io/projected/910cffa0-9a97-4744-8c2c-5bb8c7599064-kube-api-access-wn7sr\") pod \"maas-api-55cfc7d8cc-cjfjs\" (UID: \"910cffa0-9a97-4744-8c2c-5bb8c7599064\") " pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:51.759265 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:51.759171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:52.035060 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:52.035038    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"]
Sep 07 13:28:52.036476 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:28:52.036447    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910cffa0_9a97_4744_8c2c_5bb8c7599064.slice/crio-b515e00d5e0417cf7ed3eb6d8f0692fc5064e7e203e2ab858abf483cc654ab6a WatchSource:0}: Error finding container b515e00d5e0417cf7ed3eb6d8f0692fc5064e7e203e2ab858abf483cc654ab6a: Status 404 returned error can't find the container with id b515e00d5e0417cf7ed3eb6d8f0692fc5064e7e203e2ab858abf483cc654ab6a
Sep 07 13:28:52.313751 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:52.313662    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs" event={"ID":"910cffa0-9a97-4744-8c2c-5bb8c7599064","Type":"ContainerStarted","Data":"b515e00d5e0417cf7ed3eb6d8f0692fc5064e7e203e2ab858abf483cc654ab6a"}
Sep 07 13:28:53.321230 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:53.321197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs" event={"ID":"910cffa0-9a97-4744-8c2c-5bb8c7599064","Type":"ContainerStarted","Data":"41a742c947a17291d6fed405252cc5cd54b53fab89e35c73c7abd616e6e4ca9f"}
Sep 07 13:28:53.321642 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:53.321332    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:28:53.343443 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:53.343389    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs" podStartSLOduration=1.867014819 podStartE2EDuration="2.343372821s" totalImagesPullingTime="476.358002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:28:53.342144957 +0000 UTC m=+2157.048927889" watchObservedRunningTime="2026-09-07 13:28:53.343372821 +0000 UTC m=+2157.050155752"
Sep 07 13:28:59.331593 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:28:59.331564    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55cfc7d8cc-cjfjs"
Sep 07 13:29:08.567911 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:08.567875    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:29:08.568341 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:08.568088    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" podUID="5c31c113-7f5e-4005-aa8a-022761c76810" containerName="maas-api" containerID="cri-o://25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28" gracePeriod=30
Sep 07 13:29:09.824091 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.824063    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:29:09.878737 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.878649    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca\") pod \"5c31c113-7f5e-4005-aa8a-022761c76810\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") "
Sep 07 13:29:09.878737 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.878711    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") pod \"5c31c113-7f5e-4005-aa8a-022761c76810\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") "
Sep 07 13:29:09.878959 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.878764    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") pod \"5c31c113-7f5e-4005-aa8a-022761c76810\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") "
Sep 07 13:29:09.878959 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.878784    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jwf\" (UniqueName: \"kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf\") pod \"5c31c113-7f5e-4005-aa8a-022761c76810\" (UID: \"5c31c113-7f5e-4005-aa8a-022761c76810\") "
Sep 07 13:29:09.879111 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.879085    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c31c113-7f5e-4005-aa8a-022761c76810" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:29:09.880908 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.880873    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf" (OuterVolumeSpecName: "kube-api-access-88jwf") pod "5c31c113-7f5e-4005-aa8a-022761c76810" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810"). InnerVolumeSpecName "kube-api-access-88jwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:29:09.881017 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.880913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c31c113-7f5e-4005-aa8a-022761c76810" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:29:09.881017 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.880935    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5c31c113-7f5e-4005-aa8a-022761c76810" (UID: "5c31c113-7f5e-4005-aa8a-022761c76810"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:29:09.979464 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.979432    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c31c113-7f5e-4005-aa8a-022761c76810-openshift-service-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:29:09.979464 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.979463    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-metrics-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:29:09.979712 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.979476    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c31c113-7f5e-4005-aa8a-022761c76810-maas-api-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:29:09.979712 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:09.979487    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jwf\" (UniqueName: \"kubernetes.io/projected/5c31c113-7f5e-4005-aa8a-022761c76810-kube-api-access-88jwf\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Sep 07 13:29:10.412985 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.412947    2570 generic.go:356] "Generic (PLEG): container finished" podID="5c31c113-7f5e-4005-aa8a-022761c76810" containerID="25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28" exitCode=0
Sep 07 13:29:10.413178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.412993    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"
Sep 07 13:29:10.413178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.413032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" event={"ID":"5c31c113-7f5e-4005-aa8a-022761c76810","Type":"ContainerDied","Data":"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"}
Sep 07 13:29:10.413178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.413102    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84" event={"ID":"5c31c113-7f5e-4005-aa8a-022761c76810","Type":"ContainerDied","Data":"7bf0b7dba6e0766301b233bfbfdbe2660c5222dd0ed9fd6d9f02f0ac7125e5b3"}
Sep 07 13:29:10.413178 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.413126    2570 scope.go:117] "RemoveContainer" containerID="25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"
Sep 07 13:29:10.422844 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.422825    2570 scope.go:117] "RemoveContainer" containerID="25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"
Sep 07 13:29:10.423171 ip-10-0-143-132 kubenswrapper[2570]: E0907 13:29:10.423153    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28\": container with ID starting with 25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28 not found: ID does not exist" containerID="25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"
Sep 07 13:29:10.423222 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.423181    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28"} err="failed to get container status \"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28\": rpc error: code = NotFound desc = could not find container \"25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28\": container with ID starting with 25048f8ecc03ff746f4060cc0259163b60aac12242a913f592f2456cbd07fa28 not found: ID does not exist"
Sep 07 13:29:10.438433 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.438404    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:29:10.447297 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.447275    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d966df4d9-rcn84"]
Sep 07 13:29:10.814679 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:10.814579    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c31c113-7f5e-4005-aa8a-022761c76810" path="/var/lib/kubelet/pods/5c31c113-7f5e-4005-aa8a-022761c76810/volumes"
Sep 07 13:29:25.666590 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:25.666555    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdf6bbd8c-pj9vg_745089c0-ddc7-424c-b30e-6053389ffaca/authorino/0.log"
Sep 07 13:29:31.092499 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:31.092468    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m7m5l_69839a41-3ab9-412f-a4fb-b6b40d48af94/manager/0.log"
Sep 07 13:29:31.231470 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:31.231438    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8dgqv_44c54b51-8d4b-4958-adf6-ca5d3de13a39/manager/0.log"
Sep 07 13:29:31.377946 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:31.377872    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f4d8b5df-czjcp_f89af3c1-4c36-413d-adc0-04c963e34c20/manager/0.log"
Sep 07 13:29:31.680440 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:31.680397    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pf6sb_430164e9-3193-466f-904c-f2f542957ebd/manager/0.log"
Sep 07 13:29:32.149418 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:32.149331    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc4b9478f-tmqd7_47ecd7ab-b18e-4dec-a2c0-d89a226a4c14/manager/0.log"
Sep 07 13:29:32.164292 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:32.164257    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc4b9478f-tmqd7_47ecd7ab-b18e-4dec-a2c0-d89a226a4c14/copy-manifests/0.log"
Sep 07 13:29:32.640588 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:32.640556    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-55cfc7d8cc-cjfjs_910cffa0-9a97-4744-8c2c-5bb8c7599064/maas-api/0.log"
Sep 07 13:29:32.894845 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:32.894759    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dkdhn_066d589b-5092-4470-a498-52defaccb0fa/postgres/0.log"
Sep 07 13:29:33.685917 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:33.685889    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdf6bbd8c-pj9vg_745089c0-ddc7-424c-b30e-6053389ffaca/authorino/0.log"
Sep 07 13:29:33.821211 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:33.821174    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-84sjp_3db5fbf9-c913-409f-8c2a-8a917157d415/manager/0.log"
Sep 07 13:29:33.939552 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:33.939473    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5dmvd_9d3699a7-c4cd-4e13-9890-d31f91aece78/manager/0.log"
Sep 07 13:29:34.056904 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:34.056874    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-r8nsj_dec899ca-0835-434f-a418-453a3fddd42e/kuadrant-console-plugin/0.log"
Sep 07 13:29:34.186121 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:34.186086    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-mgl95_6edd2b42-b521-4020-b3b7-1b9938a76673/manager/0.log"
Sep 07 13:29:34.438898 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:34.438868    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-qwfsd_4e35c8f5-1530-400b-8172-6e19abf174fa/manager/0.log"
Sep 07 13:29:35.031224 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:35.031195    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558c85b7d6-fl4x5_f28fb77a-c190-44ef-9b41-da3758e10623/kube-auth-proxy/0.log"
Sep 07 13:29:36.195682 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:36.195655    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-fqptk_fc2fc993-285b-44ee-8cd1-3f5f0b4f9eb4/main/0.log"
Sep 07 13:29:42.612493 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.612446    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9djjs/must-gather-x45hx"]
Sep 07 13:29:42.612976 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.612943    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c31c113-7f5e-4005-aa8a-022761c76810" containerName="maas-api"
Sep 07 13:29:42.612976 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.612961    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c31c113-7f5e-4005-aa8a-022761c76810" containerName="maas-api"
Sep 07 13:29:42.613072 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.613054    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c31c113-7f5e-4005-aa8a-022761c76810" containerName="maas-api"
Sep 07 13:29:42.616400 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.616378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.619234 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.619214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9djjs\"/\"openshift-service-ca.crt\""
Sep 07 13:29:42.619362 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.619266    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9djjs\"/\"default-dockercfg-zn4q2\""
Sep 07 13:29:42.620268 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.620252    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9djjs\"/\"kube-root-ca.crt\""
Sep 07 13:29:42.626784 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.626762    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9djjs/must-gather-x45hx"]
Sep 07 13:29:42.666423 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.666387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4b55ee0-00c2-48d7-a25a-b47264d95672-must-gather-output\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.666601 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.666434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tp2\" (UniqueName: \"kubernetes.io/projected/c4b55ee0-00c2-48d7-a25a-b47264d95672-kube-api-access-94tp2\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.767417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.767379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4b55ee0-00c2-48d7-a25a-b47264d95672-must-gather-output\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.767417 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.767431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94tp2\" (UniqueName: \"kubernetes.io/projected/c4b55ee0-00c2-48d7-a25a-b47264d95672-kube-api-access-94tp2\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.767773 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.767747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c4b55ee0-00c2-48d7-a25a-b47264d95672-must-gather-output\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.776558 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.776528    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tp2\" (UniqueName: \"kubernetes.io/projected/c4b55ee0-00c2-48d7-a25a-b47264d95672-kube-api-access-94tp2\") pod \"must-gather-x45hx\" (UID: \"c4b55ee0-00c2-48d7-a25a-b47264d95672\") " pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:42.927235 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:42.927203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9djjs/must-gather-x45hx"
Sep 07 13:29:43.201116 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:43.201089    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9djjs/must-gather-x45hx"]
Sep 07 13:29:43.203272 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:29:43.203244    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4b55ee0_00c2_48d7_a25a_b47264d95672.slice/crio-d183c19bad51c1495d0bea8f5c9f3c4a701a577a4a2ed178366bbda7d5ce3123 WatchSource:0}: Error finding container d183c19bad51c1495d0bea8f5c9f3c4a701a577a4a2ed178366bbda7d5ce3123: Status 404 returned error can't find the container with id d183c19bad51c1495d0bea8f5c9f3c4a701a577a4a2ed178366bbda7d5ce3123
Sep 07 13:29:43.205170 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:43.205152    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:29:43.586319 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:43.586229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9djjs/must-gather-x45hx" event={"ID":"c4b55ee0-00c2-48d7-a25a-b47264d95672","Type":"ContainerStarted","Data":"d183c19bad51c1495d0bea8f5c9f3c4a701a577a4a2ed178366bbda7d5ce3123"}
Sep 07 13:29:44.595646 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:44.595589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9djjs/must-gather-x45hx" event={"ID":"c4b55ee0-00c2-48d7-a25a-b47264d95672","Type":"ContainerStarted","Data":"be3fe4d0583b037df9cc5802668c16634d8d0e7c64900a0d514435967af3b458"}
Sep 07 13:29:44.596085 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:44.595653    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9djjs/must-gather-x45hx" event={"ID":"c4b55ee0-00c2-48d7-a25a-b47264d95672","Type":"ContainerStarted","Data":"5351486f2f74c937fae1b77dc278d43071e6de3b29a2fbb4e4917d176c1e5280"}
Sep 07 13:29:44.618674 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:44.618593    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9djjs/must-gather-x45hx" podStartSLOduration=1.833450443 podStartE2EDuration="2.618571172s" totalImagesPullingTime="785.120729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:29:44.614645305 +0000 UTC m=+2208.321428230" watchObservedRunningTime="2026-09-07 13:29:44.618571172 +0000 UTC m=+2208.325354105"
Sep 07 13:29:45.648477 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:45.648446    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22pgn_67863efb-6457-47e6-9c0e-8c8946263e6e/global-pull-secret-syncer/0.log"
Sep 07 13:29:45.920117 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:45.920078    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wq8zl_759be7ca-493b-459c-961d-3ca2517f2807/konnectivity-agent/0.log"
Sep 07 13:29:46.052643 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:46.052583    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-132.ec2.internal_a7db37ffbd7e75f97328ea72fd34d53c/haproxy/0.log"
Sep 07 13:29:50.295674 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.295425    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdf6bbd8c-pj9vg_745089c0-ddc7-424c-b30e-6053389ffaca/authorino/0.log"
Sep 07 13:29:50.335842 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.335804    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-84sjp_3db5fbf9-c913-409f-8c2a-8a917157d415/manager/0.log"
Sep 07 13:29:50.381535 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.381361    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5dmvd_9d3699a7-c4cd-4e13-9890-d31f91aece78/manager/0.log"
Sep 07 13:29:50.428016 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.427901    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-r8nsj_dec899ca-0835-434f-a418-453a3fddd42e/kuadrant-console-plugin/0.log"
Sep 07 13:29:50.494112 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.494007    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-mgl95_6edd2b42-b521-4020-b3b7-1b9938a76673/manager/0.log"
Sep 07 13:29:50.602097 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:50.601985    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-qwfsd_4e35c8f5-1530-400b-8172-6e19abf174fa/manager/0.log"
Sep 07 13:29:52.835283 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:52.835253    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgstf_d8744e60-d4dd-4dab-9335-c6759640ee54/node-exporter/0.log"
Sep 07 13:29:52.875654 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:52.875360    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgstf_d8744e60-d4dd-4dab-9335-c6759640ee54/kube-rbac-proxy/0.log"
Sep 07 13:29:52.902265 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:52.902241    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgstf_d8744e60-d4dd-4dab-9335-c6759640ee54/init-textfile/0.log"
Sep 07 13:29:55.698658 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.698602    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"]
Sep 07 13:29:55.705941 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.705903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.713842 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.713816    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"]
Sep 07 13:29:55.803184 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.803144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-podres\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.803435 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.803408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2c9\" (UniqueName: \"kubernetes.io/projected/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-kube-api-access-5k2c9\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.803586 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.803450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-proc\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.803586 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.803524    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-lib-modules\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.803586 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.803559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-sys\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904131 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-lib-modules\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-sys\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904270    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-lib-modules\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-podres\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904314 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-sys\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2c9\" (UniqueName: \"kubernetes.io/projected/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-kube-api-access-5k2c9\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-proc\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904543 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-podres\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.904731 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.904612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-proc\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:55.913880 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:55.913847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2c9\" (UniqueName: \"kubernetes.io/projected/2833b2fe-f2e8-48f4-bd2c-202db8c9578e-kube-api-access-5k2c9\") pod \"perf-node-gather-daemonset-s9t52\" (UID: \"2833b2fe-f2e8-48f4-bd2c-202db8c9578e\") " pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:56.025614 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.025474    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:56.284122 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.284051    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76575d89bb-49k4s_9c04511b-c8e7-47eb-b697-57921e5caf2a/console/0.log"
Sep 07 13:29:56.329258 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.329021    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-54htw_41617925-30ec-472d-b4be-d5a80c0b5e53/download-server/0.log"
Sep 07 13:29:56.344545 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.344382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"]
Sep 07 13:29:56.346849 ip-10-0-143-132 kubenswrapper[2570]: W0907 13:29:56.344784    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2833b2fe_f2e8_48f4_bd2c_202db8c9578e.slice/crio-448d13862b34f5cf4576f8f875e4e95fb0c9ffbae66825aa7f753b339170badf WatchSource:0}: Error finding container 448d13862b34f5cf4576f8f875e4e95fb0c9ffbae66825aa7f753b339170badf: Status 404 returned error can't find the container with id 448d13862b34f5cf4576f8f875e4e95fb0c9ffbae66825aa7f753b339170badf
Sep 07 13:29:56.694394 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.694359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52" event={"ID":"2833b2fe-f2e8-48f4-bd2c-202db8c9578e","Type":"ContainerStarted","Data":"b90ff5816bdcde588f776417668524cad90be901f5cf9f27a41425eeb5b59caa"}
Sep 07 13:29:56.694575 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.694416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52" event={"ID":"2833b2fe-f2e8-48f4-bd2c-202db8c9578e","Type":"ContainerStarted","Data":"448d13862b34f5cf4576f8f875e4e95fb0c9ffbae66825aa7f753b339170badf"}
Sep 07 13:29:56.694666 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.694566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:29:56.718110 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:56.718040    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52" podStartSLOduration=1.718020474 podStartE2EDuration="1.718020474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:29:56.714332821 +0000 UTC m=+2220.421115757" watchObservedRunningTime="2026-09-07 13:29:56.718020474 +0000 UTC m=+2220.424803406"
Sep 07 13:29:58.449099 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:58.449062    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kf7tv_75982892-57de-4ad8-8a45-07e6ed6c6835/dns/0.log"
Sep 07 13:29:58.479206 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:58.479177    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kf7tv_75982892-57de-4ad8-8a45-07e6ed6c6835/kube-rbac-proxy/0.log"
Sep 07 13:29:58.591684 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:58.591647    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qq82_e17c6c58-0175-4877-a5d8-a1aaf9681d66/dns-node-resolver/0.log"
Sep 07 13:29:59.199128 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:59.199093    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54bf76d9cd-j462c_df15b7c8-35cf-43db-bde9-65bfa488e1a8/registry/0.log"
Sep 07 13:29:59.228844 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:29:59.228817    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mpzz_b0b65b81-dba1-4cd4-89f6-d8607316143a/node-ca/0.log"
Sep 07 13:30:00.842256 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:00.842221    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558c85b7d6-fl4x5_f28fb77a-c190-44ef-9b41-da3758e10623/kube-auth-proxy/0.log"
Sep 07 13:30:02.057881 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:02.057852    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8r85k_82773765-3fff-4079-b3cd-d5a3973942d2/serve-healthcheck-canary/0.log"
Sep 07 13:30:02.712602 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:02.712571    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9djjs/perf-node-gather-daemonset-s9t52"
Sep 07 13:30:02.793693 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:02.793662    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbkp9_1194d574-de67-4aa2-af13-d311c8385489/kube-rbac-proxy/0.log"
Sep 07 13:30:02.821201 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:02.821168    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbkp9_1194d574-de67-4aa2-af13-d311c8385489/exporter/0.log"
Sep 07 13:30:02.848747 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:02.848715    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbkp9_1194d574-de67-4aa2-af13-d311c8385489/extractor/0.log"
Sep 07 13:30:05.317463 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:05.317408    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m7m5l_69839a41-3ab9-412f-a4fb-b6b40d48af94/manager/0.log"
Sep 07 13:30:05.654190 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:05.654159    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8dgqv_44c54b51-8d4b-4958-adf6-ca5d3de13a39/manager/0.log"
Sep 07 13:30:05.725924 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:05.725865    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f4d8b5df-czjcp_f89af3c1-4c36-413d-adc0-04c963e34c20/manager/0.log"
Sep 07 13:30:05.924375 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:05.924349    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pf6sb_430164e9-3193-466f-904c-f2f542957ebd/manager/0.log"
Sep 07 13:30:06.166020 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:06.165990    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc4b9478f-tmqd7_47ecd7ab-b18e-4dec-a2c0-d89a226a4c14/manager/0.log"
Sep 07 13:30:06.189755 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:06.189688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc4b9478f-tmqd7_47ecd7ab-b18e-4dec-a2c0-d89a226a4c14/copy-manifests/0.log"
Sep 07 13:30:07.027610 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:07.027575    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558c85b7d6-fl4x5_f28fb77a-c190-44ef-9b41-da3758e10623/kube-auth-proxy/0.log"
Sep 07 13:30:09.334838 ip-10-0-143-132 kubenswrapper[2570]: I0907 13:30:09.334801    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558c85b7d6-fl4x5_f28fb77a-c190-44ef-9b41-da3758e10623/kube-auth-proxy/0.log"