Sep 14 12:58:00.052195 ip-10-0-137-35 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 12:58:00.466627 ip-10-0-137-35 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:00.466627 ip-10-0-137-35 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 12:58:00.466627 ip-10-0-137-35 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:00.466627 ip-10-0-137-35 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 12:58:00.466627 ip-10-0-137-35 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 12:58:00.468788 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.468687    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 12:58:00.475185 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475156    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.475185 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475178    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.475185 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475183    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.475185 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475187    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475195    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475201    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475206    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475210    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475215    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475220    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475224    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475227    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475231    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475235    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475239    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475243    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475246    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475250    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475253    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475257    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475261    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475265    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.475447 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475269    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475274    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475277    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475281    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475285    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475288    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475293    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475297    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475300    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475304    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475312    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475316    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475320    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475324    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475328    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475333    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475338    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475342    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475346    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.476239 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475350    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475357    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475363    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475367    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475373    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475378    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475382    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475386    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475391    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475395    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475399    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475404    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475408    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475413    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475418    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475422    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475427    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475431    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475438    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475442    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.477120 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475447    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475451    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475455    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475460    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475465    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475469    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475473    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475478    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475482    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475487    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475491    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475495    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475500    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475506    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475513    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475518    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475523    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475528    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475533    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.477975 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475538    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475542    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475547    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475553    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475558    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475563    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475567    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475572    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475576    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475580    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475585    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475589    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475593    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475598    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475602    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475606    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475611    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475615    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.475619    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476790    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.478781 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476800    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476806    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476811    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476816    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476820    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476824    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476828    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476832    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476837    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476841    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476845    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476849    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476854    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476858    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476862    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476866    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476871    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476893    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476897    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476902    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.479646 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476906    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476909    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476914    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476918    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476923    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476927    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476932    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476937    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476941    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476948    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476955    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476960    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476965    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476970    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476974    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476978    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476983    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476987    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476991    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.480302 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.476997    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477002    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477007    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477012    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477016    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477020    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477025    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477030    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477036    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477041    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477047    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477052    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477057    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477061    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477066    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477070    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477074    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477078    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477082    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.480776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477086    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477091    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477095    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477099    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477103    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477107    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477112    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477117    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477121    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477126    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477131    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477135    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477138    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477142    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477146    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477150    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477154    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477159    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477163    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.481357 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477167    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477171    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477175    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477179    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477183    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477188    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477193    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477197    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477201    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477206    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477211    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477215    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477219    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477223    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477228    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477232    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477236    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477240    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477244    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477248    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.481854 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477253    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477849    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477857    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477861    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477865    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477869    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477891    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477897    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477902    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477906    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477911    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477919    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477925    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477930    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477934    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477939    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477943    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477950    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477954    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.482456 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477958    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477963    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477967    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477971    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477974    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477978    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477982    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477986    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477990    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477994    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.477998    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478002    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478019    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478025    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478030    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478034    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478038    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478042    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478046    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.483073 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478050    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478058    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478063    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478067    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478071    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478075    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478079    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478084    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478088    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478092    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478096    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478100    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478105    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478110    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478114    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478118    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478123    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478126    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478133    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478139    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.483648 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478145    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478149    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478156    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478161    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478166    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478170    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478175    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478180    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478185    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478189    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478194    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478198    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478202    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478208    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478213    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478218    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478223    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478228    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478233    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478238    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.484157 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478242    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478247    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478251    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478255    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478259    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478264    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478268    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478272    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478277    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478281    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478285    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478290    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478294    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478298    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478302    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478306    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478311    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478315    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478322    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478326    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.484707 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478330    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.478334    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478440    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478493    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478502    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478511    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478517    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478522    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478529    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478536    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478541    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478547    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478552    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478558    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478563    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478567    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478572    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478577    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478582    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478588    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478595    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478600    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478605    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478610    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 12:58:00.485273 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478615    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478621    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478626    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478631    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478637    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478642    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478649    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478654    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478658    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478663    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478670    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478675    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478679    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478686    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478691    2559 flags.go:64] FLAG: --enable-server="true"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478695    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478702    2559 flags.go:64] FLAG: --event-burst="100"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478707    2559 flags.go:64] FLAG: --event-qps="50"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478712    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478717    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478722    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478728    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478733    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478737    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478742    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 14 12:58:00.485947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478747    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478752    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478758    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478763    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478767    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478772    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478777    2559 flags.go:64] FLAG: --feature-gates=""
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478782    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478787    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478792    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478796    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478801    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478806    2559 flags.go:64] FLAG: --help="false"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478812    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478818    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478823    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478828    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478833    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478839    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478844    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478848    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478853    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478857    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 12:58:00.486549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478862    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478867    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478872    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478892    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478897    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478902    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478906    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478911    2559 flags.go:64] FLAG: --lock-file=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478915    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478920    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478924    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478933    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478939    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478944    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478948    2559 flags.go:64] FLAG: --logging-format="text"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478953    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478958    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478963    2559 flags.go:64] FLAG: --manifest-url=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478967    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478974    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478979    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478986    2559 flags.go:64] FLAG: --max-pods="110"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478993    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.478997    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479002    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 12:58:00.487152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479007    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479012    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479017    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479022    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479033    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479038    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479043    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479048    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479053    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479061    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479065    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479070    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479075    2559 flags.go:64] FLAG: --port="10250"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479080    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479085    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047ce32538b627d74"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479090    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479095    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479100    2559 flags.go:64] FLAG: --register-node="true"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479104    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479110    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479116    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479121    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479126    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479132    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479137    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 12:58:00.487754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479142    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479147    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479152    2559 flags.go:64] FLAG: --runonce="false"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479156    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479161    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479168    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479173    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479178    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479183    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479188    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479193    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479198    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479203    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479207    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479212    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479217    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479222    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479226    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479235    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479240    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479244    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479251    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479256    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479261    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479265    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 12:58:00.488378 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479270    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479275    2559 flags.go:64] FLAG: --v="2"
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479281    2559 flags.go:64] FLAG: --version="false"
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479288    2559 flags.go:64] FLAG: --vmodule=""
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479294    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.479300    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479487    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479493    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479498    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479502    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479507    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479512    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479519    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479523    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479528    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479533    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479538    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479542    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479547    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479551    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479556    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.489015 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479560    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479564    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479568    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479573    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479579    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479586    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479590    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479595    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479599    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479604    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479609    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479614    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479619    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479623    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479627    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479633    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479637    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479641    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479645    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.489560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479649    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479653    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479658    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479663    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479668    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479672    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479676    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479681    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479685    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479689    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479693    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479697    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479702    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479708    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479714    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479720    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479726    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479731    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479735    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.490047 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479739    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479744    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479748    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479752    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479756    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479760    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479764    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479768    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479772    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479777    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479782    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479786    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479790    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479794    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479799    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479805    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479809    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479815    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479819    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479824    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.490523 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479828    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479832    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479836    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479841    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479845    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479850    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479854    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479858    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479862    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479867    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479871    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479889    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479894    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479898    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479902    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479907    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479912    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479916    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479920    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479925    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.491036 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479929    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479933    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479937    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479942    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479946    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.479950    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.480895    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.489346    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.489362    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.490287    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.490299    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490354    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490360    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490363    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490367    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.491520 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490370    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490374    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490377    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490380    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490383    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490385    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490388    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490391    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490394    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490398    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490401    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490405    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490407    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490410    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490414    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490417    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490420    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490423    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490426    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.492005 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490428    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490431    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490434    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490436    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490439    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490442    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490446    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490449    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490452    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490454    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490457    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490460    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490462    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490465    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490468    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490470    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490473    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490475    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490478    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490481    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.492482 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490483    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490485    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490488    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490491    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490495    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490499    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490502    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490505    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490508    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490511    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490514    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490517    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490520    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490523    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490526    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490529    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490532    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490535    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490538    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.493043 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490542    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490544    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490547    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490550    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490552    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490555    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490558    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490560    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490562    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490565    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490568    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490570    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490573    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490576    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490579    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490582    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490585    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490587    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490591    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490593    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.493510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490596    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490599    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490601    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490604    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490607    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490609    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490612    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490614    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490617    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490619    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490622    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490625    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490628    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490631    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490633    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490636    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.494017 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490638    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.490643    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490755    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490760    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490763    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490766    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490769    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490771    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490774    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490777    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490780    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490783    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490785    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490789    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490792    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 12:58:00.494404 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490794    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490797    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490799    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490802    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490804    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490807    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490810    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490812    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490814    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490817    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490819    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490822    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490826    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490830    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490833    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490836    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490839    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490842    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490845    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 12:58:00.494779 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490849    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490852    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490854    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490857    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490860    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490862    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490865    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490867    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490870    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490872    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490890    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490895    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490898    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490901    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490904    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490906    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490909    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490911    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490914    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 12:58:00.495323 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490917    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490919    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490922    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490925    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490927    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490930    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490933    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490936    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490939    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490942    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490947    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490950    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490953    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490956    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490958    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490961    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490964    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490966    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490969    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490972    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 12:58:00.495776 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490974    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490977    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490979    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490982    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490984    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490987    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490989    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490992    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490995    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.490997    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491000    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491003    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491005    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491008    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491011    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491013    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491016    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491018    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491021    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491024    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 12:58:00.496266 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491026    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491029    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491031    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491034    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491037    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491040    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491042    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:00.491045    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.491050    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.491160    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.493575    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.494631    2559 server.go:1019] "Starting client certificate rotation"
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.494734    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 12:58:00.496755 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.494774    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 12:58:00.497391 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.497377    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 12:58:00.502939 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.502918    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 12:58:00.513919 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.513895    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 14 12:58:00.517551 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.517532    2559 log.go:25] "Validated CRI v1 image API"
Sep 14 12:58:00.518384 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.518362    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 12:58:00.521652 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.521633    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 943f6e15-f2ee-4e00-8e41-e13756c09a40:/dev/nvme0n1p3 a9e479ca-c4c1-4339-ba62-fbfe4b8fd2cc:/dev/nvme0n1p4]
Sep 14 12:58:00.521715 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.521652    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 12:58:00.527165 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.527057    2559 manager.go:216] Machine: {Timestamp:2026-09-14 12:58:00.525442915 +0000 UTC m=+0.361951739 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114240 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23693f152928c49f6fb34589987323 SystemUUID:ec23693f-1529-28c4-9f6f-b34589987323 BootID:e4e21d8d-be85-4232-95b9-c2af25735160 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:9e:af:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:9e:af:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:fc:8e:a6:d6:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 12:58:00.527165 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.527161    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 12:58:00.527291 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.527276    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 12:58:00.530687 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.530659    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 12:58:00.530823 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.530690    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 12:58:00.531595 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.531585    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 12:58:00.531628 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.531599    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 12:58:00.531628 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.531607    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 12:58:00.532451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.532431    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 12:58:00.533551 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.533540    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 12:58:00.537727 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537715    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 12:58:00.537834 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537825    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 12:58:00.537871 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537853    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 12:58:00.537871 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537862    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 12:58:00.537933 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537884    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 12:58:00.537933 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537894    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 14 12:58:00.537933 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.537904    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 12:58:00.538333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.538319    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 12:58:00.538380 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.538349    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 12:58:00.538408 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.538373    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 12:58:00.541227 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.541210    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 12:58:00.544237 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.544222    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 12:58:00.544303 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.544254    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 12:58:00.546270 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546256    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546274    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546280    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546286    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546295    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546300    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546314    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546319    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546326    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 12:58:00.546331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546332    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 12:58:00.546565 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546341    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 12:58:00.546565 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.546346    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 12:58:00.547217 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.547208    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 12:58:00.547217 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.547217    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 12:58:00.551604 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.551570    2559 server.go:1268] "Started kubelet"
Sep 14 12:58:00.552015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.551966    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 12:58:00.552130 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.551979    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 12:58:00.552284 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.552253    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 12:58:00.552511 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.552475    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 12:58:00.552611 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.552125    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 12:58:00.552611 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.552582    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 12:58:00.552595 ip-10-0-137-35 systemd[1]: Started Kubernetes Kubelet.
Sep 14 12:58:00.553983 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.553967    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 12:58:00.554652 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.554635    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 12:58:00.559483 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.559456    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 12:58:00.563488 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.562335    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e6ab263b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.551532091 +0000 UTC m=+0.388040922,LastTimestamp:2026-09-14 12:58:00.551532091 +0000 UTC m=+0.388040922,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.563798 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.563777    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 12:58:00.564435 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.564419    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 12:58:00.564597 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.564577    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:00.565294 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565271    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 12:58:00.565373 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565281    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 12:58:00.565373 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565322    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 12:58:00.565495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565392    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 12:58:00.565495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565401    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 12:58:00.565495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565469    2559 factory.go:55] Registering systemd factory
Sep 14 12:58:00.565495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565482    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 14 12:58:00.565723 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565700    2559 factory.go:153] Registering CRI-O factory
Sep 14 12:58:00.565723 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565720    2559 factory.go:223] Registration of the crio container factory successfully
Sep 14 12:58:00.565822 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565764    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 12:58:00.565822 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565781    2559 factory.go:103] Registering Raw factory
Sep 14 12:58:00.565822 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.565792    2559 manager.go:1196] Started watching for new ooms in manager
Sep 14 12:58:00.566866 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.566849    2559 manager.go:349] Starting recovery of all containers
Sep 14 12:58:00.578261 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.578248    2559 manager.go:354] Recovery completed
Sep 14 12:58:00.579814 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.579794    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 12:58:00.579935 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.579903    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 12:58:00.582733 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.582719    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.584772 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.584756    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.584852 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.584791    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.584852 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.584803    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.585424 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.585409    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 12:58:00.585424 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.585418    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.585555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.585421    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 12:58:00.585555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.585488    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 12:58:00.586153 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586133    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.586217 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586164    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.586217 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586177    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.586701 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586688    2559 policy_none.go:49] "None policy: Start"
Sep 14 12:58:00.586747 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586708    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 12:58:00.586747 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.586723    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 12:58:00.588219 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.588199    2559 policy_none.go:47] "Start"
Sep 14 12:58:00.597721 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.597509    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e8a655a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.584770985 +0000 UTC m=+0.421279812,LastTimestamp:2026-09-14 12:58:00.584770985 +0000 UTC m=+0.421279812,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.606629 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.606566    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e8a6ba7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.584796797 +0000 UTC m=+0.421305625,LastTimestamp:2026-09-14 12:58:00.584796797 +0000 UTC m=+0.421305625,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.617632 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.617556    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e8a6e342  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.584807234 +0000 UTC m=+0.421316062,LastTimestamp:2026-09-14 12:58:00.584807234 +0000 UTC m=+0.421316062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625339    2559 manager.go:337] "Starting Device Plugin manager"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.625382    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625398    2559 server.go:87] "Starting device plugin registration server"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625682    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625695    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625820    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625964    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.625973    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.626463    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.626512    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.628652    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-35.ec2.internal.18d53157e8a655a9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e8a655a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.584770985 +0000 UTC m=+0.421279812,LastTimestamp:2026-09-14 12:58:00.586151107 +0000 UTC m=+0.422659932,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.644415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.639060    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q4bk5"
Sep 14 12:58:00.648790 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.648724    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-35.ec2.internal.18d53157e8a6ba7d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-35.ec2.internal.18d53157e8a6ba7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-35.ec2.internal,UID:ip-10-0-137-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-35.ec2.internal,},FirstTimestamp:2026-09-14 12:58:00.584796797 +0000 UTC m=+0.421305625,LastTimestamp:2026-09-14 12:58:00.586171313 +0000 UTC m=+0.422680139,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-35.ec2.internal,}"
Sep 14 12:58:00.655961 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.655944    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q4bk5"
Sep 14 12:58:00.675002 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.674978    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 12:58:00.676185 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.676167    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 12:58:00.676241 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.676226    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 12:58:00.676288 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.676250    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 12:58:00.676372 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.676343    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 12:58:00.678709 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.678691    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:00.726465 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.726378    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.727315 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.727299    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.727416 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.727335    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.727416 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.727352    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.727416 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.727383    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.739051 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.739031    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.739142 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.739053    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-35.ec2.internal\": node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:00.776468 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.776441    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"]
Sep 14 12:58:00.776587 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.776509    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.776587 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.776510    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:00.778036 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.778019    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.778124 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.778046    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.778124 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.778060    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.779674 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.779661    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.779815 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.779800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.779871 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.779857    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.780388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780366    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.780451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780370    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.780451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780420    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.780451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780436    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.780563 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780392    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.780563 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.780470    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.782106 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.782087    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.782199 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.782115    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 12:58:00.782782 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.782767    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 12:58:00.782862 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.782794    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 12:58:00.782862 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.782808    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeHasSufficientPID"
Sep 14 12:58:00.814602 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.814578    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-35.ec2.internal\" not found" node="ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.819090 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.819074    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-35.ec2.internal\" not found" node="ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.877138 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.877113    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:00.966911 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.966869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.967032 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.966927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.967032 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:00.966962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e14f36cc9cd4b7b9c71314199a9dd97e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e14f36cc9cd4b7b9c71314199a9dd97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:00.977997 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:00.977950    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.067628 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.067693 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.067693 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e14f36cc9cd4b7b9c71314199a9dd97e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e14f36cc9cd4b7b9c71314199a9dd97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.067753 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.067753 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73c7cb59bce5441fc972c77ff5e881da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal\" (UID: \"73c7cb59bce5441fc972c77ff5e881da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.067753 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.067749    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e14f36cc9cd4b7b9c71314199a9dd97e-config\") pod \"kube-apiserver-proxy-ip-10-0-137-35.ec2.internal\" (UID: \"e14f36cc9cd4b7b9c71314199a9dd97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.078717 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.078692    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.117889 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.117857    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.121857 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.121670    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.179680 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.179646    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.280234 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.280170    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.380870 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.380842    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.392193 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.392173    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:01.481063 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.481022    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-35.ec2.internal\" not found"
Sep 14 12:58:01.494389 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.494362    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 12:58:01.494525 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.494498    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 12:58:01.494566 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.494514    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 14 12:58:01.509052 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.509032    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:01.539414 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.539333    2559 apiserver.go:52] "Watching apiserver"
Sep 14 12:58:01.550120 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.550089    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 12:58:01.550447 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.550423    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-crf9v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn","openshift-multus/multus-additional-cni-plugins-wvlxf","openshift-multus/multus-p5zh8","openshift-multus/network-metrics-daemon-wns98","openshift-network-diagnostics/network-check-target-rwwnn","openshift-network-operator/iptables-alerter-ztnhx","openshift-ovn-kubernetes/ovnkube-node-s8jch","kube-system/konnectivity-agent-lnc7p","openshift-cluster-node-tuning-operator/tuned-pzl5j","openshift-dns/node-resolver-42gqn","openshift-image-registry/node-ca-lwjsd"]
Sep 14 12:58:01.552082 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.552059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.552190 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.552167    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:01.553351 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.553329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.555011 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.554986    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.555911 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.555881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 12:58:01.556136 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.556118    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.556205 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.556139    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rrwrp\""
Sep 14 12:58:01.556205 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.556144    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.557470 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.557448    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vvphc\""
Sep 14 12:58:01.557674 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.557657    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 12:58:01.558029 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.558010    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.558311 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.558286    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 12:58:01.558415 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.558295    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 12:58:01.558554 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.558534    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.558633 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.558554    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.560506 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.560487    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.560601 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.560582    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:01.561073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.561057    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pnrrw\""
Sep 14 12:58:01.561176 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.561159    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 12:58:01.562018 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.562001    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:01.562109 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.562051    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:01.563768 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.563746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.563947 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.563932    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 12:58:01.564587 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.564574    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.565673 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.565656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.567459 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.567440    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.568912 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.568894    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.569110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.569093    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.570222 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570200    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.570325 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570270    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 12:58:01.570390 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.570390 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570354    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 12:58:01.570390 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-netns\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.570509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-conf-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.570509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:01.570509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-dbus\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.570509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.570496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-multus\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-systemd-units\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-var-lib-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cni-binary-copy\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf2q8\" (UniqueName: \"kubernetes.io/projected/bfba470d-95e0-4d59-a22c-62eff4f91ff2-kube-api-access-gf2q8\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571739    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-daemon-config\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571853    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-config\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-device-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571952    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.571991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2872\" (UniqueName: \"kubernetes.io/projected/14916014-7e8d-4be8-810e-ef7bb4622d3d-kube-api-access-l2872\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-netns\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-log-socket\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572151    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nmqbj\""
Sep 14 12:58:01.573220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572281    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-bin\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-netd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89f7afff-11d3-445f-a94c-7787e0268e90-iptables-alerter-script\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-system-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-socket-dir-parent\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-bin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f7afff-11d3-445f-a94c-7787e0268e90-host-slash\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572653    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwrvq\""
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572717    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-k8s-cni-cncf-io\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-multus-certs\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-etc-kubernetes\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-node-log\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-script-lib\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.574274 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-etc-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-cnibin\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-kubelet\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573336    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s847l\" (UniqueName: \"kubernetes.io/projected/89f7afff-11d3-445f-a94c-7787e0268e90-kube-api-access-s847l\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-sys-fs\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cnibin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-kubelet\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573613    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-systemd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-env-overrides\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.572283    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.573844    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmf2n\" (UniqueName: \"kubernetes.io/projected/973513d5-904f-4e9b-8b01-cc403a4e44d9-kube-api-access-jmf2n\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-registration-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.575220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-ovn\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovn-node-metrics-cert\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4ftj\" (UniqueName: \"kubernetes.io/projected/b75dd968-bb0b-439b-afe0-e55c7114310c-kube-api-access-m4ftj\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574226    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kts7q\""
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-kubelet-config\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-hostroot\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-slash\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwlwh\""
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-socket-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574817    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmhwk\" (UniqueName: \"kubernetes.io/projected/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kube-api-access-kmhwk\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574855    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.574910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.575510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.576073 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.575947    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.578095 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.578079    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvz8j\""
Sep 14 12:58:01.578226 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.578197    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.578829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.578784    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 12:58:01.578902 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.578796    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 12:58:01.579081 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.579061    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 12:58:01.581763 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.581739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtstv\""
Sep 14 12:58:01.583182 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.583160    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 12:58:01.583299 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.583229    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"
Sep 14 12:58:01.583359 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.583345    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal"]
Sep 14 12:58:01.585184 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.585168    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 12:58:01.592194 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.592171    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal"]
Sep 14 12:58:01.593537 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.593430    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 12:58:01.612642 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.612621    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4c55"
Sep 14 12:58:01.623243 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.623218    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4c55"
Sep 14 12:58:01.661278 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.661220    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 12:53:01 +0000 UTC" deadline="2028-02-07 15:58:46.2425905 +0000 UTC"
Sep 14 12:58:01.661278 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.661275    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12267h0m44.581318404s"
Sep 14 12:58:01.666776 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.666746    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 12:58:01.676018 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.675996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-conf-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-dbus\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-multus\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-systemd-units\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-conf-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676204 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-var-lib-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-modprobe-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676234    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-multus\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-systemd-units\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cni-binary-copy\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-dbus\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-var-lib-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf2q8\" (UniqueName: \"kubernetes.io/projected/bfba470d-95e0-4d59-a22c-62eff4f91ff2-kube-api-access-gf2q8\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-serviceca\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.676602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.676683    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.676809    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:02.176780825 +0000 UTC m=+2.013289662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-daemon-config\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-config\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-device-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.676972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-systemd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-run\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2872\" (UniqueName: \"kubernetes.io/projected/14916014-7e8d-4be8-810e-ef7bb4622d3d-kube-api-access-l2872\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cni-binary-copy\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.677114 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-netns\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-netns\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-log-socket\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677188    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-device-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysconfig\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-log-socket\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.677504    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-etc-tuned\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-daemon-config\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-bin\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.677670    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:02.177650352 +0000 UTC m=+2.014159174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-bin\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.677720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-netd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-cni-netd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89f7afff-11d3-445f-a94c-7787e0268e90-iptables-alerter-script\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8sd\" (UniqueName: \"kubernetes.io/projected/f0198e44-8a37-444d-a47f-c54549d5551d-kube-api-access-9w8sd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-config\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7533ba1-9705-411d-ad8f-d099e90a6f7e-hosts-file\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl66r\" (UniqueName: \"kubernetes.io/projected/e7533ba1-9705-411d-ad8f-d099e90a6f7e-kube-api-access-fl66r\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-system-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-socket-dir-parent\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.677972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-bin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f7afff-11d3-445f-a94c-7787e0268e90-host-slash\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-agent-certs\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-system-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-socket-dir-parent\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-k8s-cni-cncf-io\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.678333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-multus-certs\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-cni-bin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-etc-kubernetes\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f7afff-11d3-445f-a94c-7787e0268e90-host-slash\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-k8s-cni-cncf-io\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-node-log\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-etc-kubernetes\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-sys\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-multus-certs\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-script-lib\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-node-log\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dljc\" (UniqueName: \"kubernetes.io/projected/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-kube-api-access-4dljc\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-etc-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-etc-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-lib-modules\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-host\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89f7afff-11d3-445f-a94c-7787e0268e90-iptables-alerter-script\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7533ba1-9705-411d-ad8f-d099e90a6f7e-tmp-dir\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678480    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-cnibin\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-kubelet\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s847l\" (UniqueName: \"kubernetes.io/projected/89f7afff-11d3-445f-a94c-7787e0268e90-kube-api-access-s847l\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-sys-fs\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-kubelet\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14916014-7e8d-4be8-810e-ef7bb4622d3d-cnibin\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovnkube-script-lib\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-sys-fs\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cnibin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.679872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-kubelet\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-systemd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-cnibin\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-env-overrides\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-systemd\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678928    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-var-lib-kubelet\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf2n\" (UniqueName: \"kubernetes.io/projected/973513d5-904f-4e9b-8b01-cc403a4e44d9-kube-api-access-jmf2n\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.678990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-registration-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-ovn\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovn-node-metrics-cert\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4ftj\" (UniqueName: \"kubernetes.io/projected/b75dd968-bb0b-439b-afe0-e55c7114310c-kube-api-access-m4ftj\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-var-lib-kubelet\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-host\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-kubelet-config\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-hostroot\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-registration-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.680482 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973513d5-904f-4e9b-8b01-cc403a4e44d9-env-overrides\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14916014-7e8d-4be8-810e-ef7bb4622d3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-slash\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-slash\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2028780-5f7e-4ceb-8333-a6b1daf07c05-kubelet-config\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-hostroot\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-ovn\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-socket-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmhwk\" (UniqueName: \"kubernetes.io/projected/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kube-api-access-kmhwk\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-socket-dir\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-conf\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679710    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-run-openvswitch\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-konnectivity-ca\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.681056 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679747    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973513d5-904f-4e9b-8b01-cc403a4e44d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-kubernetes\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-tmp\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-netns\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-multus-cni-dir\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.679984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfba470d-95e0-4d59-a22c-62eff4f91ff2-host-run-netns\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.681635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.680036    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 12:58:01.683645 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.683620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973513d5-904f-4e9b-8b01-cc403a4e44d9-ovn-node-metrics-cert\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.688425 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.688404    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:01.688527 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.688430    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:01.688527 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.688445    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:01.688527 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:01.688519    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:02.18850141 +0000 UTC m=+2.025010246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:01.695215 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.695190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf2q8\" (UniqueName: \"kubernetes.io/projected/bfba470d-95e0-4d59-a22c-62eff4f91ff2-kube-api-access-gf2q8\") pod \"multus-p5zh8\" (UID: \"bfba470d-95e0-4d59-a22c-62eff4f91ff2\") " pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.695328 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.695305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2872\" (UniqueName: \"kubernetes.io/projected/14916014-7e8d-4be8-810e-ef7bb4622d3d-kube-api-access-l2872\") pod \"multus-additional-cni-plugins-wvlxf\" (UID: \"14916014-7e8d-4be8-810e-ef7bb4622d3d\") " pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.697887 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.697829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf2n\" (UniqueName: \"kubernetes.io/projected/973513d5-904f-4e9b-8b01-cc403a4e44d9-kube-api-access-jmf2n\") pod \"ovnkube-node-s8jch\" (UID: \"973513d5-904f-4e9b-8b01-cc403a4e44d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.698012 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.697925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s847l\" (UniqueName: \"kubernetes.io/projected/89f7afff-11d3-445f-a94c-7787e0268e90-kube-api-access-s847l\") pod \"iptables-alerter-ztnhx\" (UID: \"89f7afff-11d3-445f-a94c-7787e0268e90\") " pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.699495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.699459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4ftj\" (UniqueName: \"kubernetes.io/projected/b75dd968-bb0b-439b-afe0-e55c7114310c-kube-api-access-m4ftj\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:01.701706 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.701674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmhwk\" (UniqueName: \"kubernetes.io/projected/452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8-kube-api-access-kmhwk\") pod \"aws-ebs-csi-driver-node-d88tn\" (UID: \"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.708105 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.708073    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c7cb59bce5441fc972c77ff5e881da.slice/crio-06dfe74b4491951170ddc2cd2187d268a3ab0e276a904b8ace0f1c8ebe961b38 WatchSource:0}: Error finding container 06dfe74b4491951170ddc2cd2187d268a3ab0e276a904b8ace0f1c8ebe961b38: Status 404 returned error can't find the container with id 06dfe74b4491951170ddc2cd2187d268a3ab0e276a904b8ace0f1c8ebe961b38
Sep 14 12:58:01.708394 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.708369    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14f36cc9cd4b7b9c71314199a9dd97e.slice/crio-dffef07a2af7a248bb6729588a1671acf8de065f78a3d2f4e009034635abb3a0 WatchSource:0}: Error finding container dffef07a2af7a248bb6729588a1671acf8de065f78a3d2f4e009034635abb3a0: Status 404 returned error can't find the container with id dffef07a2af7a248bb6729588a1671acf8de065f78a3d2f4e009034635abb3a0
Sep 14 12:58:01.715021 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.715004    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 12:58:01.780557 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-conf\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-konnectivity-ca\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-kubernetes\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-tmp\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-modprobe-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-serviceca\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780685    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-kubernetes\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780710    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-conf\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.780743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-systemd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-systemd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-modprobe-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-run\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysconfig\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780867    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-run\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-etc-tuned\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8sd\" (UniqueName: \"kubernetes.io/projected/f0198e44-8a37-444d-a47f-c54549d5551d-kube-api-access-9w8sd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysconfig\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7533ba1-9705-411d-ad8f-d099e90a6f7e-hosts-file\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.780961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl66r\" (UniqueName: \"kubernetes.io/projected/e7533ba1-9705-411d-ad8f-d099e90a6f7e-kube-api-access-fl66r\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-agent-certs\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-sys\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dljc\" (UniqueName: \"kubernetes.io/projected/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-kube-api-access-4dljc\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.781137 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-lib-modules\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-host\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-serviceca\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7533ba1-9705-411d-ad8f-d099e90a6f7e-tmp-dir\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-konnectivity-ca\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-host\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-lib-modules\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-sys\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-var-lib-kubelet\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-host\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-etc-sysctl-d\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7533ba1-9705-411d-ad8f-d099e90a6f7e-hosts-file\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-var-lib-kubelet\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7533ba1-9705-411d-ad8f-d099e90a6f7e-tmp-dir\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.781800 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.781698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0198e44-8a37-444d-a47f-c54549d5551d-host\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.783609 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.783583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff-agent-certs\") pod \"konnectivity-agent-lnc7p\" (UID: \"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff\") " pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.783710 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.783595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-tmp\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.783710 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.783639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0198e44-8a37-444d-a47f-c54549d5551d-etc-tuned\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.792275 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.792218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl66r\" (UniqueName: \"kubernetes.io/projected/e7533ba1-9705-411d-ad8f-d099e90a6f7e-kube-api-access-fl66r\") pod \"node-resolver-42gqn\" (UID: \"e7533ba1-9705-411d-ad8f-d099e90a6f7e\") " pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:01.792555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.792532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dljc\" (UniqueName: \"kubernetes.io/projected/53170467-8c0d-4b4b-ae4f-40d5af9cdfde-kube-api-access-4dljc\") pod \"node-ca-lwjsd\" (UID: \"53170467-8c0d-4b4b-ae4f-40d5af9cdfde\") " pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:01.792661 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.792642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8sd\" (UniqueName: \"kubernetes.io/projected/f0198e44-8a37-444d-a47f-c54549d5551d-kube-api-access-9w8sd\") pod \"tuned-pzl5j\" (UID: \"f0198e44-8a37-444d-a47f-c54549d5551d\") " pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.896537 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.896506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn"
Sep 14 12:58:01.905938 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.905900    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452f63cc_c0ac_4c49_8d2d_30ebe5f0d9a8.slice/crio-041d67eb15f8d95c0c56fb0645ff437ca3d690f811d5d4f3485b2b160385d4b1 WatchSource:0}: Error finding container 041d67eb15f8d95c0c56fb0645ff437ca3d690f811d5d4f3485b2b160385d4b1: Status 404 returned error can't find the container with id 041d67eb15f8d95c0c56fb0645ff437ca3d690f811d5d4f3485b2b160385d4b1
Sep 14 12:58:01.921008 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.920987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvlxf"
Sep 14 12:58:01.929141 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.929118    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14916014_7e8d_4be8_810e_ef7bb4622d3d.slice/crio-097ed5f97734f131ad2d1801bb632a957cd64d4cf9f74bd49063fd60c6a0531e WatchSource:0}: Error finding container 097ed5f97734f131ad2d1801bb632a957cd64d4cf9f74bd49063fd60c6a0531e: Status 404 returned error can't find the container with id 097ed5f97734f131ad2d1801bb632a957cd64d4cf9f74bd49063fd60c6a0531e
Sep 14 12:58:01.929718 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.929697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p5zh8"
Sep 14 12:58:01.936801 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.936781    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfba470d_95e0_4d59_a22c_62eff4f91ff2.slice/crio-7a57dfb6504a86e5e3795fd1c693e7acfd92832f69eb23f45c0759c685efeb10 WatchSource:0}: Error finding container 7a57dfb6504a86e5e3795fd1c693e7acfd92832f69eb23f45c0759c685efeb10: Status 404 returned error can't find the container with id 7a57dfb6504a86e5e3795fd1c693e7acfd92832f69eb23f45c0759c685efeb10
Sep 14 12:58:01.944652 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.944631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ztnhx"
Sep 14 12:58:01.950811 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.950784    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:01.951903 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.951882    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f7afff_11d3_445f_a94c_7787e0268e90.slice/crio-8f8583b48f3036ee907f4f8205d418277f2c6df32cec12ebf2820d50bf7b1667 WatchSource:0}: Error finding container 8f8583b48f3036ee907f4f8205d418277f2c6df32cec12ebf2820d50bf7b1667: Status 404 returned error can't find the container with id 8f8583b48f3036ee907f4f8205d418277f2c6df32cec12ebf2820d50bf7b1667
Sep 14 12:58:01.958092 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.958068    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973513d5_904f_4e9b_8b01_cc403a4e44d9.slice/crio-96437a505bd794acffe6a667b04ce40500a92b62ffd6fe9f75cf6ed3319c8424 WatchSource:0}: Error finding container 96437a505bd794acffe6a667b04ce40500a92b62ffd6fe9f75cf6ed3319c8424: Status 404 returned error can't find the container with id 96437a505bd794acffe6a667b04ce40500a92b62ffd6fe9f75cf6ed3319c8424
Sep 14 12:58:01.969553 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.969522    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:01.978037 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.978012    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993a1fa2_5aa8_4fb2_b7d7_b3f5446158ff.slice/crio-00ee27c2ec10833aee16be1b94789612d4c414f3803809f2804874c22f3b043a WatchSource:0}: Error finding container 00ee27c2ec10833aee16be1b94789612d4c414f3803809f2804874c22f3b043a: Status 404 returned error can't find the container with id 00ee27c2ec10833aee16be1b94789612d4c414f3803809f2804874c22f3b043a
Sep 14 12:58:01.991106 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:01.991086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pzl5j"
Sep 14 12:58:01.998849 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:01.998827    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0198e44_8a37_444d_a47f_c54549d5551d.slice/crio-c8a00d5a7772539c9ece382b883118d3704c5ce2c840d82da50aa542f5d2ace7 WatchSource:0}: Error finding container c8a00d5a7772539c9ece382b883118d3704c5ce2c840d82da50aa542f5d2ace7: Status 404 returned error can't find the container with id c8a00d5a7772539c9ece382b883118d3704c5ce2c840d82da50aa542f5d2ace7
Sep 14 12:58:02.001004 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.000987    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:02.011603 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.011585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42gqn"
Sep 14 12:58:02.017090 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.017070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwjsd"
Sep 14 12:58:02.019557 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:02.019535    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7533ba1_9705_411d_ad8f_d099e90a6f7e.slice/crio-add46449431b7013f91583c76eae9cde5777b4d3398c5cad5b974030a804fa6c WatchSource:0}: Error finding container add46449431b7013f91583c76eae9cde5777b4d3398c5cad5b974030a804fa6c: Status 404 returned error can't find the container with id add46449431b7013f91583c76eae9cde5777b4d3398c5cad5b974030a804fa6c
Sep 14 12:58:02.024804 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:02.024780    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53170467_8c0d_4b4b_ae4f_40d5af9cdfde.slice/crio-d43d5ed78feb13e8c2aa9b5383045bf151d44aedfe876b4bd615a8138f16c442 WatchSource:0}: Error finding container d43d5ed78feb13e8c2aa9b5383045bf151d44aedfe876b4bd615a8138f16c442: Status 404 returned error can't find the container with id d43d5ed78feb13e8c2aa9b5383045bf151d44aedfe876b4bd615a8138f16c442
Sep 14 12:58:02.184414 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.184316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:02.184414 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.184357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:02.184644 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.184491    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:02.184644 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.184551    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:02.184644 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.184567    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:03.184550202 +0000 UTC m=+3.021059015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:02.184644 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.184613    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:03.184595314 +0000 UTC m=+3.021104129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:02.285441 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.285399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:02.285618 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.285603    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:02.285677 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.285628    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:02.285677 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.285639    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:02.285763 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:02.285693    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:03.285679183 +0000 UTC m=+3.122187997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:02.625789 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.625719    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 12:53:02 +0000 UTC" deadline="2028-05-24 01:47:18.854655392 +0000 UTC"
Sep 14 12:58:02.625789 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.625786    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14820h49m16.228873585s"
Sep 14 12:58:02.694376 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.694263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42gqn" event={"ID":"e7533ba1-9705-411d-ad8f-d099e90a6f7e","Type":"ContainerStarted","Data":"add46449431b7013f91583c76eae9cde5777b4d3398c5cad5b974030a804fa6c"}
Sep 14 12:58:02.707937 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.707895    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"96437a505bd794acffe6a667b04ce40500a92b62ffd6fe9f75cf6ed3319c8424"}
Sep 14 12:58:02.717229 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.717193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztnhx" event={"ID":"89f7afff-11d3-445f-a94c-7787e0268e90","Type":"ContainerStarted","Data":"8f8583b48f3036ee907f4f8205d418277f2c6df32cec12ebf2820d50bf7b1667"}
Sep 14 12:58:02.731377 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.731335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"73c7cb59bce5441fc972c77ff5e881da","Type":"ContainerStarted","Data":"06dfe74b4491951170ddc2cd2187d268a3ab0e276a904b8ace0f1c8ebe961b38"}
Sep 14 12:58:02.737367 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.737338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwjsd" event={"ID":"53170467-8c0d-4b4b-ae4f-40d5af9cdfde","Type":"ContainerStarted","Data":"d43d5ed78feb13e8c2aa9b5383045bf151d44aedfe876b4bd615a8138f16c442"}
Sep 14 12:58:02.753023 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.752494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzl5j" event={"ID":"f0198e44-8a37-444d-a47f-c54549d5551d","Type":"ContainerStarted","Data":"c8a00d5a7772539c9ece382b883118d3704c5ce2c840d82da50aa542f5d2ace7"}
Sep 14 12:58:02.776461 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.776424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnc7p" event={"ID":"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff","Type":"ContainerStarted","Data":"00ee27c2ec10833aee16be1b94789612d4c414f3803809f2804874c22f3b043a"}
Sep 14 12:58:02.795421 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.795383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p5zh8" event={"ID":"bfba470d-95e0-4d59-a22c-62eff4f91ff2","Type":"ContainerStarted","Data":"7a57dfb6504a86e5e3795fd1c693e7acfd92832f69eb23f45c0759c685efeb10"}
Sep 14 12:58:02.811077 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.810983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerStarted","Data":"097ed5f97734f131ad2d1801bb632a957cd64d4cf9f74bd49063fd60c6a0531e"}
Sep 14 12:58:02.815201 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.815169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn" event={"ID":"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8","Type":"ContainerStarted","Data":"041d67eb15f8d95c0c56fb0645ff437ca3d690f811d5d4f3485b2b160385d4b1"}
Sep 14 12:58:02.828457 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.828424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" event={"ID":"e14f36cc9cd4b7b9c71314199a9dd97e","Type":"ContainerStarted","Data":"dffef07a2af7a248bb6729588a1671acf8de065f78a3d2f4e009034635abb3a0"}
Sep 14 12:58:02.921826 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:02.921744    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:03.193648 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.193551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:03.193853 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.193663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:03.193853 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.193796    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:03.194006 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.193863    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:05.193843819 +0000 UTC m=+5.030352634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:03.194770 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.194322    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:03.194770 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.194380    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:05.194361684 +0000 UTC m=+5.030870502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:03.295424 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.294715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:03.295424 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.294878    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:03.295424 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.294901    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:03.295424 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.294932    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:03.295424 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.294998    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:05.294977551 +0000 UTC m=+5.131486370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:03.626188 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.626137    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 12:53:02 +0000 UTC" deadline="2028-03-22 20:25:44.979422078 +0000 UTC"
Sep 14 12:58:03.626188 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.626184    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13327h27m41.353242802s"
Sep 14 12:58:03.677235 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.677197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:03.677431 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.677355    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:03.677856 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.677809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:03.677974 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.677924    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:03.678052 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:03.678014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:03.678117 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:03.678097    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:04.423105 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:04.423028    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 12:58:05.210509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.210453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:05.211011 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.210531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:05.211011 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.210716    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:05.211011 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.210781    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:09.210760303 +0000 UTC m=+9.047269125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:05.211269 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.211241    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:05.211354 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.211302    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:09.211285446 +0000 UTC m=+9.047794263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:05.311247 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.311210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:05.311440 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.311387    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:05.311440 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.311406    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:05.311440 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.311420    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:05.311624 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.311477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:09.31145892 +0000 UTC m=+9.147967741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:05.677237 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.677196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:05.677432 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.677356    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:05.677794 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.677770    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:05.677889 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.677875    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:05.677973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:05.677936    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:05.678060 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:05.678039    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:07.677473 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:07.677438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:07.678013 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:07.677451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:07.678013 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:07.677581    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:07.678013 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:07.677602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:07.678013 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:07.677713    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:07.678013 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:07.677815    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:09.248244 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.248004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:09.248687 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.248269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:09.248687 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.248189    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:09.248687 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.248392    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:09.248687 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.248416    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:17.248393079 +0000 UTC m=+17.084901911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:09.248687 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.248444    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:17.248427453 +0000 UTC m=+17.084936268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:09.349553 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.349518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:09.349745 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.349679    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:09.349745 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.349705    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:09.349745 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.349715    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:09.349907 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.349767    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:17.349752924 +0000 UTC m=+17.186261736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:09.677829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.677528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:09.677829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.677686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:09.677829 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.677688    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:09.677829 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.677831    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:09.678205 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:09.677893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:09.678205 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:09.677973    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:11.676636 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:11.676606    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:11.677100 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:11.676738    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:11.677100 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:11.677034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:11.677205 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:11.677108    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:11.677205 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:11.677151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:11.677205 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:11.677193    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:13.676790 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:13.676755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:13.677192 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:13.676755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:13.677192 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:13.676858    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:13.677192 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:13.676755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:13.677192 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:13.676948    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:13.677192 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:13.677056    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:15.676674 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:15.676636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:15.677108 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:15.676688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:15.677108 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:15.676748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:15.677108 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:15.676757    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:15.677108 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:15.676838    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:15.677108 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:15.676920    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:17.306220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.306184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:17.306602 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.306266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:17.306602 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.306347    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:17.306602 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.306348    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:17.306602 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.306406    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:33.306388877 +0000 UTC m=+33.142897692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:17.306602 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.306420    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:58:33.306413914 +0000 UTC m=+33.142922726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:17.407410 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.407374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:17.407565 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.407508    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:17.407565 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.407523    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:17.407565 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.407533    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:17.407692 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.407578    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:33.407563773 +0000 UTC m=+33.244072585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:17.677388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.677308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:17.677388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.677350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:17.677388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:17.677352    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:17.677658 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.677437    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:17.677658 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.677503    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:17.677658 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:17.677600    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:19.676499 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:19.676456    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:19.677067 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:19.676506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:19.677067 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:19.676456    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:19.677067 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:19.676592    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:19.677067 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:19.676710    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:19.677067 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:19.676830    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:21.676692 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.676474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:21.677395 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.676628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:21.677395 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:21.676780    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:21.677395 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.676642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:21.677395 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:21.676911    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:21.677395 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:21.676987    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:21.882939 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.882900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pzl5j" event={"ID":"f0198e44-8a37-444d-a47f-c54549d5551d","Type":"ContainerStarted","Data":"5293679f8bb392086108ea84a4f270d902469ca3d48f1904d7af9b1b6a8b1130"}
Sep 14 12:58:21.887191 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.887142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p5zh8" event={"ID":"bfba470d-95e0-4d59-a22c-62eff4f91ff2","Type":"ContainerStarted","Data":"9cd7801f5a3070519b5253f81366de26e6863719d23b4fc37532d69f891ca695"}
Sep 14 12:58:21.894237 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.894193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" event={"ID":"e14f36cc9cd4b7b9c71314199a9dd97e","Type":"ContainerStarted","Data":"97210ffd53405700f707bd78a5656822ce025ab2f8ed69226d4e22610ce23625"}
Sep 14 12:58:21.902986 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.902619    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 12:58:21.903079 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903054    2559 generic.go:356] "Generic (PLEG): container finished" podID="973513d5-904f-4e9b-8b01-cc403a4e44d9" containerID="5f434486b71b7808256f5377fbafb729ee5f5026ce872727198c81cc193a9f83" exitCode=1
Sep 14 12:58:21.903109 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"db96f960598d965d296438d18cd171f1ace05fe06509a52d4af6ccad38839005"}
Sep 14 12:58:21.903555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"aaf986e7bf7514226b9aee82db202b3b64bd2e0ea5318362266c62500d519cbd"}
Sep 14 12:58:21.903555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"4f509ed37c2b73500c886bc3c6e7b3796730529fbabeb370ac6d61dc7edc14ee"}
Sep 14 12:58:21.903555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerDied","Data":"5f434486b71b7808256f5377fbafb729ee5f5026ce872727198c81cc193a9f83"}
Sep 14 12:58:21.903555 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.903319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"5850b526a211e4fea3d3f007459144a471eca804ed5938beb0b7658977721b31"}
Sep 14 12:58:21.973867 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:21.972975    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pzl5j" podStartSLOduration=1.690063178 podStartE2EDuration="20.972952833s" totalImagesPullingTime="19.282889655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:21.921251869 +0000 UTC m=+21.757760704" watchObservedRunningTime="2026-09-14 12:58:21.972952833 +0000 UTC m=+21.809461671"
Sep 14 12:58:22.008980 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.008920    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p5zh8" podStartSLOduration=1.378334091 podStartE2EDuration="21.008902242s" totalImagesPullingTime="19.630568151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:21.974561093 +0000 UTC m=+21.811069941" watchObservedRunningTime="2026-09-14 12:58:22.008902242 +0000 UTC m=+21.845411067"
Sep 14 12:58:22.009570 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.009525    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-35.ec2.internal" podStartSLOduration=20.009512692 podStartE2EDuration="20.009512692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:22.008817061 +0000 UTC m=+21.845325896" watchObservedRunningTime="2026-09-14 12:58:22.009512692 +0000 UTC m=+21.846021526"
Sep 14 12:58:22.906988 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.906902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ztnhx" event={"ID":"89f7afff-11d3-445f-a94c-7787e0268e90","Type":"ContainerStarted","Data":"a30867e3571587c2cc4e56915aeb8aab9d1b952dcb1d0ee3789915afc06a8bce"}
Sep 14 12:58:22.908700 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.908665    2559 generic.go:356] "Generic (PLEG): container finished" podID="73c7cb59bce5441fc972c77ff5e881da" containerID="44e754d02894a1a9ec22d5a7e98d57f6c252378884bdc670f2c7067cd913349c" exitCode=0
Sep 14 12:58:22.908835 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.908756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"73c7cb59bce5441fc972c77ff5e881da","Type":"ContainerDied","Data":"44e754d02894a1a9ec22d5a7e98d57f6c252378884bdc670f2c7067cd913349c"}
Sep 14 12:58:22.910519 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.910461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwjsd" event={"ID":"53170467-8c0d-4b4b-ae4f-40d5af9cdfde","Type":"ContainerStarted","Data":"5eed16edfb75163e971e7b00512b849ae4d3d8ab6ffc26081796e85af598e6ef"}
Sep 14 12:58:22.912159 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.912131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnc7p" event={"ID":"993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff","Type":"ContainerStarted","Data":"92f2ca280e70726bfc7e6ee9a287367edbdaad6dd135039802846f4425e4ddea"}
Sep 14 12:58:22.913954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.913932    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="9795f2a036459b72381b7340bf6acb3a16982ab3c66c632b01e7a8699ec11487" exitCode=0
Sep 14 12:58:22.914057 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.913997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"9795f2a036459b72381b7340bf6acb3a16982ab3c66c632b01e7a8699ec11487"}
Sep 14 12:58:22.918092 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.918040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn" event={"ID":"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8","Type":"ContainerStarted","Data":"456fc04791ef309cf197ce4dcc43b7e36823db0d4f81081f8e63c009779ed5a8"}
Sep 14 12:58:22.920427 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.920403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42gqn" event={"ID":"e7533ba1-9705-411d-ad8f-d099e90a6f7e","Type":"ContainerStarted","Data":"72772e8529866f280739c2c13582705d7674641558685f5f4920677aeeff03cb"}
Sep 14 12:58:22.924034 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.924013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 12:58:22.924407 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.924388    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"9d315e5def089126fd435ba99585deac669699ab09930cfd3e4ba635d9590935"}
Sep 14 12:58:22.973367 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.973309    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lwjsd" podStartSLOduration=2.734262399 podStartE2EDuration="21.973289914s" totalImagesPullingTime="19.239027515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:22.972195954 +0000 UTC m=+22.808704799" watchObservedRunningTime="2026-09-14 12:58:22.973289914 +0000 UTC m=+22.809798749"
Sep 14 12:58:22.973967 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:22.973921    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ztnhx" podStartSLOduration=2.662332711 podStartE2EDuration="21.973908386s" totalImagesPullingTime="19.311575675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:22.934826451 +0000 UTC m=+22.771335298" watchObservedRunningTime="2026-09-14 12:58:22.973908386 +0000 UTC m=+22.810417220"
Sep 14 12:58:23.036922 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.036851    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-42gqn" podStartSLOduration=2.774251718 podStartE2EDuration="22.036836725s" totalImagesPullingTime="19.262585007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:23.0008453 +0000 UTC m=+22.837354146" watchObservedRunningTime="2026-09-14 12:58:23.036836725 +0000 UTC m=+22.873345559"
Sep 14 12:58:23.108270 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.108222    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnc7p" podStartSLOduration=6.752590831 podStartE2EDuration="22.108205595s" totalImagesPullingTime="15.355614764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:23.108175915 +0000 UTC m=+22.944684751" watchObservedRunningTime="2026-09-14 12:58:23.108205595 +0000 UTC m=+22.944714429"
Sep 14 12:58:23.140642 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.140609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:23.141212 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.141189    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:23.455407 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.455381    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 12:58:23.636258 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.636136    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T12:58:23.45539931Z","UUID":"0a03f9a9-fde5-4f44-9248-c3db5fc6402c","Handler":null,"Name":"","Endpoint":""}
Sep 14 12:58:23.637667 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.637644    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 12:58:23.637786 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.637673    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 12:58:23.677190 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.677158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:23.677190 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.677191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:23.677445 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.677279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:23.677445 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:23.677291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:23.677445 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:23.677401    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:23.677578 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:23.677485    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:23.928644 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.928602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn" event={"ID":"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8","Type":"ContainerStarted","Data":"1eaa45f806aa4a08512bb14ab332cbf517508ceffa10d66fe7cf1c964f036720"}
Sep 14 12:58:23.930622 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.930595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" event={"ID":"73c7cb59bce5441fc972c77ff5e881da","Type":"ContainerStarted","Data":"973f8f2c141f88843f09a19750a1b414378f224b3a9384a750acc2edb764fb9e"}
Sep 14 12:58:23.930808 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.930789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:23.931762 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.931745    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnc7p"
Sep 14 12:58:23.961522 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:23.961459    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-35.ec2.internal" podStartSLOduration=21.961439781 podStartE2EDuration="21.961439781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:23.961161764 +0000 UTC m=+23.797670623" watchObservedRunningTime="2026-09-14 12:58:23.961439781 +0000 UTC m=+23.797948616"
Sep 14 12:58:24.935594 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:24.935335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn" event={"ID":"452f63cc-c0ac-4c49-8d2d-30ebe5f0d9a8","Type":"ContainerStarted","Data":"2bcce4732d0fe537825c81a7d1b0c946729a1760996b4e3517807f0c6e481a0d"}
Sep 14 12:58:24.938333 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:24.938313    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 12:58:24.938653 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:24.938633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"5f03f0d4185291bee617e447db85e36b74e69591781e534866141c2455aaf4ef"}
Sep 14 12:58:24.963552 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:24.963505    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d88tn" podStartSLOduration=1.991350191 podStartE2EDuration="23.963492331s" totalImagesPullingTime="21.97214214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:24.962435771 +0000 UTC m=+24.798944604" watchObservedRunningTime="2026-09-14 12:58:24.963492331 +0000 UTC m=+24.800001241"
Sep 14 12:58:25.676484 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:25.676449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:25.676484 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:25.676474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:25.676709 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:25.676583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:25.676709 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:25.676596    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:25.676709 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:25.676666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:25.676802 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:25.676722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:26.946795 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:26.946765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 12:58:26.947261 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:26.947199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"407101443cf5d31985067f49ac0692ba6217d80b143ebed76d9cfaec051ea286"}
Sep 14 12:58:26.947621 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:26.947592    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:26.947727 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:26.947704    2559 scope.go:117] "RemoveContainer" containerID="5f434486b71b7808256f5377fbafb729ee5f5026ce872727198c81cc193a9f83"
Sep 14 12:58:26.964697 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:26.964674    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:27.677281 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:27.677248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:27.677447 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:27.677258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:27.677447 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:27.677382    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:27.677447 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:27.677371    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:27.677594 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:27.677472    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:27.677594 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:27.677565    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:28.631619 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.631382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwwnn"]
Sep 14 12:58:28.632243 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.631708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:28.632243 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:28.631824    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:28.640706 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.640683    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wns98"]
Sep 14 12:58:28.640818 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.640780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:28.640916 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:28.640873    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:28.644174 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.644156    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-crf9v"]
Sep 14 12:58:28.644272 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.644216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:28.644315 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:28.644280    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:28.955123 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.955063    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 12:58:28.955466 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.955437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" event={"ID":"973513d5-904f-4e9b-8b01-cc403a4e44d9","Type":"ContainerStarted","Data":"cd290cb035a62bf08099cf548cb249e7cbe59cb349c649ed1d359b1f20107d1b"}
Sep 14 12:58:28.955796 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.955776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:28.955933 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.955841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:28.957397 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.957376    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="5f19fdd381c4a265fbf0e2a3c5bf8df31c817ec014b7081c108ea3b493bc1209" exitCode=0
Sep 14 12:58:28.957521 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.957411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"5f19fdd381c4a265fbf0e2a3c5bf8df31c817ec014b7081c108ea3b493bc1209"}
Sep 14 12:58:28.970984 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:28.970967    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:58:29.038954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:29.038909    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch" podStartSLOduration=8.686331528 podStartE2EDuration="28.03889563s" totalImagesPullingTime="19.352564102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:29.002044389 +0000 UTC m=+28.838553223" watchObservedRunningTime="2026-09-14 12:58:29.03889563 +0000 UTC m=+28.875404456"
Sep 14 12:58:29.676925 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:29.676895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:29.677358 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:29.676987    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:30.677221 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:30.677195    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:30.677892 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:30.677285    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:30.677892 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:30.677330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:30.677892 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:30.677379    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:30.964189 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:30.964162    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="3de4bd3f21ea7bfb600ae018ece91b7185ba7dcb6945b096bb539dce6de67fa9" exitCode=0
Sep 14 12:58:30.964313 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:30.964243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"3de4bd3f21ea7bfb600ae018ece91b7185ba7dcb6945b096bb539dce6de67fa9"}
Sep 14 12:58:31.676635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:31.676604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:31.676847 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:31.676718    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:32.680191 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:32.680156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:32.680627 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:32.680285    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wns98" podUID="b75dd968-bb0b-439b-afe0-e55c7114310c"
Sep 14 12:58:32.680627 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:32.680327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:32.680627 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:32.680411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-crf9v" podUID="c2028780-5f7e-4ceb-8333-a6b1daf07c05"
Sep 14 12:58:32.971109 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:32.971071    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="8fd24716ef45ba9d66667c97767236fc23c8db4c07ef0e7b30df34c81338e137" exitCode=0
Sep 14 12:58:32.971109 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:32.971100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"8fd24716ef45ba9d66667c97767236fc23c8db4c07ef0e7b30df34c81338e137"}
Sep 14 12:58:33.332776 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:33.332707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:33.332776 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:33.332739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:33.332974 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.332835    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:33.332974 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.332899    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:33.332974 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.332901    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret podName:c2028780-5f7e-4ceb-8333-a6b1daf07c05 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:05.332885122 +0000 UTC m=+65.169393948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret") pod "global-pull-secret-syncer-crf9v" (UID: "c2028780-5f7e-4ceb-8333-a6b1daf07c05") : object "kube-system"/"original-pull-secret" not registered
Sep 14 12:58:33.332974 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.332945    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 12:59:05.332932852 +0000 UTC m=+65.169441663 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 12:58:33.433519 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:33.433489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:33.433653 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.433620    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 12:58:33.433653 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.433637    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 12:58:33.433653 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.433646    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qtlf8 for pod openshift-network-diagnostics/network-check-target-rwwnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:33.433768 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.433685    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8 podName:82b05a31-142c-4b20-9122-3e5caf69ddf1 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:05.433674841 +0000 UTC m=+65.270183653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtlf8" (UniqueName: "kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8") pod "network-check-target-rwwnn" (UID: "82b05a31-142c-4b20-9122-3e5caf69ddf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 12:58:33.677001 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:33.676927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:33.677166 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:33.677041    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwwnn" podUID="82b05a31-142c-4b20-9122-3e5caf69ddf1"
Sep 14 12:58:34.430940 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.430853    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-35.ec2.internal" event="NodeReady"
Sep 14 12:58:34.431359 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.430989    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 12:58:34.478808 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.478780    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 12:58:34.495339 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.495313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.500207 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.500171    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 14 12:58:34.500360 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.500220    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 14 12:58:34.500360 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.500275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29dxj\""
Sep 14 12:58:34.500360 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.500175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 14 12:58:34.505499 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.505481    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 14 12:58:34.508198 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.508146    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 12:58:34.516524 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.516502    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r28ld"]
Sep 14 12:58:34.535504 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.535311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q4kqw"]
Sep 14 12:58:34.535504 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.535451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.538837 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.538674    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 12:58:34.538837 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.538789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 12:58:34.540183 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.540164    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4h7f4\""
Sep 14 12:58:34.561640 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.561622    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4kqw"]
Sep 14 12:58:34.561743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.561648    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r28ld"]
Sep 14 12:58:34.561743 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.561733    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.566543 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.566525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 12:58:34.566644 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.566583    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 12:58:34.567065 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.566833    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fp9b8\""
Sep 14 12:58:34.567065 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.566897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 12:58:34.643076 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643194 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643194 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-cert\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.643194 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5zq7\" (UniqueName: \"kubernetes.io/projected/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-kube-api-access-c5zq7\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.643346 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643346 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643346 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrxq\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-config-volume\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643439    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqs7\" (UniqueName: \"kubernetes.io/projected/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-kube-api-access-wbqs7\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.643509 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.643718 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.643520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-tmp-dir\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.676752 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.676728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:58:34.677124 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.676934    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:58:34.680890 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.680851    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 12:58:34.681014 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.680924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5b9s\""
Sep 14 12:58:34.681643 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.681625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 12:58:34.744104 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqs7\" (UniqueName: \"kubernetes.io/projected/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-kube-api-access-wbqs7\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.744215 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744215 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-tmp-dir\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.744309 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744309 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744439 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:34.744413    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:34.744439 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:34.744435    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:34.744585 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-cert\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.744585 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:34.744488    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:35.244469302 +0000 UTC m=+35.080978123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:34.744585 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5zq7\" (UniqueName: \"kubernetes.io/projected/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-kube-api-access-c5zq7\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.744585 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-tmp-dir\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrxq\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-config-volume\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.744764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.745052 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.745052 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.744908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.745146 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:34.745097    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:34.745197 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.745156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.745197 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:34.745171    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:35.245151396 +0000 UTC m=+35.081660222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:34.745803 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.745781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.748785 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.748749    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.748785 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.748760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.748925 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.748810    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-cert\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.749748 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.749717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:34.754448 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.754420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-config-volume\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.755965 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.755945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5zq7\" (UniqueName: \"kubernetes.io/projected/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-kube-api-access-c5zq7\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:34.756328 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.756309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.756741 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.756725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrxq\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:34.756797 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.756733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqs7\" (UniqueName: \"kubernetes.io/projected/61bc7287-f2f6-48a0-83ec-16338aaa7e5a-kube-api-access-wbqs7\") pod \"ingress-canary-q4kqw\" (UID: \"61bc7287-f2f6-48a0-83ec-16338aaa7e5a\") " pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:34.869845 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.869808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:34.871474 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:34.871454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4kqw"
Sep 14 12:58:35.192557 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.192524    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4kqw"]
Sep 14 12:58:35.197204 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:35.196974    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bc7287_f2f6_48a0_83ec_16338aaa7e5a.slice/crio-76808ac309dad1ac62638a71c28bc5a454eaac12d753cd67feed3bd91062ed40 WatchSource:0}: Error finding container 76808ac309dad1ac62638a71c28bc5a454eaac12d753cd67feed3bd91062ed40: Status 404 returned error can't find the container with id 76808ac309dad1ac62638a71c28bc5a454eaac12d753cd67feed3bd91062ed40
Sep 14 12:58:35.248942 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.248917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:35.249076 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.248995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:35.249076 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:35.249064    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:35.249163 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:35.249082    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:35.249163 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:35.249102    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:35.249163 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:35.249140    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:36.249117202 +0000 UTC m=+36.085626015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:35.249163 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:35.249159    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:36.249149593 +0000 UTC m=+36.085658404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:35.677024 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.676995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:58:35.680917 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.680895    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 12:58:35.682031 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.682005    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-578px\""
Sep 14 12:58:35.682031 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.682022    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 12:58:35.980716 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:35.980674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4kqw" event={"ID":"61bc7287-f2f6-48a0-83ec-16338aaa7e5a","Type":"ContainerStarted","Data":"76808ac309dad1ac62638a71c28bc5a454eaac12d753cd67feed3bd91062ed40"}
Sep 14 12:58:36.258459 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:36.258386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:36.258459 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:36.258457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:36.258651 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:36.258545    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:36.258651 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:36.258562    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:36.258651 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:36.258567    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:36.258651 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:36.258615    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:38.25860205 +0000 UTC m=+38.095110862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:36.258651 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:36.258635    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:38.258626187 +0000 UTC m=+38.095135000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:38.274329 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:38.274293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:38.274364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:38.274477    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:38.274476    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:38.274559    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:42.27453622 +0000 UTC m=+42.111045035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:38.274489    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:38.274823 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:38.274644    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:42.274626384 +0000 UTC m=+42.111135200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:38.991139 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:38.991106    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="5accb5b4eed774e6993ab1c0ef61d57197fe5293a2515e20cf3ab94428fb49da" exitCode=0
Sep 14 12:58:38.991255 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:38.991180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"5accb5b4eed774e6993ab1c0ef61d57197fe5293a2515e20cf3ab94428fb49da"}
Sep 14 12:58:38.992665 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:38.992641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4kqw" event={"ID":"61bc7287-f2f6-48a0-83ec-16338aaa7e5a","Type":"ContainerStarted","Data":"5aaaa6fa3187f5d74d91206074447e5b371cc19e8bf60880b213a1bcee851226"}
Sep 14 12:58:39.044475 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:39.044392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q4kqw" podStartSLOduration=1.558452359 podStartE2EDuration="5.044375445s" totalImagesPullingTime="3.485923086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:39.044333826 +0000 UTC m=+38.880842671" watchObservedRunningTime="2026-09-14 12:58:39.044375445 +0000 UTC m=+38.880884281"
Sep 14 12:58:39.733013 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:39.732977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:39.847054 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:39.847026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:39.998387 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:39.998308    2559 generic.go:356] "Generic (PLEG): container finished" podID="14916014-7e8d-4be8-810e-ef7bb4622d3d" containerID="40e53bff14db8ce692308b9a0ebba6a421476a453f3a575b26141979254c8805" exitCode=0
Sep 14 12:58:39.998517 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:39.998388    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerDied","Data":"40e53bff14db8ce692308b9a0ebba6a421476a453f3a575b26141979254c8805"}
Sep 14 12:58:41.003944 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:41.003907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" event={"ID":"14916014-7e8d-4be8-810e-ef7bb4622d3d","Type":"ContainerStarted","Data":"dd8fed4f071a2432b70d243c5bdb9d4324b56232835194a39b4fd09c6728186f"}
Sep 14 12:58:41.316566 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:41.316480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:41.427570 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:41.427542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:41.600115 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:41.600037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:41.704250 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:41.704219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:42.303613 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:42.303579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:42.303637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:42.303723    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:42.303729    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:42.303746    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:42.303772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:50.303758399 +0000 UTC m=+50.140267211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:42.304003 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:42.303785    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:50.303779156 +0000 UTC m=+50.140287967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:44.797864 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:44.797825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:44.889792 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:44.889754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:47.905226 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:47.905184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:48.142891 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:48.142858    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:48.329946 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:48.329916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:49.308386 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:49.308348    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:49.451190 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:49.451150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log" limit=1024
Sep 14 12:58:50.355416 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:50.355370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:50.355432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:50.355530    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:50.355596    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.355579793 +0000 UTC m=+66.192088610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:50.355536    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:50.355636    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:58:50.355798 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:50.355682    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.355671096 +0000 UTC m=+66.192179908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:58:59.192346 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.192249    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wvlxf" podStartSLOduration=25.428969662 podStartE2EDuration="58.192235355s" totalImagesPullingTime="32.763265693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:58:41.056166491 +0000 UTC m=+40.892675334" watchObservedRunningTime="2026-09-14 12:58:59.192235355 +0000 UTC m=+59.028744188"
Sep 14 12:58:59.193618 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.193592    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"]
Sep 14 12:58:59.195948 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.195930    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-z75ld"]
Sep 14 12:58:59.196074 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.196056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.198814 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.198797    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"]
Sep 14 12:58:59.198993 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.198969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.199825 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.199802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.199935 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.199812    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 14 12:58:59.199935 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.199812    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.200049 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.199955    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bq8jn\""
Sep 14 12:58:59.200844 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.200830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"
Sep 14 12:58:59.204227 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.204210    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nrp6c\""
Sep 14 12:58:59.206791 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.206774    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 14 12:58:59.206872 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.206857    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.207024 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.207007    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 14 12:58:59.207381 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.207365    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.210915 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.210895    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pqbnx\""
Sep 14 12:58:59.218554 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.218515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-z75ld"]
Sep 14 12:58:59.221060 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.221037    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 14 12:58:59.265924 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.265895    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"]
Sep 14 12:58:59.284673 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.284647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"]
Sep 14 12:58:59.316716 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-tmp\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.316824 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-snapshots\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.316824 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6469a-50ab-4c5f-baea-782c744a3328-serving-cert\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.316925 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-service-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.316925 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mxx\" (UniqueName: \"kubernetes.io/projected/2d13120a-1ddf-4331-b685-354490677fc9-kube-api-access-f5mxx\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.316989 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/63c766c1-1d16-442c-803b-641bda6d8c5d-kube-api-access-qmrw6\") pod \"network-check-source-6f8b768455-72kvz\" (UID: \"63c766c1-1d16-442c-803b-641bda6d8c5d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"
Sep 14 12:58:59.316989 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.316977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.317047 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.317025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-trusted-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.317115 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.317048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cr8z\" (UniqueName: \"kubernetes.io/projected/65e6469a-50ab-4c5f-baea-782c744a3328-kube-api-access-8cr8z\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418122 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-snapshots\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418122 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6469a-50ab-4c5f-baea-782c744a3328-serving-cert\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418283 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-service-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418283 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mxx\" (UniqueName: \"kubernetes.io/projected/2d13120a-1ddf-4331-b685-354490677fc9-kube-api-access-f5mxx\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.418353 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/63c766c1-1d16-442c-803b-641bda6d8c5d-kube-api-access-qmrw6\") pod \"network-check-source-6f8b768455-72kvz\" (UID: \"63c766c1-1d16-442c-803b-641bda6d8c5d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"
Sep 14 12:58:59.418353 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.418495 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-trusted-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418554 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cr8z\" (UniqueName: \"kubernetes.io/projected/65e6469a-50ab-4c5f-baea-782c744a3328-kube-api-access-8cr8z\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418608 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-tmp\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418796 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-snapshots\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418917 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.418872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65e6469a-50ab-4c5f-baea-782c744a3328-tmp\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.418917 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.418908    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 12:58:59.418998 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.418979    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls podName:2d13120a-1ddf-4331-b685-354490677fc9 nodeName:}" failed. No retries permitted until 2026-09-14 12:58:59.918961467 +0000 UTC m=+59.755470292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-lgnnj" (UID: "2d13120a-1ddf-4331-b685-354490677fc9") : secret "samples-operator-tls" not found
Sep 14 12:58:59.419046 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.419029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-service-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.419241 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.419226    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bfb5dc75b-tzm4f"]
Sep 14 12:58:59.419373 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.419351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e6469a-50ab-4c5f-baea-782c744a3328-trusted-ca-bundle\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.421843 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.421819    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65e6469a-50ab-4c5f-baea-782c744a3328-serving-cert\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.423856 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.423842    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.431361 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.431340    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nqt75\""
Sep 14 12:58:59.431458 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.431381    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 14 12:58:59.431528 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.431477    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 14 12:58:59.431650 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.431636    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 14 12:58:59.431982 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.431964    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 12:58:59.432399 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.432386    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 12:58:59.433759 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.433746    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 14 12:58:59.437675 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.437654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/63c766c1-1d16-442c-803b-641bda6d8c5d-kube-api-access-qmrw6\") pod \"network-check-source-6f8b768455-72kvz\" (UID: \"63c766c1-1d16-442c-803b-641bda6d8c5d\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"
Sep 14 12:58:59.440313 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.440292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mxx\" (UniqueName: \"kubernetes.io/projected/2d13120a-1ddf-4331-b685-354490677fc9-kube-api-access-f5mxx\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.441227 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.441204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cr8z\" (UniqueName: \"kubernetes.io/projected/65e6469a-50ab-4c5f-baea-782c744a3328-kube-api-access-8cr8z\") pod \"insights-operator-5844b856db-z75ld\" (UID: \"65e6469a-50ab-4c5f-baea-782c744a3328\") " pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.450187 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.450134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bfb5dc75b-tzm4f"]
Sep 14 12:58:59.511938 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.511913    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-z75ld"
Sep 14 12:58:59.517022 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.517005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"
Sep 14 12:58:59.620327 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.620273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-default-certificate\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.620456 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.620349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.620456 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.620391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-stats-auth\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.620456 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.620433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.620576 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.620458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7nl\" (UniqueName: \"kubernetes.io/projected/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-kube-api-access-kr7nl\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721087 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.721059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-default-certificate\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.721102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.721136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-stats-auth\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.721162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721220 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.721180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7nl\" (UniqueName: \"kubernetes.io/projected/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-kube-api-access-kr7nl\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.721423 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.721228    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:58:59.721423 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.721305    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.22128426 +0000 UTC m=+60.057793077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:58:59.721423 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.721326    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.221314874 +0000 UTC m=+60.057823692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:58:59.723382 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.723362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-default-certificate\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.723649 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.723631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-stats-auth\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.740600 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.740572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7nl\" (UniqueName: \"kubernetes.io/projected/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-kube-api-access-kr7nl\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:58:59.816520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.816493    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-z75ld"]
Sep 14 12:58:59.819435 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:59.819410    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e6469a_50ab_4c5f_baea_782c744a3328.slice/crio-2e0645bbc9cae94f1a7951f04956c6dd1730910ae404cabb386541b7c82a2846 WatchSource:0}: Error finding container 2e0645bbc9cae94f1a7951f04956c6dd1730910ae404cabb386541b7c82a2846: Status 404 returned error can't find the container with id 2e0645bbc9cae94f1a7951f04956c6dd1730910ae404cabb386541b7c82a2846
Sep 14 12:58:59.865720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.865697    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-72kvz"]
Sep 14 12:58:59.872058 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:58:59.872037    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c766c1_1d16_442c_803b_641bda6d8c5d.slice/crio-16f053b062bb67ce697b3dd09724380e5ca798f23e697bfb620abb41baa4e26d WatchSource:0}: Error finding container 16f053b062bb67ce697b3dd09724380e5ca798f23e697bfb620abb41baa4e26d: Status 404 returned error can't find the container with id 16f053b062bb67ce697b3dd09724380e5ca798f23e697bfb620abb41baa4e26d
Sep 14 12:58:59.922221 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:58:59.922198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:58:59.922358 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.922343    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 12:58:59.922407 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:58:59.922398    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls podName:2d13120a-1ddf-4331-b685-354490677fc9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:00.922381638 +0000 UTC m=+60.758890454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-lgnnj" (UID: "2d13120a-1ddf-4331-b685-354490677fc9") : secret "samples-operator-tls" not found
Sep 14 12:59:00.049910 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.049827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz" event={"ID":"63c766c1-1d16-442c-803b-641bda6d8c5d","Type":"ContainerStarted","Data":"16f053b062bb67ce697b3dd09724380e5ca798f23e697bfb620abb41baa4e26d"}
Sep 14 12:59:00.050968 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.050947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-z75ld" event={"ID":"65e6469a-50ab-4c5f-baea-782c744a3328","Type":"ContainerStarted","Data":"2e0645bbc9cae94f1a7951f04956c6dd1730910ae404cabb386541b7c82a2846"}
Sep 14 12:59:00.225112 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.225083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:00.225522 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.225295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:00.225522 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:00.225351    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:01.225329676 +0000 UTC m=+61.061838491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:59:00.225522 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:00.225432    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:59:00.225522 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:00.225487    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:01.225468281 +0000 UTC m=+61.061977094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:59:00.931999 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.931958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:00.932215 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:00.932125    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 12:59:00.932215 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:00.932204    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls podName:2d13120a-1ddf-4331-b685-354490677fc9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:02.932183832 +0000 UTC m=+62.768692649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-lgnnj" (UID: "2d13120a-1ddf-4331-b685-354490677fc9") : secret "samples-operator-tls" not found
Sep 14 12:59:00.982838 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:00.982811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8jch"
Sep 14 12:59:01.234000 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:01.233933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:01.234433 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:01.234078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:01.234433 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:01.234107    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:59:01.234433 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:01.234224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.234203356 +0000 UTC m=+63.070712182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:59:01.234433 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:01.234328    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.234309205 +0000 UTC m=+63.070818040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:59:02.058783 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:02.058749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-z75ld" event={"ID":"65e6469a-50ab-4c5f-baea-782c744a3328","Type":"ContainerStarted","Data":"6f99cf1e22c3c33c301806822b9ebb410f80627541d99f1c0d7080b473f7fd9b"}
Sep 14 12:59:02.080488 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:02.080422    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-z75ld" podStartSLOduration=1.250001323 podStartE2EDuration="3.08040155s" totalImagesPullingTime="1.830400227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:02.078616724 +0000 UTC m=+61.915125596" watchObservedRunningTime="2026-09-14 12:59:02.08040155 +0000 UTC m=+61.916910385"
Sep 14 12:59:02.947235 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:02.947164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:02.947578 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:02.947324    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 12:59:02.947578 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:02.947385    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls podName:2d13120a-1ddf-4331-b685-354490677fc9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.947369403 +0000 UTC m=+66.783878238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-lgnnj" (UID: "2d13120a-1ddf-4331-b685-354490677fc9") : secret "samples-operator-tls" not found
Sep 14 12:59:03.064342 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.064295    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz" event={"ID":"63c766c1-1d16-442c-803b-641bda6d8c5d","Type":"ContainerStarted","Data":"aea3a5c96af8c4ebd3f191c65185c3e8b6ea0beadf682247c389bb0c6da32e16"}
Sep 14 12:59:03.075024 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.074995    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjp"]
Sep 14 12:59:03.077527 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.077505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.080445 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.080423    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 12:59:03.080549 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.080505    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 12:59:03.080615 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.080559    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pk74f\""
Sep 14 12:59:03.097451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.097433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjp"]
Sep 14 12:59:03.137467 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.137422    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-72kvz" podStartSLOduration=1.330323812 podStartE2EDuration="4.137408291s" totalImagesPullingTime="2.807084479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:03.099819192 +0000 UTC m=+62.936328026" watchObservedRunningTime="2026-09-14 12:59:03.137408291 +0000 UTC m=+62.973917117"
Sep 14 12:59:03.148954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.148933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.149122 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.149097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.149201 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.149148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/955dfa97-f575-418c-a8e1-5db579097e89-crio-socket\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.149266 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.149212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s74h\" (UniqueName: \"kubernetes.io/projected/955dfa97-f575-418c-a8e1-5db579097e89-kube-api-access-8s74h\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.149318 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.149268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/955dfa97-f575-418c-a8e1-5db579097e89-data-volume\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250421 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/955dfa97-f575-418c-a8e1-5db579097e89-data-volume\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250688 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:03.250688 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250528    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:07.250515808 +0000 UTC m=+67.087024619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:59:03.250688 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250688 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250688 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/955dfa97-f575-418c-a8e1-5db579097e89-data-volume\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/955dfa97-f575-418c-a8e1-5db579097e89-crio-socket\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/955dfa97-f575-418c-a8e1-5db579097e89-crio-socket\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250777    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.250807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s74h\" (UniqueName: \"kubernetes.io/projected/955dfa97-f575-418c-a8e1-5db579097e89-kube-api-access-8s74h\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250816    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250831    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.750814714 +0000 UTC m=+63.587323538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250871    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:03.750856185 +0000 UTC m=+63.587365003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250921    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:59:03.250955 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.250952    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:07.250943115 +0000 UTC m=+67.087451928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:59:03.260818 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.260801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s74h\" (UniqueName: \"kubernetes.io/projected/955dfa97-f575-418c-a8e1-5db579097e89-kube-api-access-8s74h\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.755265 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.755235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.755404 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:03.755276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:03.755404 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.755352    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.755478 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.755417    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:04.755403453 +0000 UTC m=+64.591912265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:03.755478 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.755434    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:03.755555 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:03.755479    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:04.755464877 +0000 UTC m=+64.591973692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:04.376066 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:04.376038    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-42gqn_e7533ba1-9705-411d-ad8f-d099e90a6f7e/dns-node-resolver/0.log"
Sep 14 12:59:04.762527 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:04.762494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:04.762701 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:04.762534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:04.762701 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:04.762619    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:04.762701 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:04.762628    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:04.762701 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:04.762690    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.762673998 +0000 UTC m=+66.599182814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:04.762942 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:04.762716    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:06.762700497 +0000 UTC m=+66.599209309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:05.367728 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.367687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:59:05.367728 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.367729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 12:59:05.419357 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.419326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 12:59:05.428457 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:05.428419    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 14 12:59:05.428582 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:05.428518    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs podName:b75dd968-bb0b-439b-afe0-e55c7114310c nodeName:}" failed. No retries permitted until 2026-09-14 13:00:09.428494923 +0000 UTC m=+129.265003734 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs") pod "network-metrics-daemon-wns98" (UID: "b75dd968-bb0b-439b-afe0-e55c7114310c") : secret "metrics-daemon-secret" not found
Sep 14 12:59:05.447246 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.447218    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 12:59:05.450392 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.450367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2028780-5f7e-4ceb-8333-a6b1daf07c05-original-pull-secret\") pod \"global-pull-secret-syncer-crf9v\" (UID: \"c2028780-5f7e-4ceb-8333-a6b1daf07c05\") " pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:59:05.468117 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.468092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:59:05.470485 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.470460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtlf8\" (UniqueName: \"kubernetes.io/projected/82b05a31-142c-4b20-9122-3e5caf69ddf1-kube-api-access-qtlf8\") pod \"network-check-target-rwwnn\" (UID: \"82b05a31-142c-4b20-9122-3e5caf69ddf1\") " pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:59:05.524298 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.524270    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwjsd_53170467-8c0d-4b4b-ae4f-40d5af9cdfde/node-ca/0.log"
Sep 14 12:59:05.588839 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.588803    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-crf9v"
Sep 14 12:59:05.690773 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.690745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-578px\""
Sep 14 12:59:05.698031 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.698011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:59:05.858679 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.858655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-crf9v"]
Sep 14 12:59:05.859514 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:05.859488    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2028780_5f7e_4ceb_8333_a6b1daf07c05.slice/crio-cc79d2ad43887724d8c914ea07b9c7e454d2f087e42ff98861d969ec1558df6e WatchSource:0}: Error finding container cc79d2ad43887724d8c914ea07b9c7e454d2f087e42ff98861d969ec1558df6e: Status 404 returned error can't find the container with id cc79d2ad43887724d8c914ea07b9c7e454d2f087e42ff98861d969ec1558df6e
Sep 14 12:59:05.979262 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:05.979223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwwnn"]
Sep 14 12:59:05.981560 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:05.981533    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b05a31_142c_4b20_9122_3e5caf69ddf1.slice/crio-8905b4b00b9594dbb9b1b273310206f418eab034a84d4e2ffa79b1e3ffb26493 WatchSource:0}: Error finding container 8905b4b00b9594dbb9b1b273310206f418eab034a84d4e2ffa79b1e3ffb26493: Status 404 returned error can't find the container with id 8905b4b00b9594dbb9b1b273310206f418eab034a84d4e2ffa79b1e3ffb26493
Sep 14 12:59:06.075295 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.075252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-crf9v" event={"ID":"c2028780-5f7e-4ceb-8333-a6b1daf07c05","Type":"ContainerStarted","Data":"cc79d2ad43887724d8c914ea07b9c7e454d2f087e42ff98861d969ec1558df6e"}
Sep 14 12:59:06.076866 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.076838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwwnn" event={"ID":"82b05a31-142c-4b20-9122-3e5caf69ddf1","Type":"ContainerStarted","Data":"9965255c115f39b5fc119fa69e32a42f45d2858afa297ef034c17a6e94d33079"}
Sep 14 12:59:06.076987 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.076889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwwnn" event={"ID":"82b05a31-142c-4b20-9122-3e5caf69ddf1","Type":"ContainerStarted","Data":"8905b4b00b9594dbb9b1b273310206f418eab034a84d4e2ffa79b1e3ffb26493"}
Sep 14 12:59:06.076987 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.076960    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:59:06.097169 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.097120    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rwwnn" podStartSLOduration=65.097102468 podStartE2EDuration="1m5.097102468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:06.096707713 +0000 UTC m=+65.933216546" watchObservedRunningTime="2026-09-14 12:59:06.097102468 +0000 UTC m=+65.933611303"
Sep 14 12:59:06.374184 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.374096    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4kqw_61bc7287-f2f6-48a0-83ec-16338aaa7e5a/serve-healthcheck-canary/0.log"
Sep 14 12:59:06.377228 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.377199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:59:06.377341 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.377249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:06.377341 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.377335    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 12:59:06.377415 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.377385    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls podName:dca459ee-1d98-4ab8-83d8-f1aadab5a7c2 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:38.377369483 +0000 UTC m=+98.213878298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls") pod "dns-default-r28ld" (UID: "dca459ee-1d98-4ab8-83d8-f1aadab5a7c2") : secret "dns-default-metrics-tls" not found
Sep 14 12:59:06.377469 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.377454    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 14 12:59:06.377510 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.377471    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf446d5f-9zd9g: secret "image-registry-tls" not found
Sep 14 12:59:06.377542 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.377522    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls podName:4573f87e-0637-44f9-9a19-31a7efd358a4 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:38.377512419 +0000 UTC m=+98.214021231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls") pod "image-registry-6cf446d5f-9zd9g" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4") : secret "image-registry-tls" not found
Sep 14 12:59:06.781076 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.781037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:06.781505 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.781094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:06.781505 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.781168    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:06.781505 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.781255    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:06.781505 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.781262    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:10.781240149 +0000 UTC m=+70.617748967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:06.781505 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.781324    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:10.781305364 +0000 UTC m=+70.617814179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:06.982714 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:06.982673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:06.982913 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.982839    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 14 12:59:06.982994 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:06.982938    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls podName:2d13120a-1ddf-4331-b685-354490677fc9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:14.982916181 +0000 UTC m=+74.819424993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-lgnnj" (UID: "2d13120a-1ddf-4331-b685-354490677fc9") : secret "samples-operator-tls" not found
Sep 14 12:59:07.285152 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:07.285112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:07.285349 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:07.285206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:07.285349 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:07.285298    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.285276075 +0000 UTC m=+75.121784887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:59:07.285475 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:07.285372    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:59:07.285475 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:07.285434    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:15.285416761 +0000 UTC m=+75.121925574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:59:10.815011 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:10.814968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:10.815011 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:10.815014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:10.815491 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:10.815115    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:10.815491 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:10.815125    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 12:59:10.815491 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:10.815186    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:18.815172299 +0000 UTC m=+78.651681110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:10.815491 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:10.815212    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:18.815192083 +0000 UTC m=+78.651700915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : configmap "kube-rbac-proxy" not found
Sep 14 12:59:11.093121 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:11.093037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-crf9v" event={"ID":"c2028780-5f7e-4ceb-8333-a6b1daf07c05","Type":"ContainerStarted","Data":"59d563bba8a7093024fa7db3250593dd355e82a6a5c6e2322ed06a5f692f4f0c"}
Sep 14 12:59:11.117856 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:11.117803    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-crf9v" podStartSLOduration=65.729214727 podStartE2EDuration="1m10.117788207s" totalImagesPullingTime="4.38857348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:11.116900781 +0000 UTC m=+70.953409608" watchObservedRunningTime="2026-09-14 12:59:11.117788207 +0000 UTC m=+70.954297040"
Sep 14 12:59:15.048342 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.048298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:15.050677 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.050653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2d13120a-1ddf-4331-b685-354490677fc9-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-lgnnj\" (UID: \"2d13120a-1ddf-4331-b685-354490677fc9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:15.109863 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.109833    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bq8jn\""
Sep 14 12:59:15.116337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.116319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"
Sep 14 12:59:15.350138 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.350042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:15.350138 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.350110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:15.350329 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:15.350217    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 12:59:15.350329 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:15.350260    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:31.350241783 +0000 UTC m=+91.186750594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : configmap references non-existent config key: service-ca.crt
Sep 14 12:59:15.350329 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:15.350287    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs podName:34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:31.350279209 +0000 UTC m=+91.186788020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs") pod "router-default-7bfb5dc75b-tzm4f" (UID: "34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9") : secret "router-metrics-certs-default" not found
Sep 14 12:59:15.386016 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:15.385980    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj"]
Sep 14 12:59:16.111811 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:16.111764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj" event={"ID":"2d13120a-1ddf-4331-b685-354490677fc9","Type":"ContainerStarted","Data":"3f8a3f024e7873f7e037c9a00bdcf1bcc14bf026d8bb68f65eee6e6b09fb6b55"}
Sep 14 12:59:18.119337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.119300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj" event={"ID":"2d13120a-1ddf-4331-b685-354490677fc9","Type":"ContainerStarted","Data":"20fe410569cdb076e19181274c8f813efea5f982bb9c84fc0b0a5a20a604db98"}
Sep 14 12:59:18.119838 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.119363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj" event={"ID":"2d13120a-1ddf-4331-b685-354490677fc9","Type":"ContainerStarted","Data":"68f8f5b829d52f223946cb23e53105c4dcac826b45ac8dc05f190f737d368283"}
Sep 14 12:59:18.138050 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.137995    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-lgnnj" podStartSLOduration=17.342264671 podStartE2EDuration="19.137979607s" totalImagesPullingTime="1.795714936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:18.137099546 +0000 UTC m=+77.973608380" watchObservedRunningTime="2026-09-14 12:59:18.137979607 +0000 UTC m=+77.974488494"
Sep 14 12:59:18.878934 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.878894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:18.878934 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.878950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:18.879169 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:18.879053    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:18.879169 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:18.879105    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls podName:955dfa97-f575-418c-a8e1-5db579097e89 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:34.879092612 +0000 UTC m=+94.715601424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-smwjp" (UID: "955dfa97-f575-418c-a8e1-5db579097e89") : secret "insights-runtime-extractor-tls" not found
Sep 14 12:59:18.879587 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:18.879565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/955dfa97-f575-418c-a8e1-5db579097e89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:31.374624 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.374469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:31.374624 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.374533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:31.375291 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.375265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-service-ca-bundle\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:31.376798 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.376773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9-metrics-certs\") pod \"router-default-7bfb5dc75b-tzm4f\" (UID: \"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9\") " pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:31.536126 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.536097    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nqt75\""
Sep 14 12:59:31.544438 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.544412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:31.830933 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:31.830727    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bfb5dc75b-tzm4f"]
Sep 14 12:59:31.833440 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:31.833400    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f3c7f6_c8fd_401c_bd30_0a8f87cb36a9.slice/crio-2854b9c8b7940a45a2f282a22f6ed9dad8ee94245a745678990aee16b63f693c WatchSource:0}: Error finding container 2854b9c8b7940a45a2f282a22f6ed9dad8ee94245a745678990aee16b63f693c: Status 404 returned error can't find the container with id 2854b9c8b7940a45a2f282a22f6ed9dad8ee94245a745678990aee16b63f693c
Sep 14 12:59:32.159646 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:32.159542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f" event={"ID":"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9","Type":"ContainerStarted","Data":"882cdf842b2347524dad9d34a7de5a5d7de8b9d18dbe4ff0802e27950a852f1c"}
Sep 14 12:59:32.159646 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:32.159608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f" event={"ID":"34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9","Type":"ContainerStarted","Data":"2854b9c8b7940a45a2f282a22f6ed9dad8ee94245a745678990aee16b63f693c"}
Sep 14 12:59:32.192764 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:32.192709    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f" podStartSLOduration=33.192691724 podStartE2EDuration="33.192691724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:32.192293435 +0000 UTC m=+92.028802285" watchObservedRunningTime="2026-09-14 12:59:32.192691724 +0000 UTC m=+92.029200557"
Sep 14 12:59:32.545349 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:32.545311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:32.548161 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:32.548137    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:33.162628 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:33.162594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:33.163913 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:33.163894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bfb5dc75b-tzm4f"
Sep 14 12:59:34.389178 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.389148    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"]
Sep 14 12:59:34.392229 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.392213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:34.397791 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.397766    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 14 12:59:34.398407 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.398377    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nfjwp\""
Sep 14 12:59:34.415108 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.415075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"]
Sep 14 12:59:34.497358 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.497315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wqlcl\" (UID: \"60ca7160-7583-4ac4-8111-fab93391faa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:34.598695 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.598641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wqlcl\" (UID: \"60ca7160-7583-4ac4-8111-fab93391faa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:34.598929 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:34.598804    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 14 12:59:34.598929 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:34.598906    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates podName:60ca7160-7583-4ac4-8111-fab93391faa0 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:35.098864884 +0000 UTC m=+94.935373713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-wqlcl" (UID: "60ca7160-7583-4ac4-8111-fab93391faa0") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 14 12:59:34.900740 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.900696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:34.903089 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:34.903059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/955dfa97-f575-418c-a8e1-5db579097e89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smwjp\" (UID: \"955dfa97-f575-418c-a8e1-5db579097e89\") " pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:35.102223 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.102158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wqlcl\" (UID: \"60ca7160-7583-4ac4-8111-fab93391faa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:35.104635 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.104611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60ca7160-7583-4ac4-8111-fab93391faa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wqlcl\" (UID: \"60ca7160-7583-4ac4-8111-fab93391faa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:35.186494 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.186424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smwjp"
Sep 14 12:59:35.300520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.300480    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:35.460021 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.459985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smwjp"]
Sep 14 12:59:35.464510 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:35.464485    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955dfa97_f575_418c_a8e1_5db579097e89.slice/crio-3f3811d82bc402a7888512bf291847ebfa8ce76b3f2b4f9402f961d0a053adce WatchSource:0}: Error finding container 3f3811d82bc402a7888512bf291847ebfa8ce76b3f2b4f9402f961d0a053adce: Status 404 returned error can't find the container with id 3f3811d82bc402a7888512bf291847ebfa8ce76b3f2b4f9402f961d0a053adce
Sep 14 12:59:35.573667 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:35.573639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"]
Sep 14 12:59:35.576371 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:35.576341    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ca7160_7583_4ac4_8111_fab93391faa0.slice/crio-1f682137c60ac5c251638371d2d450ecf6e5989343f345c1377447f0b45cc88d WatchSource:0}: Error finding container 1f682137c60ac5c251638371d2d450ecf6e5989343f345c1377447f0b45cc88d: Status 404 returned error can't find the container with id 1f682137c60ac5c251638371d2d450ecf6e5989343f345c1377447f0b45cc88d
Sep 14 12:59:36.173031 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:36.172997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjp" event={"ID":"955dfa97-f575-418c-a8e1-5db579097e89","Type":"ContainerStarted","Data":"cc73e62a89c5089a5a94bc084718a5884106ec189dfa9fc942ccb3f0aebbcbc9"}
Sep 14 12:59:36.173206 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:36.173072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjp" event={"ID":"955dfa97-f575-418c-a8e1-5db579097e89","Type":"ContainerStarted","Data":"3f3811d82bc402a7888512bf291847ebfa8ce76b3f2b4f9402f961d0a053adce"}
Sep 14 12:59:36.174336 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:36.174310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl" event={"ID":"60ca7160-7583-4ac4-8111-fab93391faa0","Type":"ContainerStarted","Data":"1f682137c60ac5c251638371d2d450ecf6e5989343f345c1377447f0b45cc88d"}
Sep 14 12:59:37.082539 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:37.082506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rwwnn"
Sep 14 12:59:37.178853 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:37.178820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjp" event={"ID":"955dfa97-f575-418c-a8e1-5db579097e89","Type":"ContainerStarted","Data":"482900ec182ed72d305c15351064f8db19b6780ed45fe37828329f400b118826"}
Sep 14 12:59:38.183972 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.183864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl" event={"ID":"60ca7160-7583-4ac4-8111-fab93391faa0","Type":"ContainerStarted","Data":"bd5cfdacfc9c0a8c4f56773eae54349c2bbd5f063cec0c836f2868fc78fc9999"}
Sep 14 12:59:38.184375 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.184048    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:38.186167 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.186144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smwjp" event={"ID":"955dfa97-f575-418c-a8e1-5db579097e89","Type":"ContainerStarted","Data":"aefb13069c887b23d48a00237c95e059bf516d0ef8ecffcdba44f64a5f34b619"}
Sep 14 12:59:38.188929 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.188909    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl"
Sep 14 12:59:38.213432 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.213392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wqlcl" podStartSLOduration=2.6003881890000002 podStartE2EDuration="4.213376035s" totalImagesPullingTime="1.612987846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:38.212981858 +0000 UTC m=+98.049490703" watchObservedRunningTime="2026-09-14 12:59:38.213376035 +0000 UTC m=+98.049884868"
Sep 14 12:59:38.427935 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.427898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:59:38.428139 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.427945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:38.430328 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.430303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dca459ee-1d98-4ab8-83d8-f1aadab5a7c2-metrics-tls\") pod \"dns-default-r28ld\" (UID: \"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2\") " pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:38.430432 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.430305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"image-registry-6cf446d5f-9zd9g\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") " pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:59:38.448390 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.448333    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4h7f4\""
Sep 14 12:59:38.456730 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.456710    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:38.487483 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.487394    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-smwjp" podStartSLOduration=33.089616399 podStartE2EDuration="35.487371965s" totalImagesPullingTime="2.397755566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 12:59:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:38.296667096 +0000 UTC m=+98.133175944" watchObservedRunningTime="2026-09-14 12:59:38.487371965 +0000 UTC m=+98.323880803"
Sep 14 12:59:38.488330 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.488305    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"]
Sep 14 12:59:38.490503 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.490482    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.493455 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.493296    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q45lf\""
Sep 14 12:59:38.493455 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.493323    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 14 12:59:38.494231 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.493790    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 12:59:38.494231 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.494021    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 12:59:38.494231 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.494114    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 12:59:38.494231 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.494023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 14 12:59:38.508844 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.508815    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"]
Sep 14 12:59:38.629723 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.629684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4285b1-8e47-4557-9a65-80e6821c585e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.629723 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.629724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.629959 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.629760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.629959 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.629808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzjw\" (UniqueName: \"kubernetes.io/projected/fb4285b1-8e47-4557-9a65-80e6821c585e-kube-api-access-4fzjw\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.709051 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.708975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-29dxj\""
Sep 14 12:59:38.717009 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.716987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:59:38.730982 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.730957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.731104 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.730994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzjw\" (UniqueName: \"kubernetes.io/projected/fb4285b1-8e47-4557-9a65-80e6821c585e-kube-api-access-4fzjw\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.731104 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.731083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4285b1-8e47-4557-9a65-80e6821c585e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.731292 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.731265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.731709 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.731690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb4285b1-8e47-4557-9a65-80e6821c585e-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.733286 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.733266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.733369 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.733331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb4285b1-8e47-4557-9a65-80e6821c585e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.748508 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.748483    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r28ld"]
Sep 14 12:59:38.751592 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:38.751557    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca459ee_1d98_4ab8_83d8_f1aadab5a7c2.slice/crio-5db6f2e2a518909211391206dcd3b5d5a2a8497bf1db9bbdce79b256bea93f10 WatchSource:0}: Error finding container 5db6f2e2a518909211391206dcd3b5d5a2a8497bf1db9bbdce79b256bea93f10: Status 404 returned error can't find the container with id 5db6f2e2a518909211391206dcd3b5d5a2a8497bf1db9bbdce79b256bea93f10
Sep 14 12:59:38.755507 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.755488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzjw\" (UniqueName: \"kubernetes.io/projected/fb4285b1-8e47-4557-9a65-80e6821c585e-kube-api-access-4fzjw\") pod \"prometheus-operator-68bcd7f987-2m6k6\" (UID: \"fb4285b1-8e47-4557-9a65-80e6821c585e\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:38.800572 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:38.800539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"
Sep 14 12:59:39.002298 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.002239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 12:59:39.004636 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:39.004597    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4573f87e_0637_44f9_9a19_31a7efd358a4.slice/crio-05f20dce9a3ac6fa9eadc336a143349befb69608ec75774fc5c697919daea0b7 WatchSource:0}: Error finding container 05f20dce9a3ac6fa9eadc336a143349befb69608ec75774fc5c697919daea0b7: Status 404 returned error can't find the container with id 05f20dce9a3ac6fa9eadc336a143349befb69608ec75774fc5c697919daea0b7
Sep 14 12:59:39.083718 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.083692    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6"]
Sep 14 12:59:39.086957 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:39.086931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4285b1_8e47_4557_9a65_80e6821c585e.slice/crio-7c34f9f5b001e6fb499e298ddb9d4c85d796995e37fab2924217302d8329d497 WatchSource:0}: Error finding container 7c34f9f5b001e6fb499e298ddb9d4c85d796995e37fab2924217302d8329d497: Status 404 returned error can't find the container with id 7c34f9f5b001e6fb499e298ddb9d4c85d796995e37fab2924217302d8329d497
Sep 14 12:59:39.191678 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.191645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6" event={"ID":"fb4285b1-8e47-4557-9a65-80e6821c585e","Type":"ContainerStarted","Data":"7c34f9f5b001e6fb499e298ddb9d4c85d796995e37fab2924217302d8329d497"}
Sep 14 12:59:39.193616 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.193585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" event={"ID":"4573f87e-0637-44f9-9a19-31a7efd358a4","Type":"ContainerStarted","Data":"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"}
Sep 14 12:59:39.193753 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.193634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" event={"ID":"4573f87e-0637-44f9-9a19-31a7efd358a4","Type":"ContainerStarted","Data":"05f20dce9a3ac6fa9eadc336a143349befb69608ec75774fc5c697919daea0b7"}
Sep 14 12:59:39.193753 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.193696    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 12:59:39.195053 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.195028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r28ld" event={"ID":"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2","Type":"ContainerStarted","Data":"5db6f2e2a518909211391206dcd3b5d5a2a8497bf1db9bbdce79b256bea93f10"}
Sep 14 12:59:39.224342 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.224283    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" podStartSLOduration=98.2242614 podStartE2EDuration="1m38.2242614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:39.221273572 +0000 UTC m=+99.057782406" watchObservedRunningTime="2026-09-14 12:59:39.2242614 +0000 UTC m=+99.060770237"
Sep 14 12:59:39.733520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.733464    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 12:59:39.736032 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.736008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.740595 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.740459    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 12:59:39.741631 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.741561    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 12:59:39.741631 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.741621    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 12:59:39.742013 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.741969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 12:59:39.742013 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.741982    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 12:59:39.742195 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.742070    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7s58v\""
Sep 14 12:59:39.742195 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.742092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 12:59:39.742343 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.742211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 12:59:39.754829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.754773    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 12:59:39.841631 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.841829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.841829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsbk\" (UniqueName: \"kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.841829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.841829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.841829 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.841802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942392 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsbk\" (UniqueName: \"kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942558 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942558 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942558 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942558 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.942737 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.942576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.943306 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.943280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.943442 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.943290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.943442 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.943359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.945468 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.945442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.945789 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.945764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:39.959038 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:39.959012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsbk\" (UniqueName: \"kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk\") pod \"console-6779c54495-bl2gc\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") " pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:40.049064 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:40.048968    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:40.839667 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:40.839576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 12:59:40.842924 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:40.842868    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da1b42f_9325_47e2_aa7b_577e723dde86.slice/crio-6e3a31309cd7e767da0af08dee49fb9098656042fa7fea36624ecc9437514a77 WatchSource:0}: Error finding container 6e3a31309cd7e767da0af08dee49fb9098656042fa7fea36624ecc9437514a77: Status 404 returned error can't find the container with id 6e3a31309cd7e767da0af08dee49fb9098656042fa7fea36624ecc9437514a77
Sep 14 12:59:41.204358 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.204257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r28ld" event={"ID":"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2","Type":"ContainerStarted","Data":"51c8b939cf3bd79f787cb19920f129eca40fa8cb50cf946503ea3cdfa65d5418"}
Sep 14 12:59:41.204358 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.204326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r28ld" event={"ID":"dca459ee-1d98-4ab8-83d8-f1aadab5a7c2","Type":"ContainerStarted","Data":"fee7c8a9d3eeca5c08fd2a6b1d8da311f53517c8d9c9dbf7d4374a9a998f4025"}
Sep 14 12:59:41.204577 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.204435    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:41.205971 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.205945    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6" event={"ID":"fb4285b1-8e47-4557-9a65-80e6821c585e","Type":"ContainerStarted","Data":"2e17c9bda8641753aa2c5ccfd887aaf698333cb6e2455a0ad933fcda24e1acae"}
Sep 14 12:59:41.206104 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.205998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6" event={"ID":"fb4285b1-8e47-4557-9a65-80e6821c585e","Type":"ContainerStarted","Data":"b2fbef3b86a2b57de623c55ae6904408df36e24fe61f9f0162be85d1ac64824a"}
Sep 14 12:59:41.207062 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.207041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6779c54495-bl2gc" event={"ID":"1da1b42f-9325-47e2-aa7b-577e723dde86","Type":"ContainerStarted","Data":"6e3a31309cd7e767da0af08dee49fb9098656042fa7fea36624ecc9437514a77"}
Sep 14 12:59:41.271704 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.271659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r28ld" podStartSLOduration=65.467752296 podStartE2EDuration="1m7.271646054s" totalImagesPullingTime="1.803893758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:41.242149018 +0000 UTC m=+101.078657851" watchObservedRunningTime="2026-09-14 12:59:41.271646054 +0000 UTC m=+101.108154869"
Sep 14 12:59:41.272625 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:41.272592    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-2m6k6" podStartSLOduration=1.802212742 podStartE2EDuration="3.272582469s" totalImagesPullingTime="1.470369727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:41.271085138 +0000 UTC m=+101.107593982" watchObservedRunningTime="2026-09-14 12:59:41.272582469 +0000 UTC m=+101.109091303"
Sep 14 12:59:42.848697 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.848663    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"]
Sep 14 12:59:42.869438 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.869407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"]
Sep 14 12:59:42.869592 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.869531    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:42.872371 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.872253    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 14 12:59:42.872513 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.872490    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"]
Sep 14 12:59:42.873427 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.873404    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 14 12:59:42.873546 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.873426    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kj7hd\""
Sep 14 12:59:42.887754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.887732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.893437 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.893417    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 14 12:59:42.893609 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.893475    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 14 12:59:42.893609 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.893499    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 14 12:59:42.893609 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.893591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xtjf5\""
Sep 14 12:59:42.898931 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.898912    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"]
Sep 14 12:59:42.904853 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.904831    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-67jzm"]
Sep 14 12:59:42.922015 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.921997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:42.925042 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.925019    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 12:59:42.925388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.925303    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 12:59:42.925388 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.925321    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 12:59:42.925624 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.925606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cbw8t\""
Sep 14 12:59:42.971624 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.971752 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.971752 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvwh\" (UniqueName: \"kubernetes.io/projected/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-kube-api-access-tfvwh\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:42.971857 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:42.971857 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mzk\" (UniqueName: \"kubernetes.io/projected/40595e35-e5d2-48de-874c-c6419bc4449a-kube-api-access-q4mzk\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.972002 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:42.972002 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.972002 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.971973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40595e35-e5d2-48de-874c-c6419bc4449a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:42.972144 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.972007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:42.972144 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:42.972030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073139 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40595e35-e5d2-48de-874c-c6419bc4449a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073139 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-metrics-client-ca\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.073337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-root\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073490 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073490 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073490 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073490 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-wtmp\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073490 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvwh\" (UniqueName: \"kubernetes.io/projected/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-kube-api-access-tfvwh\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.073717 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-accelerators-collector-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073717 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-textfile\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073717 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40595e35-e5d2-48de-874c-c6419bc4449a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073717 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.073944 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mzk\" (UniqueName: \"kubernetes.io/projected/40595e35-e5d2-48de-874c-c6419bc4449a-kube-api-access-q4mzk\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.073944 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.073944 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwmv7\" (UniqueName: \"kubernetes.io/projected/7199a045-e839-4f91-9bde-5c6efc05f08d-kube-api-access-qwmv7\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.073944 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.073829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.074148 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:43.073980    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 14 12:59:43.074148 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.074039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.074148 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:43.074051    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls podName:40595e35-e5d2-48de-874c-c6419bc4449a nodeName:}" failed. No retries permitted until 2026-09-14 12:59:43.574032484 +0000 UTC m=+103.410541297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-4mrsd" (UID: "40595e35-e5d2-48de-874c-c6419bc4449a") : secret "kube-state-metrics-tls" not found
Sep 14 12:59:43.074148 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.074120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.074361 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.074261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-sys\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.074361 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.074295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.074460 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.074411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.076299 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.076271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.076896 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.076818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.076896 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.076818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.087866 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.087814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvwh\" (UniqueName: \"kubernetes.io/projected/bf8a897b-e809-4c56-8f02-ea9ec52d8a17-kube-api-access-tfvwh\") pod \"openshift-state-metrics-67dcf8c979-wwdgf\" (UID: \"bf8a897b-e809-4c56-8f02-ea9ec52d8a17\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.091106 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.091086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mzk\" (UniqueName: \"kubernetes.io/projected/40595e35-e5d2-48de-874c-c6419bc4449a-kube-api-access-q4mzk\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.175213 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwmv7\" (UniqueName: \"kubernetes.io/projected/7199a045-e839-4f91-9bde-5c6efc05f08d-kube-api-access-qwmv7\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175213 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-sys\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175213 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-metrics-client-ca\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-root\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-wtmp\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-accelerators-collector-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-textfile\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:43.175359    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 14 12:59:43.175469 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:43.175443    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls podName:7199a045-e839-4f91-9bde-5c6efc05f08d nodeName:}" failed. No retries permitted until 2026-09-14 12:59:43.675421909 +0000 UTC m=+103.511930749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls") pod "node-exporter-67jzm" (UID: "7199a045-e839-4f91-9bde-5c6efc05f08d") : secret "node-exporter-tls" not found
Sep 14 12:59:43.175928 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-sys\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175928 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-textfile\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175928 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-wtmp\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.175928 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.175830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7199a045-e839-4f91-9bde-5c6efc05f08d-root\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.176228 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.176201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-accelerators-collector-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.176362 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.176340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7199a045-e839-4f91-9bde-5c6efc05f08d-metrics-client-ca\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.178028 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.178007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.181954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.181932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"
Sep 14 12:59:43.186765 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.186739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwmv7\" (UniqueName: \"kubernetes.io/projected/7199a045-e839-4f91-9bde-5c6efc05f08d-kube-api-access-qwmv7\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.579637 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.579601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.581851 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.581825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40595e35-e5d2-48de-874c-c6419bc4449a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mrsd\" (UID: \"40595e35-e5d2-48de-874c-c6419bc4449a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.682633 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.682484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.685159 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.685109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7199a045-e839-4f91-9bde-5c6efc05f08d-node-exporter-tls\") pod \"node-exporter-67jzm\" (UID: \"7199a045-e839-4f91-9bde-5c6efc05f08d\") " pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.796729 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.796637    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"
Sep 14 12:59:43.832399 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.832347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-67jzm"
Sep 14 12:59:43.912863 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.912835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf"]
Sep 14 12:59:43.977743 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:43.977714    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8a897b_e809_4c56_8f02_ea9ec52d8a17.slice/crio-59f116e5e1960b4eb8ecaefa893fd8262027034a3904ec4b2171bacf33533f1d WatchSource:0}: Error finding container 59f116e5e1960b4eb8ecaefa893fd8262027034a3904ec4b2171bacf33533f1d: Status 404 returned error can't find the container with id 59f116e5e1960b4eb8ecaefa893fd8262027034a3904ec4b2171bacf33533f1d
Sep 14 12:59:43.984647 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:43.984626    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 12:59:44.004638 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.004620    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.008925 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:44.008901    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7199a045_e839_4f91_9bde_5c6efc05f08d.slice/crio-f050e843367e43870ce3958761eb674a4ced7418befcdd192e1781cfbaa8755b WatchSource:0}: Error finding container f050e843367e43870ce3958761eb674a4ced7418befcdd192e1781cfbaa8755b: Status 404 returned error can't find the container with id f050e843367e43870ce3958761eb674a4ced7418befcdd192e1781cfbaa8755b
Sep 14 12:59:44.011632 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.011585    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 14 12:59:44.012970 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.012942    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 14 12:59:44.013068 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.013051    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 14 12:59:44.014560 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.014485    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 14 12:59:44.015110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.014701    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 14 12:59:44.015110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.014729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 14 12:59:44.015110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.014910    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t4ktt\""
Sep 14 12:59:44.015110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.014985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 14 12:59:44.015341 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.015173    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 14 12:59:44.015341 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.015223    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 14 12:59:44.027214 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.027190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 12:59:44.085606 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085720 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.085973 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.086324 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.085991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.086324 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.086012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxf59\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187236 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187393 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187393 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187464 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187519 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187551 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187551 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187609 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187655 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187655 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187645    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxf59\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187754 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.187856 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.187769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.188336 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.188281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.188623 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.188596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.188776 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.188751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.190931 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.190545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.191339 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.191291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.191455 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.191424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.191559 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.191528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.191622 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.191601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.192161 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.191940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.192161 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.192120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.192283 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.192189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.192531 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.192515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.200494 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.200472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxf59\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59\") pod \"alertmanager-main-0\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.220409 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.220381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6779c54495-bl2gc" event={"ID":"1da1b42f-9325-47e2-aa7b-577e723dde86","Type":"ContainerStarted","Data":"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"}
Sep 14 12:59:44.221674 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.221653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67jzm" event={"ID":"7199a045-e839-4f91-9bde-5c6efc05f08d","Type":"ContainerStarted","Data":"f050e843367e43870ce3958761eb674a4ced7418befcdd192e1781cfbaa8755b"}
Sep 14 12:59:44.223596 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.223574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf" event={"ID":"bf8a897b-e809-4c56-8f02-ea9ec52d8a17","Type":"ContainerStarted","Data":"b347fc1c8cf323a3794497083f8661ff5ef453ee80c8a88e4aa94e5c4c2ac121"}
Sep 14 12:59:44.223671 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.223619    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf" event={"ID":"bf8a897b-e809-4c56-8f02-ea9ec52d8a17","Type":"ContainerStarted","Data":"a54f9fac0fe41d475e14550cd55f5caf8870a15170fe7f29335b35db6ae679cd"}
Sep 14 12:59:44.223671 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.223637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf" event={"ID":"bf8a897b-e809-4c56-8f02-ea9ec52d8a17","Type":"ContainerStarted","Data":"59f116e5e1960b4eb8ecaefa893fd8262027034a3904ec4b2171bacf33533f1d"}
Sep 14 12:59:44.250631 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.250592    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6779c54495-bl2gc" podStartSLOduration=2.088041373 podStartE2EDuration="5.250574288s" totalImagesPullingTime="3.162532915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:44.250349653 +0000 UTC m=+104.086858486" watchObservedRunningTime="2026-09-14 12:59:44.250574288 +0000 UTC m=+104.087083122"
Sep 14 12:59:44.285452 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.285431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd"]
Sep 14 12:59:44.287621 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:44.287600    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40595e35_e5d2_48de_874c_c6419bc4449a.slice/crio-d61814021c0752d2320a4d61e93c76796ed545de27b2ae9dbed6b46a949eee2f WatchSource:0}: Error finding container d61814021c0752d2320a4d61e93c76796ed545de27b2ae9dbed6b46a949eee2f: Status 404 returned error can't find the container with id d61814021c0752d2320a4d61e93c76796ed545de27b2ae9dbed6b46a949eee2f
Sep 14 12:59:44.318106 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.318085    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 12:59:44.604891 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:44.604843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 12:59:44.606905 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:44.606856    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d4a117_5320_485e_af24_b54f3c1f57fe.slice/crio-43959c5de4400cbe5589d5cc0f696676049c0fc7d8b534d3c85c09c9727dc1cb WatchSource:0}: Error finding container 43959c5de4400cbe5589d5cc0f696676049c0fc7d8b534d3c85c09c9727dc1cb: Status 404 returned error can't find the container with id 43959c5de4400cbe5589d5cc0f696676049c0fc7d8b534d3c85c09c9727dc1cb
Sep 14 12:59:45.229481 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:45.229438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd" event={"ID":"40595e35-e5d2-48de-874c-c6419bc4449a","Type":"ContainerStarted","Data":"d61814021c0752d2320a4d61e93c76796ed545de27b2ae9dbed6b46a949eee2f"}
Sep 14 12:59:45.231331 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:45.231298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"43959c5de4400cbe5589d5cc0f696676049c0fc7d8b534d3c85c09c9727dc1cb"}
Sep 14 12:59:46.242110 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.242064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd" event={"ID":"40595e35-e5d2-48de-874c-c6419bc4449a","Type":"ContainerStarted","Data":"69766b19eb2bacb6748be233615600d6b400037597ddd7394820f03ee8ead903"}
Sep 14 12:59:46.242520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.242143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd" event={"ID":"40595e35-e5d2-48de-874c-c6419bc4449a","Type":"ContainerStarted","Data":"8fc45f8244f4bdfce9c75be665aff3883f6575396aee55ed5e3475918c7489f7"}
Sep 14 12:59:46.242520 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.242173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd" event={"ID":"40595e35-e5d2-48de-874c-c6419bc4449a","Type":"ContainerStarted","Data":"ac1d3ea409019641a24907bcf1e9fcf22ba46a503100f7159cf4ad02732ab440"}
Sep 14 12:59:46.244337 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.244307    2559 generic.go:356] "Generic (PLEG): container finished" podID="7199a045-e839-4f91-9bde-5c6efc05f08d" containerID="ed226fa9933820a3d4774b6374dfa8402e52755e1bd1400f664849ad8a86bcc3" exitCode=0
Sep 14 12:59:46.244451 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.244393    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67jzm" event={"ID":"7199a045-e839-4f91-9bde-5c6efc05f08d","Type":"ContainerDied","Data":"ed226fa9933820a3d4774b6374dfa8402e52755e1bd1400f664849ad8a86bcc3"}
Sep 14 12:59:46.247062 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.247035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf" event={"ID":"bf8a897b-e809-4c56-8f02-ea9ec52d8a17","Type":"ContainerStarted","Data":"263256bb92ecaa531e94644109233b0a71c2749c83de23b57aa6d35e9a68c7e0"}
Sep 14 12:59:46.249247 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.249224    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="c0feb3ce213d275ea5fc34523c9fa8b76d4ffbb0777c69dd4e426c1e3f4d9bb1" exitCode=0
Sep 14 12:59:46.249344 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.249263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"c0feb3ce213d275ea5fc34523c9fa8b76d4ffbb0777c69dd4e426c1e3f4d9bb1"}
Sep 14 12:59:46.267726 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.267678    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mrsd" podStartSLOduration=2.647659475 podStartE2EDuration="4.267661808s" totalImagesPullingTime="1.620002333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:46.266303347 +0000 UTC m=+106.102812188" watchObservedRunningTime="2026-09-14 12:59:46.267661808 +0000 UTC m=+106.104170641"
Sep 14 12:59:46.350035 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:46.349988    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wwdgf" podStartSLOduration=2.579706479 podStartE2EDuration="4.349970539s" totalImagesPullingTime="1.77026406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:46.348887288 +0000 UTC m=+106.185396116" watchObservedRunningTime="2026-09-14 12:59:46.349970539 +0000 UTC m=+106.186479376"
Sep 14 12:59:47.256704 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.256601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67jzm" event={"ID":"7199a045-e839-4f91-9bde-5c6efc05f08d","Type":"ContainerStarted","Data":"3031a91a724672a5f6ce1fcdb3c3b18274a462f81f17e25893eca4502df94a7c"}
Sep 14 12:59:47.256704 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.256666    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-67jzm" event={"ID":"7199a045-e839-4f91-9bde-5c6efc05f08d","Type":"ContainerStarted","Data":"b49f22057af9a15ce12c10babd7b92fad066ae9479150738117527c5c9b4e082"}
Sep 14 12:59:47.293445 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.293394    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-67jzm" podStartSLOduration=3.3041440570000002 podStartE2EDuration="5.293368059s" totalImagesPullingTime="1.898557819s" totalInitContainerRuntime="90.666183ms" isStatefulPod=true podCreationTimestamp="2026-09-14 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:47.293122686 +0000 UTC m=+107.129631521" watchObservedRunningTime="2026-09-14 12:59:47.293368059 +0000 UTC m=+107.129876893"
Sep 14 12:59:47.702195 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.702112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"]
Sep 14 12:59:47.705267 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.705239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:47.708471 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.708448    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bhhb9\""
Sep 14 12:59:47.708682 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.708667    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 14 12:59:47.722066 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.722040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"]
Sep 14 12:59:47.824145 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.824121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlklg\" (UniqueName: \"kubernetes.io/projected/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-kube-api-access-jlklg\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:47.824270 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.824180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:47.924956 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.924923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:47.925078 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.925060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlklg\" (UniqueName: \"kubernetes.io/projected/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-kube-api-access-jlklg\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:47.925127 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:47.925062    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 14 12:59:47.925179 ip-10-0-137-35 kubenswrapper[2559]: E0914 12:59:47.925169    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert podName:59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6 nodeName:}" failed. No retries permitted until 2026-09-14 12:59:48.425155705 +0000 UTC m=+108.261664517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-kn29p" (UID: "59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6") : secret "monitoring-plugin-cert" not found
Sep 14 12:59:47.935583 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:47.935555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlklg\" (UniqueName: \"kubernetes.io/projected/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-kube-api-access-jlklg\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:48.264574 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.264540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"5149c4c3bfb152e969eb5c929aca496bfd564db86afb1c7ec84fbc3122e339b0"}
Sep 14 12:59:48.264954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.264607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"181797d1ddc13cbc770346d7142ef46f221ac92c3ef7f5a4b3ef735e56eca870"}
Sep 14 12:59:48.264954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.264634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"e5270a34749a5f20b4c909485266d92867cb1a8953028b9fa1afffa12671d621"}
Sep 14 12:59:48.264954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.264659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"aad9871d246b7edb7cbecc8c00a3113ea7180653fd65bd605bf6b1d10e35ccff"}
Sep 14 12:59:48.264954 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.264682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"32db163a1aa63a6dad432c5e125a81d0744c63931002f86b5fa67beacd868d84"}
Sep 14 12:59:48.429281 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.429234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:48.431611 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.431585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-kn29p\" (UID: \"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:48.618529 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.618444    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:48.880160 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.880100    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 12:59:48.896417 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.896392    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"]
Sep 14 12:59:48.899102 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:48.899068    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a9ab3b_92a9_4bd9_bfd0_614c3c6bcfc6.slice/crio-6473e4efd6604fad5ab92d41fa036b63ce863278a4bce4612088f47cdaac1bcb WatchSource:0}: Error finding container 6473e4efd6604fad5ab92d41fa036b63ce863278a4bce4612088f47cdaac1bcb: Status 404 returned error can't find the container with id 6473e4efd6604fad5ab92d41fa036b63ce863278a4bce4612088f47cdaac1bcb
Sep 14 12:59:48.911965 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.911941    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 12:59:48.914206 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.914179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:48.925244 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.925224    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 12:59:48.933445 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:48.933420    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 12:59:49.035368 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035368 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035567 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035567 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035644 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035687 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035671    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.035723 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.035705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsgt\" (UniqueName: \"kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.136730 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.136630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.136730 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.136666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137001 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.136817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137001 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.136867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137001 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.136978    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137149 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.137022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137462 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.137437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137689 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.137663    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137816 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.137705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.137816 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.137756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsgt\" (UniqueName: \"kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.138434 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.138411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.139452 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.139427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.139656 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.139637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.148251 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.148231    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsgt\" (UniqueName: \"kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt\") pod \"console-554fc6468c-95gbd\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") " pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.224384 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.224346    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:49.275299 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.275016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerStarted","Data":"c03c4812b76e44fb954515d9cbee0a53ef2d33e0e7f4f2c04e2bccfed2402342"}
Sep 14 12:59:49.276714 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.276681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p" event={"ID":"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6","Type":"ContainerStarted","Data":"6473e4efd6604fad5ab92d41fa036b63ce863278a4bce4612088f47cdaac1bcb"}
Sep 14 12:59:49.315965 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.315895    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.73047423 podStartE2EDuration="6.315860758s" totalImagesPullingTime="3.564650135s" totalInitContainerRuntime="20.736393ms" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:49.314175698 +0000 UTC m=+109.150684533" watchObservedRunningTime="2026-09-14 12:59:49.315860758 +0000 UTC m=+109.152369591"
Sep 14 12:59:49.517142 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:49.517106    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 12:59:49.521146 ip-10-0-137-35 kubenswrapper[2559]: W0914 12:59:49.521119    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b9746d_2a67_43e9_82fe_aa5d252fb52a.slice/crio-c0b4bac770e6836a898d3d5331207803bea826da169a4068f0104a0e2962879c WatchSource:0}: Error finding container c0b4bac770e6836a898d3d5331207803bea826da169a4068f0104a0e2962879c: Status 404 returned error can't find the container with id c0b4bac770e6836a898d3d5331207803bea826da169a4068f0104a0e2962879c
Sep 14 12:59:50.049145 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:50.049111    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 12:59:50.284416 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:50.284377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554fc6468c-95gbd" event={"ID":"64b9746d-2a67-43e9-82fe-aa5d252fb52a","Type":"ContainerStarted","Data":"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"}
Sep 14 12:59:50.284862 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:50.284449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554fc6468c-95gbd" event={"ID":"64b9746d-2a67-43e9-82fe-aa5d252fb52a","Type":"ContainerStarted","Data":"c0b4bac770e6836a898d3d5331207803bea826da169a4068f0104a0e2962879c"}
Sep 14 12:59:50.311473 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:50.311359    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554fc6468c-95gbd" podStartSLOduration=2.311338799 podStartE2EDuration="2.311338799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:50.310542997 +0000 UTC m=+110.147051828" watchObservedRunningTime="2026-09-14 12:59:50.311338799 +0000 UTC m=+110.147847637"
Sep 14 12:59:51.213249 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:51.213213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r28ld"
Sep 14 12:59:51.289941 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:51.289868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p" event={"ID":"59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6","Type":"ContainerStarted","Data":"9812a9035f7f33027fcc931d7e134ac4c0b7d163f1268c04db183f0e9aa5f0cc"}
Sep 14 12:59:51.290322 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:51.290149    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:51.295767 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:51.295744    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p"
Sep 14 12:59:51.319610 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:51.319566    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-kn29p" podStartSLOduration=2.848710208 podStartE2EDuration="4.319552128s" totalImagesPullingTime="1.47084192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 12:59:51.318792618 +0000 UTC m=+111.155301452" watchObservedRunningTime="2026-09-14 12:59:51.319552128 +0000 UTC m=+111.156060978"
Sep 14 12:59:53.681997 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:53.681957    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 12:59:59.224820 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:59.224780    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:59.225249 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:59.224867    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:59.229561 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:59.229543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 12:59:59.325569 ip-10-0-137-35 kubenswrapper[2559]: I0914 12:59:59.325535    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 13:00:03.687432 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:03.687400    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 13:00:07.355695 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:07.355599    2559 generic.go:356] "Generic (PLEG): container finished" podID="65e6469a-50ab-4c5f-baea-782c744a3328" containerID="6f99cf1e22c3c33c301806822b9ebb410f80627541d99f1c0d7080b473f7fd9b" exitCode=0
Sep 14 13:00:07.355695 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:07.355679    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-z75ld" event={"ID":"65e6469a-50ab-4c5f-baea-782c744a3328","Type":"ContainerDied","Data":"6f99cf1e22c3c33c301806822b9ebb410f80627541d99f1c0d7080b473f7fd9b"}
Sep 14 13:00:07.356129 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:07.356041    2559 scope.go:117] "RemoveContainer" containerID="6f99cf1e22c3c33c301806822b9ebb410f80627541d99f1c0d7080b473f7fd9b"
Sep 14 13:00:08.042077 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:08.042050    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfb5dc75b-tzm4f_34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9/router/0.log"
Sep 14 13:00:08.054848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:08.054808    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4kqw_61bc7287-f2f6-48a0-83ec-16338aaa7e5a/serve-healthcheck-canary/0.log"
Sep 14 13:00:08.361593 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:08.361504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-z75ld" event={"ID":"65e6469a-50ab-4c5f-baea-782c744a3328","Type":"ContainerStarted","Data":"b392c500772a8afa017b123da61e368082292fd529f7134fbfd887f790f46e9e"}
Sep 14 13:00:09.519138 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:09.519090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 13:00:09.521540 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:09.521491    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75dd968-bb0b-439b-afe0-e55c7114310c-metrics-certs\") pod \"network-metrics-daemon-wns98\" (UID: \"b75dd968-bb0b-439b-afe0-e55c7114310c\") " pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 13:00:09.797695 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:09.797604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5b9s\""
Sep 14 13:00:09.805172 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:09.805127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wns98"
Sep 14 13:00:10.077893 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:10.077856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wns98"]
Sep 14 13:00:10.080161 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:00:10.080130    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75dd968_bb0b_439b_afe0_e55c7114310c.slice/crio-2af482c721499b2811a69807e778b4a5702fdc719d975fb7a6ceae08fcef8872 WatchSource:0}: Error finding container 2af482c721499b2811a69807e778b4a5702fdc719d975fb7a6ceae08fcef8872: Status 404 returned error can't find the container with id 2af482c721499b2811a69807e778b4a5702fdc719d975fb7a6ceae08fcef8872
Sep 14 13:00:10.370609 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:10.370526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wns98" event={"ID":"b75dd968-bb0b-439b-afe0-e55c7114310c","Type":"ContainerStarted","Data":"2af482c721499b2811a69807e778b4a5702fdc719d975fb7a6ceae08fcef8872"}
Sep 14 13:00:11.886460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:11.886426    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 13:00:12.381785 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:12.381746    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wns98" event={"ID":"b75dd968-bb0b-439b-afe0-e55c7114310c","Type":"ContainerStarted","Data":"84d559c169260adb2fe6eca2e65c0c1fbc57f508ed44899948e67f73f2c27923"}
Sep 14 13:00:12.381965 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:12.381839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wns98" event={"ID":"b75dd968-bb0b-439b-afe0-e55c7114310c","Type":"ContainerStarted","Data":"9712134034d0332e1e621ba7a1364f8be541bf87a6ce60660cf2b9965bcc5338"}
Sep 14 13:00:12.402916 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:12.402852    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wns98" podStartSLOduration=129.723697054 podStartE2EDuration="2m11.402837897s" totalImagesPullingTime="1.679140843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 12:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:00:12.400408596 +0000 UTC m=+132.236917430" watchObservedRunningTime="2026-09-14 13:00:12.402837897 +0000 UTC m=+132.239346730"
Sep 14 13:00:13.899564 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:13.899516    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6779c54495-bl2gc" podUID="1da1b42f-9325-47e2-aa7b-577e723dde86" containerName="console" containerID="cri-o://c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556" gracePeriod=15
Sep 14 13:00:14.138536 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.138508    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 13:00:14.259560 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.259560 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259560    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.259740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.259740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259627    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rsbk\" (UniqueName: \"kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.259740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.259740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.259683    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert\") pod \"1da1b42f-9325-47e2-aa7b-577e723dde86\" (UID: \"1da1b42f-9325-47e2-aa7b-577e723dde86\") "
Sep 14 13:00:14.260048 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.260016    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:14.260048 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.260031    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config" (OuterVolumeSpecName: "console-config") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:14.260190 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.260039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca" (OuterVolumeSpecName: "service-ca") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:14.262008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.261975    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:14.262094 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.262019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:14.262094 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.262032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk" (OuterVolumeSpecName: "kube-api-access-2rsbk") pod "1da1b42f-9325-47e2-aa7b-577e723dde86" (UID: "1da1b42f-9325-47e2-aa7b-577e723dde86"). InnerVolumeSpecName "kube-api-access-2rsbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:14.361292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361247    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.361292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361286    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.361292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361294    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da1b42f-9325-47e2-aa7b-577e723dde86-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.361292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361304    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rsbk\" (UniqueName: \"kubernetes.io/projected/1da1b42f-9325-47e2-aa7b-577e723dde86-kube-api-access-2rsbk\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.361553 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361315    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.361553 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.361326    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da1b42f-9325-47e2-aa7b-577e723dde86-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:14.391140 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.391106    2559 generic.go:356] "Generic (PLEG): container finished" podID="1da1b42f-9325-47e2-aa7b-577e723dde86" containerID="c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556" exitCode=0
Sep 14 13:00:14.391282 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.391151    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6779c54495-bl2gc"
Sep 14 13:00:14.391282 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.391160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6779c54495-bl2gc" event={"ID":"1da1b42f-9325-47e2-aa7b-577e723dde86","Type":"ContainerDied","Data":"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"}
Sep 14 13:00:14.391282 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.391202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6779c54495-bl2gc" event={"ID":"1da1b42f-9325-47e2-aa7b-577e723dde86","Type":"ContainerDied","Data":"6e3a31309cd7e767da0af08dee49fb9098656042fa7fea36624ecc9437514a77"}
Sep 14 13:00:14.391282 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.391234    2559 scope.go:117] "RemoveContainer" containerID="c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"
Sep 14 13:00:14.400103 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.400085    2559 scope.go:117] "RemoveContainer" containerID="c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"
Sep 14 13:00:14.400374 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:00:14.400354    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556\": container with ID starting with c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556 not found: ID does not exist" containerID="c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"
Sep 14 13:00:14.400436 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.400387    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556"} err="failed to get container status \"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556\": rpc error: code = NotFound desc = could not find container \"c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556\": container with ID starting with c0180f6617f07e974a6a06a82982888d6b1a62904e7f57b2547f0dbf5fff7556 not found: ID does not exist"
Sep 14 13:00:14.412505 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.412475    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 13:00:14.416613 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.416591    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6779c54495-bl2gc"]
Sep 14 13:00:14.682372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:14.682288    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1da1b42f-9325-47e2-aa7b-577e723dde86" path="/var/lib/kubelet/pods/1da1b42f-9325-47e2-aa7b-577e723dde86/volumes"
Sep 14 13:00:18.700871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:18.700829    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" podUID="4573f87e-0637-44f9-9a19-31a7efd358a4" containerName="registry" containerID="cri-o://4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a" gracePeriod=30
Sep 14 13:00:18.991427 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:18.991389    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 13:00:19.108379 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108431    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108638 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108638 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108628    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psrxq\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.108850 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.108764    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca\") pod \"4573f87e-0637-44f9-9a19-31a7efd358a4\" (UID: \"4573f87e-0637-44f9-9a19-31a7efd358a4\") "
Sep 14 13:00:19.109127 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.109080    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:19.109484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.109457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:19.111479 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.111447    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:19.111594 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.111575    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:19.111658 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.111619    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:19.111712 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.111696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq" (OuterVolumeSpecName: "kube-api-access-psrxq") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "kube-api-access-psrxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:19.111769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.111716    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:19.130340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.130297    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4573f87e-0637-44f9-9a19-31a7efd358a4" (UID: "4573f87e-0637-44f9-9a19-31a7efd358a4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:00:19.209772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209744    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209773    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-registry-certificates\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209783    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psrxq\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-kube-api-access-psrxq\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209792    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4573f87e-0637-44f9-9a19-31a7efd358a4-trusted-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209800    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4573f87e-0637-44f9-9a19-31a7efd358a4-bound-sa-token\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209810    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-installation-pull-secrets\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209818    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4573f87e-0637-44f9-9a19-31a7efd358a4-ca-trust-extracted\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.209982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.209827    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4573f87e-0637-44f9-9a19-31a7efd358a4-image-registry-private-configuration\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:19.414774 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.414741    2559 generic.go:356] "Generic (PLEG): container finished" podID="4573f87e-0637-44f9-9a19-31a7efd358a4" containerID="4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a" exitCode=0
Sep 14 13:00:19.414975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.414783    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g"
Sep 14 13:00:19.414975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.414822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" event={"ID":"4573f87e-0637-44f9-9a19-31a7efd358a4","Type":"ContainerDied","Data":"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"}
Sep 14 13:00:19.414975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.414911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf446d5f-9zd9g" event={"ID":"4573f87e-0637-44f9-9a19-31a7efd358a4","Type":"ContainerDied","Data":"05f20dce9a3ac6fa9eadc336a143349befb69608ec75774fc5c697919daea0b7"}
Sep 14 13:00:19.414975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.414940    2559 scope.go:117] "RemoveContainer" containerID="4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"
Sep 14 13:00:19.427389 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.427368    2559 scope.go:117] "RemoveContainer" containerID="4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"
Sep 14 13:00:19.428368 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:00:19.428282    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a\": container with ID starting with 4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a not found: ID does not exist" containerID="4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"
Sep 14 13:00:19.428368 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.428327    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a"} err="failed to get container status \"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a\": rpc error: code = NotFound desc = could not find container \"4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a\": container with ID starting with 4078d5d559ed07586f2fe383462fe917f8f8fef04dac30305d2058c2b4db062a not found: ID does not exist"
Sep 14 13:00:19.451166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.451138    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 13:00:19.457855 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:19.457828    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cf446d5f-9zd9g"]
Sep 14 13:00:20.682380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:20.682350    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4573f87e-0637-44f9-9a19-31a7efd358a4" path="/var/lib/kubelet/pods/4573f87e-0637-44f9-9a19-31a7efd358a4/volumes"
Sep 14 13:00:36.913685 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:36.913640    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-554fc6468c-95gbd" podUID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" containerName="console" containerID="cri-o://1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65" gracePeriod=15
Sep 14 13:00:37.161596 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.161571    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 13:00:37.255488 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255449    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255488 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255498    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255514    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255619    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.255758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255636    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsgt\" (UniqueName: \"kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt\") pod \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\" (UID: \"64b9746d-2a67-43e9-82fe-aa5d252fb52a\") "
Sep 14 13:00:37.256080 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.255932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:37.256148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.256069    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca" (OuterVolumeSpecName: "service-ca") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:37.256148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.256103    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config" (OuterVolumeSpecName: "console-config") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:37.256236 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.256195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:00:37.257726 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.257699    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:37.257913 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.257867    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:00:37.257965 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.257891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt" (OuterVolumeSpecName: "kube-api-access-qdsgt") pod "64b9746d-2a67-43e9-82fe-aa5d252fb52a" (UID: "64b9746d-2a67-43e9-82fe-aa5d252fb52a"). InnerVolumeSpecName "kube-api-access-qdsgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:00:37.356375 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356335    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356375 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356364    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-trusted-ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356375 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356386    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsgt\" (UniqueName: \"kubernetes.io/projected/64b9746d-2a67-43e9-82fe-aa5d252fb52a-kube-api-access-qdsgt\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356395    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356403    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356411    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b9746d-2a67-43e9-82fe-aa5d252fb52a-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.356598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.356419    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b9746d-2a67-43e9-82fe-aa5d252fb52a-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:00:37.491946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.491910    2559 generic.go:356] "Generic (PLEG): container finished" podID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" containerID="1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65" exitCode=0
Sep 14 13:00:37.492119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.491963    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554fc6468c-95gbd"
Sep 14 13:00:37.492119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.492007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554fc6468c-95gbd" event={"ID":"64b9746d-2a67-43e9-82fe-aa5d252fb52a","Type":"ContainerDied","Data":"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"}
Sep 14 13:00:37.492119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.492061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554fc6468c-95gbd" event={"ID":"64b9746d-2a67-43e9-82fe-aa5d252fb52a","Type":"ContainerDied","Data":"c0b4bac770e6836a898d3d5331207803bea826da169a4068f0104a0e2962879c"}
Sep 14 13:00:37.492119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.492085    2559 scope.go:117] "RemoveContainer" containerID="1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"
Sep 14 13:00:37.500477 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.500461    2559 scope.go:117] "RemoveContainer" containerID="1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"
Sep 14 13:00:37.500740 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:00:37.500723    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65\": container with ID starting with 1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65 not found: ID does not exist" containerID="1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"
Sep 14 13:00:37.500778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.500750    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65"} err="failed to get container status \"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65\": rpc error: code = NotFound desc = could not find container \"1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65\": container with ID starting with 1f5a7dd3a6dd178f0bc41bfb630420eb3eafe6bcf72287b302dce2b9fd6aaf65 not found: ID does not exist"
Sep 14 13:00:37.522177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.522118    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 13:00:37.525364 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:37.525342    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554fc6468c-95gbd"]
Sep 14 13:00:38.681896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:00:38.681834    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" path="/var/lib/kubelet/pods/64b9746d-2a67-43e9-82fe-aa5d252fb52a/volumes"
Sep 14 13:01:03.484833 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.484794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485136    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="alertmanager" containerID="cri-o://32db163a1aa63a6dad432c5e125a81d0744c63931002f86b5fa67beacd868d84" gracePeriod=120
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485167    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy" containerID="cri-o://181797d1ddc13cbc770346d7142ef46f221ac92c3ef7f5a4b3ef735e56eca870" gracePeriod=120
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485196    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="prom-label-proxy" containerID="cri-o://c03c4812b76e44fb954515d9cbee0a53ef2d33e0e7f4f2c04e2bccfed2402342" gracePeriod=120
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485219    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="config-reloader" containerID="cri-o://aad9871d246b7edb7cbecc8c00a3113ea7180653fd65bd605bf6b1d10e35ccff" gracePeriod=120
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485183    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-web" containerID="cri-o://e5270a34749a5f20b4c909485266d92867cb1a8953028b9fa1afffa12671d621" gracePeriod=120
Sep 14 13:01:03.485315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.485239    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-metric" containerID="cri-o://5149c4c3bfb152e969eb5c929aca496bfd564db86afb1c7ec84fbc3122e339b0" gracePeriod=120
Sep 14 13:01:03.602871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.602845    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="181797d1ddc13cbc770346d7142ef46f221ac92c3ef7f5a4b3ef735e56eca870" exitCode=0
Sep 14 13:01:03.602871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.602869    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="aad9871d246b7edb7cbecc8c00a3113ea7180653fd65bd605bf6b1d10e35ccff" exitCode=0
Sep 14 13:01:03.602871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.602896    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="32db163a1aa63a6dad432c5e125a81d0744c63931002f86b5fa67beacd868d84" exitCode=0
Sep 14 13:01:03.603062 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.602963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"181797d1ddc13cbc770346d7142ef46f221ac92c3ef7f5a4b3ef735e56eca870"}
Sep 14 13:01:03.603062 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.603029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"aad9871d246b7edb7cbecc8c00a3113ea7180653fd65bd605bf6b1d10e35ccff"}
Sep 14 13:01:03.603062 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.603056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"32db163a1aa63a6dad432c5e125a81d0744c63931002f86b5fa67beacd868d84"}
Sep 14 13:01:03.842433 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842335    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:01:03.842703 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842687    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" containerName="console"
Sep 14 13:01:03.842745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842708    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" containerName="console"
Sep 14 13:01:03.842745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842726    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4573f87e-0637-44f9-9a19-31a7efd358a4" containerName="registry"
Sep 14 13:01:03.842745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842732    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4573f87e-0637-44f9-9a19-31a7efd358a4" containerName="registry"
Sep 14 13:01:03.842745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842738    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1da1b42f-9325-47e2-aa7b-577e723dde86" containerName="console"
Sep 14 13:01:03.842745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842746    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1da1b42f-9325-47e2-aa7b-577e723dde86" containerName="console"
Sep 14 13:01:03.842916 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842804    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b9746d-2a67-43e9-82fe-aa5d252fb52a" containerName="console"
Sep 14 13:01:03.842916 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842815    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1da1b42f-9325-47e2-aa7b-577e723dde86" containerName="console"
Sep 14 13:01:03.842916 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.842823    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4573f87e-0637-44f9-9a19-31a7efd358a4" containerName="registry"
Sep 14 13:01:03.845843 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.845818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.849063 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849037    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 13:01:03.849063 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849056    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7s58v\""
Sep 14 13:01:03.849235 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849056    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 13:01:03.849294 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849277    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 13:01:03.849340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849319    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 13:01:03.849340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 13:01:03.849752 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.849738    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 13:01:03.850224 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.850200    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 13:01:03.857104 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.857083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 13:01:03.860570 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.860547    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:01:03.964132 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964300 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964300 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964386 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964386 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964386 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:03.964514 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:03.964414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dnp\" (UniqueName: \"kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.065623 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.065623 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.065838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.065838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.065838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066003 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dnp\" (UniqueName: \"kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066003 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.065925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066562 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.066536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.066588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.066594    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.066862 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.066597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.068147 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.068127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.068388 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.068368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.075410 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.075388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dnp\" (UniqueName: \"kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp\") pod \"console-8cdf85849-lbc26\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") " pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.155379 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.155282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:04.429850 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.429823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:01:04.432347 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:01:04.432319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d30160_28c4_426c_8490_0c12220907e9.slice/crio-b76d0bb199350a8f98328081ba898d2374f1de0be8fbac9fa8cc8206bfcf473d WatchSource:0}: Error finding container b76d0bb199350a8f98328081ba898d2374f1de0be8fbac9fa8cc8206bfcf473d: Status 404 returned error can't find the container with id b76d0bb199350a8f98328081ba898d2374f1de0be8fbac9fa8cc8206bfcf473d
Sep 14 13:01:04.610591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610555    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="c03c4812b76e44fb954515d9cbee0a53ef2d33e0e7f4f2c04e2bccfed2402342" exitCode=0
Sep 14 13:01:04.610591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610581    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="5149c4c3bfb152e969eb5c929aca496bfd564db86afb1c7ec84fbc3122e339b0" exitCode=0
Sep 14 13:01:04.610591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610588    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerID="e5270a34749a5f20b4c909485266d92867cb1a8953028b9fa1afffa12671d621" exitCode=0
Sep 14 13:01:04.611042 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"c03c4812b76e44fb954515d9cbee0a53ef2d33e0e7f4f2c04e2bccfed2402342"}
Sep 14 13:01:04.611042 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"5149c4c3bfb152e969eb5c929aca496bfd564db86afb1c7ec84fbc3122e339b0"}
Sep 14 13:01:04.611042 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.610765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"e5270a34749a5f20b4c909485266d92867cb1a8953028b9fa1afffa12671d621"}
Sep 14 13:01:04.612425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.612401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdf85849-lbc26" event={"ID":"b3d30160-28c4-426c-8490-0c12220907e9","Type":"ContainerStarted","Data":"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"}
Sep 14 13:01:04.612531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.612447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdf85849-lbc26" event={"ID":"b3d30160-28c4-426c-8490-0c12220907e9","Type":"ContainerStarted","Data":"b76d0bb199350a8f98328081ba898d2374f1de0be8fbac9fa8cc8206bfcf473d"}
Sep 14 13:01:04.632720 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.632666    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8cdf85849-lbc26" podStartSLOduration=1.632648508 podStartE2EDuration="1.632648508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:01:04.632270627 +0000 UTC m=+184.468779461" watchObservedRunningTime="2026-09-14 13:01:04.632648508 +0000 UTC m=+184.469157341"
Sep 14 13:01:04.735124 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.735095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:04.771721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.771896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771734    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.771896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771778    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.771896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.771896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771922    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.771972    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772022    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772082    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxf59\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772119    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772128    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:01:04.772198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy\") pod \"e9d4a117-5320-485e-af24-b54f3c1f57fe\" (UID: \"e9d4a117-5320-485e-af24-b54f3c1f57fe\") "
Sep 14 13:01:04.772628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772262    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:04.772628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772445    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-main-db\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.772628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772465    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.772781 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.772732    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:01:04.776099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.776056    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.776229 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.776105    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume" (OuterVolumeSpecName: "config-volume") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.776564 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.776524    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.776789 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.776757    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.777902 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.777840    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59" (OuterVolumeSpecName: "kube-api-access-mxf59") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "kube-api-access-mxf59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:01:04.778017 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.777996    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:01:04.778237 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.778217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.780281 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.780257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out" (OuterVolumeSpecName: "config-out") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:01:04.783037 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.782999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.790250 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.790224    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config" (OuterVolumeSpecName: "web-config") pod "e9d4a117-5320-485e-af24-b54f3c1f57fe" (UID: "e9d4a117-5320-485e-af24-b54f3c1f57fe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:01:04.873591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873554    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxf59\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-kube-api-access-mxf59\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873584    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-main-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873595    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873606    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9d4a117-5320-485e-af24-b54f3c1f57fe-tls-assets\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873614    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-volume\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873622    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-web-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873630    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-cluster-tls-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873638    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4a117-5320-485e-af24-b54f3c1f57fe-metrics-client-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873647    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873655    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9d4a117-5320-485e-af24-b54f3c1f57fe-config-out\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:04.873820 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:04.873663    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9d4a117-5320-485e-af24-b54f3c1f57fe-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:01:05.619313 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.619278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9d4a117-5320-485e-af24-b54f3c1f57fe","Type":"ContainerDied","Data":"43959c5de4400cbe5589d5cc0f696676049c0fc7d8b534d3c85c09c9727dc1cb"}
Sep 14 13:01:05.619705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.619371    2559 scope.go:117] "RemoveContainer" containerID="c03c4812b76e44fb954515d9cbee0a53ef2d33e0e7f4f2c04e2bccfed2402342"
Sep 14 13:01:05.619705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.619288    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.630986 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.630960    2559 scope.go:117] "RemoveContainer" containerID="5149c4c3bfb152e969eb5c929aca496bfd564db86afb1c7ec84fbc3122e339b0"
Sep 14 13:01:05.638496 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.638478    2559 scope.go:117] "RemoveContainer" containerID="181797d1ddc13cbc770346d7142ef46f221ac92c3ef7f5a4b3ef735e56eca870"
Sep 14 13:01:05.645525 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.645502    2559 scope.go:117] "RemoveContainer" containerID="e5270a34749a5f20b4c909485266d92867cb1a8953028b9fa1afffa12671d621"
Sep 14 13:01:05.649293 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.649271    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:05.652447 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.652421    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:05.653677 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.653655    2559 scope.go:117] "RemoveContainer" containerID="aad9871d246b7edb7cbecc8c00a3113ea7180653fd65bd605bf6b1d10e35ccff"
Sep 14 13:01:05.660795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.660778    2559 scope.go:117] "RemoveContainer" containerID="32db163a1aa63a6dad432c5e125a81d0744c63931002f86b5fa67beacd868d84"
Sep 14 13:01:05.667797 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.667780    2559 scope.go:117] "RemoveContainer" containerID="c0feb3ce213d275ea5fc34523c9fa8b76d4ffbb0777c69dd4e426c1e3f4d9bb1"
Sep 14 13:01:05.688133 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:05.688412 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688400    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy"
Sep 14 13:01:05.688451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688413    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy"
Sep 14 13:01:05.688451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688423    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="alertmanager"
Sep 14 13:01:05.688451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688429    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="alertmanager"
Sep 14 13:01:05.688451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688442    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-web"
Sep 14 13:01:05.688451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688447    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-web"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688458    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="config-reloader"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688463    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="config-reloader"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688470    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="init-config-reloader"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688475    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="init-config-reloader"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688483    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="prom-label-proxy"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688489    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="prom-label-proxy"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688497    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-metric"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688502    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-metric"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688553    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-metric"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688562    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688569    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="config-reloader"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688576    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="alertmanager"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688582    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="kube-rbac-proxy-web"
Sep 14 13:01:05.688604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.688588    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" containerName="prom-label-proxy"
Sep 14 13:01:05.693541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.693523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.696423 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 14 13:01:05.696533 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696491    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 14 13:01:05.696758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696720    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 14 13:01:05.696758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696759    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 14 13:01:05.696937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 14 13:01:05.696937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 14 13:01:05.696937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 14 13:01:05.696937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.696920    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t4ktt\""
Sep 14 13:01:05.697177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.697138    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 14 13:01:05.703243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.703224    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 14 13:01:05.708700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.708677    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:05.781544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.781866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.782169 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.781923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfsk4\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-kube-api-access-xfsk4\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.882841 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.882791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.882841 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.882848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.883074 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.882903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.883074 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.882925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.883074 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.882950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.883208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.883208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfsk4\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-kube-api-access-xfsk4\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883605    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.884027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.883978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce7b02-3890-4019-ae37-fabada11c34d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-web-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.886984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.887310 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.886985    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce7b02-3890-4019-ae37-fabada11c34d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.887974 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.887955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce7b02-3890-4019-ae37-fabada11c34d-config-out\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:05.892621 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:05.892601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfsk4\" (UniqueName: \"kubernetes.io/projected/b9ce7b02-3890-4019-ae37-fabada11c34d-kube-api-access-xfsk4\") pod \"alertmanager-main-0\" (UID: \"b9ce7b02-3890-4019-ae37-fabada11c34d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:06.005475 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.005427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 14 13:01:06.290554 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.290517    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 14 13:01:06.293459 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:01:06.293432    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ce7b02_3890_4019_ae37_fabada11c34d.slice/crio-4b8cb3790b7698355dead0444036dc1c9248cac0ee613d3f8d89687ad63b8d04 WatchSource:0}: Error finding container 4b8cb3790b7698355dead0444036dc1c9248cac0ee613d3f8d89687ad63b8d04: Status 404 returned error can't find the container with id 4b8cb3790b7698355dead0444036dc1c9248cac0ee613d3f8d89687ad63b8d04
Sep 14 13:01:06.625977 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.625866    2559 generic.go:356] "Generic (PLEG): container finished" podID="b9ce7b02-3890-4019-ae37-fabada11c34d" containerID="572b5218be9a46e5bce3835b588da6fc873131a7eb2d4ff92c83278528c7ec18" exitCode=0
Sep 14 13:01:06.625977 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.625914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerDied","Data":"572b5218be9a46e5bce3835b588da6fc873131a7eb2d4ff92c83278528c7ec18"}
Sep 14 13:01:06.626489 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.625981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"4b8cb3790b7698355dead0444036dc1c9248cac0ee613d3f8d89687ad63b8d04"}
Sep 14 13:01:06.683492 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:06.683468    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d4a117-5320-485e-af24-b54f3c1f57fe" path="/var/lib/kubelet/pods/e9d4a117-5320-485e-af24-b54f3c1f57fe/volumes"
Sep 14 13:01:07.635410 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"cb0abdd1ad849ff3f092c47024ab091a01e93d720fdf6c2cba849bfd6a34162f"}
Sep 14 13:01:07.635906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"bcad5094969bbde9e6e9e44539f9c5061987ad5c957cbab0d40f544e300cd5aa"}
Sep 14 13:01:07.635906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"4d14af171c22e50aef93111bde40d1b3325c2a08a413b5fbe41d847182f257c5"}
Sep 14 13:01:07.635906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"b9218b0b6b3ddb5d321ce56457f54dfd25e89b36278bab910e11abcc949ecbfe"}
Sep 14 13:01:07.635906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"67534b2177271b7657b47039ac5f9321ec92ddc3a4c836ed9704098019ed250a"}
Sep 14 13:01:07.635906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.635568    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9ce7b02-3890-4019-ae37-fabada11c34d","Type":"ContainerStarted","Data":"400e24ea2c153a400e5037a675e5f661002de8a47e787180147ff0d296ba4b18"}
Sep 14 13:01:07.667007 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:07.666942    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.650731801 podStartE2EDuration="2.666924144s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.192343ms" isStatefulPod=false podCreationTimestamp="2026-09-14 13:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:01:07.664434665 +0000 UTC m=+187.500943510" watchObservedRunningTime="2026-09-14 13:01:07.666924144 +0000 UTC m=+187.503432978"
Sep 14 13:01:14.155785 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:14.155738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:14.156176 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:14.155816    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:14.160580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:14.160554    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:01:14.668557 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:01:14.668528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:03:00.578937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:00.578910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:03:00.584511 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:00.584482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:03:00.585428 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:00.585403    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 13:03:45.217322 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.217289    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"]
Sep 14 13:03:45.220572 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.220553    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.223474 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.223451    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 13:03:45.224581 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.224565    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 13:03:45.224659 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.224591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h57s\""
Sep 14 13:03:45.249629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.249601    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"]
Sep 14 13:03:45.281473 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.281434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zhtc\" (UniqueName: \"kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.281657 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.281480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.281657 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.281518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.382431 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.382385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zhtc\" (UniqueName: \"kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.382431 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.382437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.382677 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.382485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.382906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.382857    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.382999 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.382927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.391388 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.391364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zhtc\" (UniqueName: \"kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.530235 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.530153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:03:45.802114 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.802082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"]
Sep 14 13:03:45.804724 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:03:45.804694    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24920963_bfdd_4b42_a32e_02ee1de24018.slice/crio-2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6 WatchSource:0}: Error finding container 2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6: Status 404 returned error can't find the container with id 2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6
Sep 14 13:03:45.806699 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:45.806680    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:03:46.237710 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:46.237677    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerStarted","Data":"2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6"}
Sep 14 13:03:53.268392 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:53.268295    2559 generic.go:356] "Generic (PLEG): container finished" podID="24920963-bfdd-4b42-a32e-02ee1de24018" containerID="dc5c306cabe65e8cb4ca1baf5dc414d271f693d2407b7c929b77fae4839f0b22" exitCode=0
Sep 14 13:03:53.268392 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:53.268345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerDied","Data":"dc5c306cabe65e8cb4ca1baf5dc414d271f693d2407b7c929b77fae4839f0b22"}
Sep 14 13:03:55.279258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:55.279222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerStarted","Data":"3da250d84e6ca9c305b8d8172af76992ac00412a1ea4fd570817198f8374eb72"}
Sep 14 13:03:56.284687 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:56.284650    2559 generic.go:356] "Generic (PLEG): container finished" podID="24920963-bfdd-4b42-a32e-02ee1de24018" containerID="3da250d84e6ca9c305b8d8172af76992ac00412a1ea4fd570817198f8374eb72" exitCode=0
Sep 14 13:03:56.285174 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:03:56.284737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerDied","Data":"3da250d84e6ca9c305b8d8172af76992ac00412a1ea4fd570817198f8374eb72"}
Sep 14 13:04:03.318937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:03.318836    2559 generic.go:356] "Generic (PLEG): container finished" podID="24920963-bfdd-4b42-a32e-02ee1de24018" containerID="3dd9f59a9cfc7733b1f5b4e2941b3aceb38b365826259dc49c58c03ff8f5f40c" exitCode=0
Sep 14 13:04:03.319298 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:03.318939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerDied","Data":"3dd9f59a9cfc7733b1f5b4e2941b3aceb38b365826259dc49c58c03ff8f5f40c"}
Sep 14 13:04:04.443593 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.443563    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:04:04.554106 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.554070    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util\") pod \"24920963-bfdd-4b42-a32e-02ee1de24018\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") "
Sep 14 13:04:04.554273 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.554169    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zhtc\" (UniqueName: \"kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc\") pod \"24920963-bfdd-4b42-a32e-02ee1de24018\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") "
Sep 14 13:04:04.554273 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.554195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle\") pod \"24920963-bfdd-4b42-a32e-02ee1de24018\" (UID: \"24920963-bfdd-4b42-a32e-02ee1de24018\") "
Sep 14 13:04:04.554814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.554786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle" (OuterVolumeSpecName: "bundle") pod "24920963-bfdd-4b42-a32e-02ee1de24018" (UID: "24920963-bfdd-4b42-a32e-02ee1de24018"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:04.556338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.556303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc" (OuterVolumeSpecName: "kube-api-access-5zhtc") pod "24920963-bfdd-4b42-a32e-02ee1de24018" (UID: "24920963-bfdd-4b42-a32e-02ee1de24018"). InnerVolumeSpecName "kube-api-access-5zhtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:04:04.558355 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.558330    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util" (OuterVolumeSpecName: "util") pod "24920963-bfdd-4b42-a32e-02ee1de24018" (UID: "24920963-bfdd-4b42-a32e-02ee1de24018"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:04.654814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.654721    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:04.654814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.654764    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zhtc\" (UniqueName: \"kubernetes.io/projected/24920963-bfdd-4b42-a32e-02ee1de24018-kube-api-access-5zhtc\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:04.654814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:04.654775    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24920963-bfdd-4b42-a32e-02ee1de24018-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:05.333969 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:05.333926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg" event={"ID":"24920963-bfdd-4b42-a32e-02ee1de24018","Type":"ContainerDied","Data":"2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6"}
Sep 14 13:04:05.334144 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:05.334003    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bc1be0c343599ed8cfef002e068383f432e12fdb93b7df102053dd4490de2e6"
Sep 14 13:04:05.334144 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:05.333944    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540znmsg"
Sep 14 13:04:09.170937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.170904    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"]
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171197    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="extract"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171208    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="extract"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171216    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="util"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171223    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="util"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171234    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="pull"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171240    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="pull"
Sep 14 13:04:09.171307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.171295    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24920963-bfdd-4b42-a32e-02ee1de24018" containerName="extract"
Sep 14 13:04:09.174580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.174562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.178606 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.178586    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 14 13:04:09.179492 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.179473    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 14 13:04:09.182394 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.182371    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rxzdf\""
Sep 14 13:04:09.193499 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.193473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"]
Sep 14 13:04:09.298255 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.298222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365574b8-a67d-4e7a-84f2-64742b0ee364-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.298411 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.298288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qj4m\" (UniqueName: \"kubernetes.io/projected/365574b8-a67d-4e7a-84f2-64742b0ee364-kube-api-access-9qj4m\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.398980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.398941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qj4m\" (UniqueName: \"kubernetes.io/projected/365574b8-a67d-4e7a-84f2-64742b0ee364-kube-api-access-9qj4m\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.399173 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.399091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365574b8-a67d-4e7a-84f2-64742b0ee364-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.399453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.399431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/365574b8-a67d-4e7a-84f2-64742b0ee364-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.416590 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.416563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qj4m\" (UniqueName: \"kubernetes.io/projected/365574b8-a67d-4e7a-84f2-64742b0ee364-kube-api-access-9qj4m\") pod \"cert-manager-operator-controller-manager-55c444bf86-v94gn\" (UID: \"365574b8-a67d-4e7a-84f2-64742b0ee364\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.483578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.483550    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"
Sep 14 13:04:09.761837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:09.761205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn"]
Sep 14 13:04:09.765859 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:09.765830    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod365574b8_a67d_4e7a_84f2_64742b0ee364.slice/crio-4363433d8f5fdd0d751e6378fa018d1c3e6c315b485d1a32cd311ec499d4785d WatchSource:0}: Error finding container 4363433d8f5fdd0d751e6378fa018d1c3e6c315b485d1a32cd311ec499d4785d: Status 404 returned error can't find the container with id 4363433d8f5fdd0d751e6378fa018d1c3e6c315b485d1a32cd311ec499d4785d
Sep 14 13:04:10.355571 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:10.355532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn" event={"ID":"365574b8-a67d-4e7a-84f2-64742b0ee364","Type":"ContainerStarted","Data":"4363433d8f5fdd0d751e6378fa018d1c3e6c315b485d1a32cd311ec499d4785d"}
Sep 14 13:04:12.367076 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:12.367040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn" event={"ID":"365574b8-a67d-4e7a-84f2-64742b0ee364","Type":"ContainerStarted","Data":"39bdd2a42c83801d20ca91472986be5e6439249b3d998e63ff904ae14842cf5b"}
Sep 14 13:04:12.388966 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:12.388920    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v94gn" podStartSLOduration=1.728196498 podStartE2EDuration="3.388907453s" totalImagesPullingTime="1.660710955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:12.387605551 +0000 UTC m=+372.224114395" watchObservedRunningTime="2026-09-14 13:04:12.388907453 +0000 UTC m=+372.225416286"
Sep 14 13:04:13.066837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.066800    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"]
Sep 14 13:04:13.070523 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.070499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.075334 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.075313    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 13:04:13.076408 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.076388    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 13:04:13.076517 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.076388    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h57s\""
Sep 14 13:04:13.096532 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.096465    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"]
Sep 14 13:04:13.230261 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.230226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.230425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.230278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2z28\" (UniqueName: \"kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.230425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.230385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.331233 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.331152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.331233 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.331196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2z28\" (UniqueName: \"kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.331454 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.331247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.331601 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.331576    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.331669 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.331615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.346227 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.346205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2z28\" (UniqueName: \"kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.380023 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.379991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:13.669630 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:13.669608    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"]
Sep 14 13:04:13.672045 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:13.672017    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc89091_b850_41b1_b401_9e6586fd87ec.slice/crio-99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4 WatchSource:0}: Error finding container 99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4: Status 404 returned error can't find the container with id 99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4
Sep 14 13:04:14.377627 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:14.377596    2559 generic.go:356] "Generic (PLEG): container finished" podID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerID="4055e55b4f18a53512942d9718949635e15772641155b34b35b709ee8aa370db" exitCode=0
Sep 14 13:04:14.377774 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:14.377673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89" event={"ID":"2dc89091-b850-41b1-b401-9e6586fd87ec","Type":"ContainerDied","Data":"4055e55b4f18a53512942d9718949635e15772641155b34b35b709ee8aa370db"}
Sep 14 13:04:14.377774 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:14.377719    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89" event={"ID":"2dc89091-b850-41b1-b401-9e6586fd87ec","Type":"ContainerStarted","Data":"99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4"}
Sep 14 13:04:15.908981 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.908949    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"]
Sep 14 13:04:15.918955 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.918931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:15.922485 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.922465    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 14 13:04:15.924045 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.924003    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 14 13:04:15.924601 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.924044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8pkbg\""
Sep 14 13:04:15.926260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:15.926212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"]
Sep 14 13:04:16.054583 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.054547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdm4\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-kube-api-access-xzdm4\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.054763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.054591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.155464 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.155428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdm4\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-kube-api-access-xzdm4\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.155464 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.155466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.166641 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.166578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.170046 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.170022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdm4\" (UniqueName: \"kubernetes.io/projected/a56ad33b-4f7e-4102-835e-abb3cf435dd3-kube-api-access-xzdm4\") pod \"cert-manager-cainjector-559cdd8c87-fxjmv\" (UID: \"a56ad33b-4f7e-4102-835e-abb3cf435dd3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.240455 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.240429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"
Sep 14 13:04:16.387700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.387670    2559 generic.go:356] "Generic (PLEG): container finished" podID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerID="1a92b554eeeb8f79075df45e64330496b7b5c9ceca727392edeb22406e9a39cc" exitCode=0
Sep 14 13:04:16.387837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.387717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89" event={"ID":"2dc89091-b850-41b1-b401-9e6586fd87ec","Type":"ContainerDied","Data":"1a92b554eeeb8f79075df45e64330496b7b5c9ceca727392edeb22406e9a39cc"}
Sep 14 13:04:16.514597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:16.514573    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv"]
Sep 14 13:04:16.547738 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:16.547712    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda56ad33b_4f7e_4102_835e_abb3cf435dd3.slice/crio-d471a525925b2b7b18551e83f1ead38cbc90e4db66ce33aca44056b3b42b19cc WatchSource:0}: Error finding container d471a525925b2b7b18551e83f1ead38cbc90e4db66ce33aca44056b3b42b19cc: Status 404 returned error can't find the container with id d471a525925b2b7b18551e83f1ead38cbc90e4db66ce33aca44056b3b42b19cc
Sep 14 13:04:17.395313 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:17.395280    2559 generic.go:356] "Generic (PLEG): container finished" podID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerID="b33984bee45f07c6cb08305f3a335b8547a6329b1ac8437d2f60cb09bf089d23" exitCode=0
Sep 14 13:04:17.395697 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:17.395361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89" event={"ID":"2dc89091-b850-41b1-b401-9e6586fd87ec","Type":"ContainerDied","Data":"b33984bee45f07c6cb08305f3a335b8547a6329b1ac8437d2f60cb09bf089d23"}
Sep 14 13:04:17.396810 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:17.396780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv" event={"ID":"a56ad33b-4f7e-4102-835e-abb3cf435dd3","Type":"ContainerStarted","Data":"d471a525925b2b7b18551e83f1ead38cbc90e4db66ce33aca44056b3b42b19cc"}
Sep 14 13:04:18.873554 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.873531    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:18.980033 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.980011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2z28\" (UniqueName: \"kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28\") pod \"2dc89091-b850-41b1-b401-9e6586fd87ec\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") "
Sep 14 13:04:18.980126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.980061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle\") pod \"2dc89091-b850-41b1-b401-9e6586fd87ec\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") "
Sep 14 13:04:18.980126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.980111    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util\") pod \"2dc89091-b850-41b1-b401-9e6586fd87ec\" (UID: \"2dc89091-b850-41b1-b401-9e6586fd87ec\") "
Sep 14 13:04:18.980477 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.980447    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle" (OuterVolumeSpecName: "bundle") pod "2dc89091-b850-41b1-b401-9e6586fd87ec" (UID: "2dc89091-b850-41b1-b401-9e6586fd87ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:18.982062 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.982036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28" (OuterVolumeSpecName: "kube-api-access-p2z28") pod "2dc89091-b850-41b1-b401-9e6586fd87ec" (UID: "2dc89091-b850-41b1-b401-9e6586fd87ec"). InnerVolumeSpecName "kube-api-access-p2z28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:04:18.992028 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:18.991973    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util" (OuterVolumeSpecName: "util") pod "2dc89091-b850-41b1-b401-9e6586fd87ec" (UID: "2dc89091-b850-41b1-b401-9e6586fd87ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:19.081071 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.081045    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:19.081071 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.081068    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2z28\" (UniqueName: \"kubernetes.io/projected/2dc89091-b850-41b1-b401-9e6586fd87ec-kube-api-access-p2z28\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:19.081260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.081079    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dc89091-b850-41b1-b401-9e6586fd87ec-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:19.408631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.408602    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89"
Sep 14 13:04:19.408811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.408601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkgm89" event={"ID":"2dc89091-b850-41b1-b401-9e6586fd87ec","Type":"ContainerDied","Data":"99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4"}
Sep 14 13:04:19.408811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.408730    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99c93956b82b420d09881436aca338ad65efa43ed135f85ee387fc1a778444b4"
Sep 14 13:04:19.410372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.410343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv" event={"ID":"a56ad33b-4f7e-4102-835e-abb3cf435dd3","Type":"ContainerStarted","Data":"0b131c4891dd7cd3265c2ded70b628cc5bf337fb18e8abce3b8c4c9d619b9c93"}
Sep 14 13:04:19.449585 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:19.449529    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fxjmv" podStartSLOduration=2.078547359 podStartE2EDuration="4.449515017s" totalImagesPullingTime="2.370967658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:19.448715885 +0000 UTC m=+379.285224721" watchObservedRunningTime="2026-09-14 13:04:19.449515017 +0000 UTC m=+379.286023850"
Sep 14 13:04:23.448758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.448727    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66hmg"]
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449038    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="util"
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449051    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="util"
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449065    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="extract"
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449071    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="extract"
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449082    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="pull"
Sep 14 13:04:23.449125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449087    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="pull"
Sep 14 13:04:23.449310 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.449139    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc89091-b850-41b1-b401-9e6586fd87ec" containerName="extract"
Sep 14 13:04:23.460751 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.460726    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.464470 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.464448    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6dmd8\""
Sep 14 13:04:23.481701 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.481674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66hmg"]
Sep 14 13:04:23.617711 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.617673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-bound-sa-token\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.617852 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.617725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9ncg\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-kube-api-access-s9ncg\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.719107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.719081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-bound-sa-token\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.719257 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.719183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9ncg\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-kube-api-access-s9ncg\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.727844 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.727816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-bound-sa-token\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.727979 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.727914    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9ncg\" (UniqueName: \"kubernetes.io/projected/5dffc7ef-bced-438b-a2e7-a65042c6ffb1-kube-api-access-s9ncg\") pod \"cert-manager-55b4d954d5-66hmg\" (UID: \"5dffc7ef-bced-438b-a2e7-a65042c6ffb1\") " pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:23.769786 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:23.769753    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-66hmg"
Sep 14 13:04:24.054186 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:24.054156    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66hmg"]
Sep 14 13:04:24.056356 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:24.056328    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dffc7ef_bced_438b_a2e7_a65042c6ffb1.slice/crio-a562d5b77cc235d7981134532aa9373cfaf968d05736c60d0212896f22ee65bb WatchSource:0}: Error finding container a562d5b77cc235d7981134532aa9373cfaf968d05736c60d0212896f22ee65bb: Status 404 returned error can't find the container with id a562d5b77cc235d7981134532aa9373cfaf968d05736c60d0212896f22ee65bb
Sep 14 13:04:24.435411 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:24.435324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-66hmg" event={"ID":"5dffc7ef-bced-438b-a2e7-a65042c6ffb1","Type":"ContainerStarted","Data":"868d2748a01b1a54aab7e99ab14696968636c21350188ed59fa68726edd1d7a1"}
Sep 14 13:04:24.435411 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:24.435372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-66hmg" event={"ID":"5dffc7ef-bced-438b-a2e7-a65042c6ffb1","Type":"ContainerStarted","Data":"a562d5b77cc235d7981134532aa9373cfaf968d05736c60d0212896f22ee65bb"}
Sep 14 13:04:24.457070 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:24.457019    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-66hmg" podStartSLOduration=1.457004149 podStartE2EDuration="1.457004149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:24.4552259 +0000 UTC m=+384.291734746" watchObservedRunningTime="2026-09-14 13:04:24.457004149 +0000 UTC m=+384.293512982"
Sep 14 13:04:36.541453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.541418    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"]
Sep 14 13:04:36.546221 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.546201    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.549394 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.549377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 13:04:36.549468 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.549427    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h57s\""
Sep 14 13:04:36.550405 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.550390    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 13:04:36.555097 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.555075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"]
Sep 14 13:04:36.611159 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.611125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cc7p\" (UniqueName: \"kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.611309 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.611176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.611309 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.611267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.711586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.711556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cc7p\" (UniqueName: \"kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.711724 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.711599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.711724 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.711655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.712101 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.712080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.712101 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.712093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.720086 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.720065    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cc7p\" (UniqueName: \"kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:36.856068 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:36.855990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:37.137556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:37.132085    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"]
Sep 14 13:04:37.492963 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:37.492926    2559 generic.go:356] "Generic (PLEG): container finished" podID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerID="b1dc05d12a9cf874f9853b3dcb8c3b28bc52e9d9f7afcbd5a1dc8606d399f506" exitCode=0
Sep 14 13:04:37.493126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:37.493019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg" event={"ID":"5d1b220c-2235-4bec-ab28-3aed13e3f035","Type":"ContainerDied","Data":"b1dc05d12a9cf874f9853b3dcb8c3b28bc52e9d9f7afcbd5a1dc8606d399f506"}
Sep 14 13:04:37.493126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:37.493072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg" event={"ID":"5d1b220c-2235-4bec-ab28-3aed13e3f035","Type":"ContainerStarted","Data":"6afdafe6fa2df3d33c3093a83150a0bea17a0d82608238ea6c5a0aa3e01f1990"}
Sep 14 13:04:38.499485 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:38.499450    2559 generic.go:356] "Generic (PLEG): container finished" podID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerID="3ce40a774f30d468c1ba6d6f65de832ec3c7fa9febe6e03762ae0b47134d6502" exitCode=0
Sep 14 13:04:38.499960 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:38.499502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg" event={"ID":"5d1b220c-2235-4bec-ab28-3aed13e3f035","Type":"ContainerDied","Data":"3ce40a774f30d468c1ba6d6f65de832ec3c7fa9febe6e03762ae0b47134d6502"}
Sep 14 13:04:39.506294 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:39.506257    2559 generic.go:356] "Generic (PLEG): container finished" podID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerID="930814fa2a809bb566e5882ce3100fb364841600f23e53c74e9de74d874d5c1a" exitCode=0
Sep 14 13:04:39.506722 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:39.506336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg" event={"ID":"5d1b220c-2235-4bec-ab28-3aed13e3f035","Type":"ContainerDied","Data":"930814fa2a809bb566e5882ce3100fb364841600f23e53c74e9de74d874d5c1a"}
Sep 14 13:04:40.629203 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.629180    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:40.639627 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.639608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util\") pod \"5d1b220c-2235-4bec-ab28-3aed13e3f035\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") "
Sep 14 13:04:40.639683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.639648    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle\") pod \"5d1b220c-2235-4bec-ab28-3aed13e3f035\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") "
Sep 14 13:04:40.639683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.639677    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cc7p\" (UniqueName: \"kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p\") pod \"5d1b220c-2235-4bec-ab28-3aed13e3f035\" (UID: \"5d1b220c-2235-4bec-ab28-3aed13e3f035\") "
Sep 14 13:04:40.640316 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.640284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle" (OuterVolumeSpecName: "bundle") pod "5d1b220c-2235-4bec-ab28-3aed13e3f035" (UID: "5d1b220c-2235-4bec-ab28-3aed13e3f035"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:40.641675 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.641645    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p" (OuterVolumeSpecName: "kube-api-access-8cc7p") pod "5d1b220c-2235-4bec-ab28-3aed13e3f035" (UID: "5d1b220c-2235-4bec-ab28-3aed13e3f035"). InnerVolumeSpecName "kube-api-access-8cc7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:04:40.645151 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.645131    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util" (OuterVolumeSpecName: "util") pod "5d1b220c-2235-4bec-ab28-3aed13e3f035" (UID: "5d1b220c-2235-4bec-ab28-3aed13e3f035"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:40.741270 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.741234    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:40.741270 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.741259    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1b220c-2235-4bec-ab28-3aed13e3f035-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:40.741270 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:40.741273    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cc7p\" (UniqueName: \"kubernetes.io/projected/5d1b220c-2235-4bec-ab28-3aed13e3f035-kube-api-access-8cc7p\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:41.518580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:41.518541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg" event={"ID":"5d1b220c-2235-4bec-ab28-3aed13e3f035","Type":"ContainerDied","Data":"6afdafe6fa2df3d33c3093a83150a0bea17a0d82608238ea6c5a0aa3e01f1990"}
Sep 14 13:04:41.518757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:41.518594    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflfthg"
Sep 14 13:04:41.518757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:41.518619    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6afdafe6fa2df3d33c3093a83150a0bea17a0d82608238ea6c5a0aa3e01f1990"
Sep 14 13:04:48.845378 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845343    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"]
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="pull"
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845686    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="pull"
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845700    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="util"
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845705    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="util"
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="extract"
Sep 14 13:04:48.845769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845724    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="extract"
Sep 14 13:04:48.846005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.845785    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1b220c-2235-4bec-ab28-3aed13e3f035" containerName="extract"
Sep 14 13:04:48.848506 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.848490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:48.851548 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.851525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h57s\""
Sep 14 13:04:48.851691 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.851572    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 13:04:48.853028 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.853008    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 13:04:48.858990 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.858965    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"]
Sep 14 13:04:48.906193 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.906152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6t5g\" (UniqueName: \"kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:48.906384 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.906241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:48.906384 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:48.906266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.007199 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.007168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.007199 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.007201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.007421 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.007232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6t5g\" (UniqueName: \"kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.007587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.007568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.007639 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.007626    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.016989 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.016956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6t5g\" (UniqueName: \"kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.158449 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.158188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:49.445238 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.445207    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"]
Sep 14 13:04:49.446545 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:49.446518    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92619a3_5d3f_43d6_b3e0_5f1588c5ab38.slice/crio-522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344 WatchSource:0}: Error finding container 522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344: Status 404 returned error can't find the container with id 522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344
Sep 14 13:04:49.562779 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.562743    2559 generic.go:356] "Generic (PLEG): container finished" podID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerID="4d41daa7626f9f21c962e1c91b249c02b3188ba0291a8ea4b2097ccbdb7d72fe" exitCode=0
Sep 14 13:04:49.562987 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.562829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6" event={"ID":"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38","Type":"ContainerDied","Data":"4d41daa7626f9f21c962e1c91b249c02b3188ba0291a8ea4b2097ccbdb7d72fe"}
Sep 14 13:04:49.562987 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:49.562891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6" event={"ID":"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38","Type":"ContainerStarted","Data":"522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344"}
Sep 14 13:04:50.569376 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:50.569340    2559 generic.go:356] "Generic (PLEG): container finished" podID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerID="e9c6805432cfa96aa0d9f698fcfa1ee2969bfdeec49648063447b0e48b05440b" exitCode=0
Sep 14 13:04:50.569758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:50.569428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6" event={"ID":"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38","Type":"ContainerDied","Data":"e9c6805432cfa96aa0d9f698fcfa1ee2969bfdeec49648063447b0e48b05440b"}
Sep 14 13:04:50.983832 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:50.983797    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:04:51.128871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.128834    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"]
Sep 14 13:04:51.156460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.156427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.162734 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.162700    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l77cj\""
Sep 14 13:04:51.170595 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.170570    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 13:04:51.170595 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.170585    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 13:04:51.170745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.170607    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 13:04:51.170745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.170695    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 13:04:51.196371 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.196338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"]
Sep 14 13:04:51.225364 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.225335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.225521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.225389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.225521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.225422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg69k\" (UniqueName: \"kubernetes.io/projected/a7e9e984-a5fd-40a1-af22-28ac819dbfce-kube-api-access-tg69k\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.225521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.225442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.225521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.225472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.326580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.326496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.326580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.326537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg69k\" (UniqueName: \"kubernetes.io/projected/a7e9e984-a5fd-40a1-af22-28ac819dbfce-kube-api-access-tg69k\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.326580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.326560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.326845 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.326597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.326845 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.326648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.327123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.327102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-manifests\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.328996 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.328974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7e9e984-a5fd-40a1-af22-28ac819dbfce-tmp\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.329092 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.329053    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-webhook-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.329152 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.329114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7e9e984-a5fd-40a1-af22-28ac819dbfce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.346434 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.346413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg69k\" (UniqueName: \"kubernetes.io/projected/a7e9e984-a5fd-40a1-af22-28ac819dbfce-kube-api-access-tg69k\") pod \"opendatahub-operator-controller-manager-b94df8b4-mgllv\" (UID: \"a7e9e984-a5fd-40a1-af22-28ac819dbfce\") " pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.466834 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.466797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:51.576632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.576553    2559 generic.go:356] "Generic (PLEG): container finished" podID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerID="e90b9899278da726f2af55f7bd3d43ed4d3a35b598128744a4bf36d856916572" exitCode=0
Sep 14 13:04:51.576632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.576597    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6" event={"ID":"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38","Type":"ContainerDied","Data":"e90b9899278da726f2af55f7bd3d43ed4d3a35b598128744a4bf36d856916572"}
Sep 14 13:04:51.773403 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:51.773377    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"]
Sep 14 13:04:51.775382 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:04:51.775357    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e9e984_a5fd_40a1_af22_28ac819dbfce.slice/crio-530dfe1825287faf13152b13c110cb1d72661070e9b9dc3966405a017386c47e WatchSource:0}: Error finding container 530dfe1825287faf13152b13c110cb1d72661070e9b9dc3966405a017386c47e: Status 404 returned error can't find the container with id 530dfe1825287faf13152b13c110cb1d72661070e9b9dc3966405a017386c47e
Sep 14 13:04:52.590058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.590000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv" event={"ID":"a7e9e984-a5fd-40a1-af22-28ac819dbfce","Type":"ContainerStarted","Data":"530dfe1825287faf13152b13c110cb1d72661070e9b9dc3966405a017386c47e"}
Sep 14 13:04:52.754391 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.754361    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:52.841788 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.841693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle\") pod \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") "
Sep 14 13:04:52.841788 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.841744    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util\") pod \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") "
Sep 14 13:04:52.842058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.841847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6t5g\" (UniqueName: \"kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g\") pod \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\" (UID: \"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38\") "
Sep 14 13:04:52.842740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.842708    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle" (OuterVolumeSpecName: "bundle") pod "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" (UID: "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:52.844673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.844631    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g" (OuterVolumeSpecName: "kube-api-access-d6t5g") pod "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" (UID: "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38"). InnerVolumeSpecName "kube-api-access-d6t5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:04:52.849741 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.849717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util" (OuterVolumeSpecName: "util") pod "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" (UID: "c92619a3-5d3f-43d6-b3e0-5f1588c5ab38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:04:52.943297 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.943262    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:52.943297 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.943293    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:52.943532 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:52.943308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6t5g\" (UniqueName: \"kubernetes.io/projected/c92619a3-5d3f-43d6-b3e0-5f1588c5ab38-kube-api-access-d6t5g\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:04:53.597572 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:53.597542    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6"
Sep 14 13:04:53.597974 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:53.597566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lgvt6" event={"ID":"c92619a3-5d3f-43d6-b3e0-5f1588c5ab38","Type":"ContainerDied","Data":"522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344"}
Sep 14 13:04:53.597974 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:53.597622    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="522c2b4561f7a2e3cd58b08126c59dc31bc78ef4f6cd7a8ca60b8014587ad344"
Sep 14 13:04:55.609976 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:55.609934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv" event={"ID":"a7e9e984-a5fd-40a1-af22-28ac819dbfce","Type":"ContainerStarted","Data":"4b7d89c3a4340340427be39cf1f27c351663bae91cdd8711fae6201440972d0e"}
Sep 14 13:04:56.616725 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:56.616687    2559 generic.go:356] "Generic (PLEG): container finished" podID="a7e9e984-a5fd-40a1-af22-28ac819dbfce" containerID="4b7d89c3a4340340427be39cf1f27c351663bae91cdd8711fae6201440972d0e" exitCode=0
Sep 14 13:04:56.617161 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:56.616766    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv" event={"ID":"a7e9e984-a5fd-40a1-af22-28ac819dbfce","Type":"ContainerDied","Data":"4b7d89c3a4340340427be39cf1f27c351663bae91cdd8711fae6201440972d0e"}
Sep 14 13:04:57.623315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:57.623274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv" event={"ID":"a7e9e984-a5fd-40a1-af22-28ac819dbfce","Type":"ContainerStarted","Data":"7db2a4e4eaecc38a837a3993f7357fae3e18e62a5921a9da173600590e8c2f99"}
Sep 14 13:04:57.623728 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:57.623408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:04:57.648487 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:04:57.648434    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv" podStartSLOduration=2.222017482 podStartE2EDuration="6.648416296s" totalImagesPullingTime="3.40921348s" totalInitContainerRuntime="1.017185334s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:04:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:04:57.646460924 +0000 UTC m=+417.482969785" watchObservedRunningTime="2026-09-14 13:04:57.648416296 +0000 UTC m=+417.484925130"
Sep 14 13:05:08.631045 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.631005    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b94df8b4-mgllv"
Sep 14 13:05:08.763350 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763318    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"]
Sep 14 13:05:08.763649 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763635    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="extract"
Sep 14 13:05:08.763649 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763650    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="extract"
Sep 14 13:05:08.763736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763659    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="util"
Sep 14 13:05:08.763736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763665    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="util"
Sep 14 13:05:08.763736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763673    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="pull"
Sep 14 13:05:08.763736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="pull"
Sep 14 13:05:08.763736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.763736    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c92619a3-5d3f-43d6-b3e0-5f1588c5ab38" containerName="extract"
Sep 14 13:05:08.772860 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.772836    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.776243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.776211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jzgpz\""
Sep 14 13:05:08.776531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.776509    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 14 13:05:08.776635 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.776513    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 14 13:05:08.776782 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.776763    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 14 13:05:08.776928 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.776905    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 14 13:05:08.777323 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.777301    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 14 13:05:08.786809 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.786779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"]
Sep 14 13:05:08.880171 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.880129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223616a1-345f-41c1-bde8-87570e6d6c3e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.880171 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.880171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.880417 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.880194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkt2\" (UniqueName: \"kubernetes.io/projected/223616a1-345f-41c1-bde8-87570e6d6c3e-kube-api-access-zgkt2\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.880417 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.880267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.981151 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.981120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.981321 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.981195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223616a1-345f-41c1-bde8-87570e6d6c3e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.981321 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.981220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.981321 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.981238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkt2\" (UniqueName: \"kubernetes.io/projected/223616a1-345f-41c1-bde8-87570e6d6c3e-kube-api-access-zgkt2\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.981869 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.981847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/223616a1-345f-41c1-bde8-87570e6d6c3e-manager-config\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.983629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.983601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.983838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.983815    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/223616a1-345f-41c1-bde8-87570e6d6c3e-metrics-cert\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:08.993795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:08.993760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkt2\" (UniqueName: \"kubernetes.io/projected/223616a1-345f-41c1-bde8-87570e6d6c3e-kube-api-access-zgkt2\") pod \"lws-controller-manager-6b9c8bb87f-pjls8\" (UID: \"223616a1-345f-41c1-bde8-87570e6d6c3e\") " pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:09.087066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:09.087023    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:09.360661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:09.360454    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"]
Sep 14 13:05:09.363324 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:05:09.363296    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223616a1_345f_41c1_bde8_87570e6d6c3e.slice/crio-018ca4d30dabd930128d236a62240bf0e41621a67d446a3224d742df0579b14b WatchSource:0}: Error finding container 018ca4d30dabd930128d236a62240bf0e41621a67d446a3224d742df0579b14b: Status 404 returned error can't find the container with id 018ca4d30dabd930128d236a62240bf0e41621a67d446a3224d742df0579b14b
Sep 14 13:05:09.680576 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:09.680492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" event={"ID":"223616a1-345f-41c1-bde8-87570e6d6c3e","Type":"ContainerStarted","Data":"018ca4d30dabd930128d236a62240bf0e41621a67d446a3224d742df0579b14b"}
Sep 14 13:05:10.686867 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:10.686825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" event={"ID":"223616a1-345f-41c1-bde8-87570e6d6c3e","Type":"ContainerStarted","Data":"dbdd2b691fd61d473e199d07af6644123dd966bd025ac0e18e4309d434d171fc"}
Sep 14 13:05:10.687268 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:10.686915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:05:10.721689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:10.721586    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" podStartSLOduration=1.599770791 podStartE2EDuration="2.721569444s" totalImagesPullingTime="1.121798653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:10.721419071 +0000 UTC m=+430.557927912" watchObservedRunningTime="2026-09-14 13:05:10.721569444 +0000 UTC m=+430.558078278"
Sep 14 13:05:16.003545 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.003498    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8cdf85849-lbc26" podUID="b3d30160-28c4-426c-8490-0c12220907e9" containerName="console" containerID="cri-o://3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b" gracePeriod=15
Sep 14 13:05:16.247091 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.247065    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:05:16.344851 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.344756    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.344851 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.344822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345098 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.344903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345098 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.344926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345098 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.344972    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345098 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345017    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dnp\" (UniqueName: \"kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345098 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert\") pod \"b3d30160-28c4-426c-8490-0c12220907e9\" (UID: \"b3d30160-28c4-426c-8490-0c12220907e9\") "
Sep 14 13:05:16.345353 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345306    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:05:16.345353 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345337    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config" (OuterVolumeSpecName: "console-config") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:05:16.345462 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345340    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:05:16.345638 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.345611    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:05:16.347178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.347153    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:05:16.347628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.347591    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:05:16.347628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.347603    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp" (OuterVolumeSpecName: "kube-api-access-45dnp") pod "b3d30160-28c4-426c-8490-0c12220907e9" (UID: "b3d30160-28c4-426c-8490-0c12220907e9"). InnerVolumeSpecName "kube-api-access-45dnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:05:16.382150 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.382119    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"]
Sep 14 13:05:16.382473 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.382455    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d30160-28c4-426c-8490-0c12220907e9" containerName="console"
Sep 14 13:05:16.382473 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.382471    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d30160-28c4-426c-8490-0c12220907e9" containerName="console"
Sep 14 13:05:16.382625 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.382531    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d30160-28c4-426c-8490-0c12220907e9" containerName="console"
Sep 14 13:05:16.385914 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.385893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.388640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.388598    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 14 13:05:16.388735 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.388648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-54jsx\""
Sep 14 13:05:16.388946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.388931    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 14 13:05:16.403604 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.403577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"]
Sep 14 13:05:16.446166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446134    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-console-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446163    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dnp\" (UniqueName: \"kubernetes.io/projected/b3d30160-28c4-426c-8490-0c12220907e9-kube-api-access-45dnp\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446177    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-oauth-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446192    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446205    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d30160-28c4-426c-8490-0c12220907e9-trusted-ca-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446225    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-serving-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.446380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.446236    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3d30160-28c4-426c-8490-0c12220907e9-console-oauth-config\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:05:16.546726 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.546686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da10d5a5-26fc-468f-80b5-cd2d50f53851-tmp\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.546726 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.546724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6mc\" (UniqueName: \"kubernetes.io/projected/da10d5a5-26fc-468f-80b5-cd2d50f53851-kube-api-access-qb6mc\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.546944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.546760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.647410 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.647321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.647554 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.647420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da10d5a5-26fc-468f-80b5-cd2d50f53851-tmp\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.647554 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.647450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6mc\" (UniqueName: \"kubernetes.io/projected/da10d5a5-26fc-468f-80b5-cd2d50f53851-kube-api-access-qb6mc\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.647554 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:05:16.647487    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 14 13:05:16.647658 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:05:16.647569    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs podName:da10d5a5-26fc-468f-80b5-cd2d50f53851 nodeName:}" failed. No retries permitted until 2026-09-14 13:05:17.147547734 +0000 UTC m=+436.984056566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs") pod "kube-auth-proxy-5c8fdbb99c-w7h4f" (UID: "da10d5a5-26fc-468f-80b5-cd2d50f53851") : secret "kube-auth-proxy-tls" not found
Sep 14 13:05:16.649632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.649609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da10d5a5-26fc-468f-80b5-cd2d50f53851-tmp\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.657031 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.657009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6mc\" (UniqueName: \"kubernetes.io/projected/da10d5a5-26fc-468f-80b5-cd2d50f53851-kube-api-access-qb6mc\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:16.717689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.717658    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3d30160-28c4-426c-8490-0c12220907e9" containerID="3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b" exitCode=0
Sep 14 13:05:16.717818 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.717701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8cdf85849-lbc26"
Sep 14 13:05:16.717818 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.717746    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdf85849-lbc26" event={"ID":"b3d30160-28c4-426c-8490-0c12220907e9","Type":"ContainerDied","Data":"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"}
Sep 14 13:05:16.717818 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.717795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8cdf85849-lbc26" event={"ID":"b3d30160-28c4-426c-8490-0c12220907e9","Type":"ContainerDied","Data":"b76d0bb199350a8f98328081ba898d2374f1de0be8fbac9fa8cc8206bfcf473d"}
Sep 14 13:05:16.717818 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.717816    2559 scope.go:117] "RemoveContainer" containerID="3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"
Sep 14 13:05:16.726359 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.726342    2559 scope.go:117] "RemoveContainer" containerID="3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"
Sep 14 13:05:16.726639 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:05:16.726621    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b\": container with ID starting with 3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b not found: ID does not exist" containerID="3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"
Sep 14 13:05:16.726691 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.726649    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b"} err="failed to get container status \"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b\": rpc error: code = NotFound desc = could not find container \"3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b\": container with ID starting with 3bf71a98ec6994f7be11588fbbefc1839a5ff1c41575fd21b4248c30b87b7e3b not found: ID does not exist"
Sep 14 13:05:16.736688 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.736664    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:05:16.740817 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:16.740796    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8cdf85849-lbc26"]
Sep 14 13:05:17.151936 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:17.151899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:17.154484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:17.154458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da10d5a5-26fc-468f-80b5-cd2d50f53851-tls-certs\") pod \"kube-auth-proxy-5c8fdbb99c-w7h4f\" (UID: \"da10d5a5-26fc-468f-80b5-cd2d50f53851\") " pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:17.295982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:17.295946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"
Sep 14 13:05:17.580077 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:17.580051    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f"]
Sep 14 13:05:17.582355 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:05:17.582328    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda10d5a5_26fc_468f_80b5_cd2d50f53851.slice/crio-1e2932dda730225c7a4ff9227df81829a4040b7e60af87b4f8063ef217456f30 WatchSource:0}: Error finding container 1e2932dda730225c7a4ff9227df81829a4040b7e60af87b4f8063ef217456f30: Status 404 returned error can't find the container with id 1e2932dda730225c7a4ff9227df81829a4040b7e60af87b4f8063ef217456f30
Sep 14 13:05:17.724859 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:17.724820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f" event={"ID":"da10d5a5-26fc-468f-80b5-cd2d50f53851","Type":"ContainerStarted","Data":"1e2932dda730225c7a4ff9227df81829a4040b7e60af87b4f8063ef217456f30"}
Sep 14 13:05:18.685184 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:18.685148    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d30160-28c4-426c-8490-0c12220907e9" path="/var/lib/kubelet/pods/b3d30160-28c4-426c-8490-0c12220907e9/volumes"
Sep 14 13:05:20.743657 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:20.743623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f" event={"ID":"da10d5a5-26fc-468f-80b5-cd2d50f53851","Type":"ContainerStarted","Data":"e37b3f488680c5252a57a8c340faaf5da6fcdd0609377aa1ec3047fba98d445b"}
Sep 14 13:05:20.760891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:20.760833    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8fdbb99c-w7h4f" podStartSLOduration=1.951577265 podStartE2EDuration="4.760818132s" totalImagesPullingTime="2.809240867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:05:20.760192731 +0000 UTC m=+440.596701567" watchObservedRunningTime="2026-09-14 13:05:20.760818132 +0000 UTC m=+440.597326980"
Sep 14 13:05:21.693743 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:05:21.693707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:06:28.641870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.641824    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"]
Sep 14 13:06:28.644495 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.644475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.647918 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.647895    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6h57s\""
Sep 14 13:06:28.649034 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.649013    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 14 13:06:28.649157 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.649013    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 14 13:06:28.660361 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.660332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"]
Sep 14 13:06:28.742683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.742648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvw7\" (UniqueName: \"kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.742858 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.742700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.742858 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.742740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.743469 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.743443    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"]
Sep 14 13:06:28.745980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.745964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.759762 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.759737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"]
Sep 14 13:06:28.834492 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.834461    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"]
Sep 14 13:06:28.837066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.837049    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:28.843301 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvw7\" (UniqueName: \"kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.843301 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.843301 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.843493 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdgrc\" (UniqueName: \"kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.843493 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.843493 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.843795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.843863 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.843773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.849970 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.849945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"]
Sep 14 13:06:28.855631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.855607    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvw7\" (UniqueName: \"kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.925815 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.925735    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"]
Sep 14 13:06:28.928683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.928664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:28.939469 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.939444    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"]
Sep 14 13:06:28.944506 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7fgq\" (UniqueName: \"kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:28.944618 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:28.944618 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdgrc\" (UniqueName: \"kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.944618 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.944771 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.944771 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:28.944975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.944956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.945062 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.945040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:28.953662 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.953641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:28.954779 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:28.954758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdgrc\" (UniqueName: \"kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:29.045560 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.045714 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdln\" (UniqueName: \"kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.045714 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.045714 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.045865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7fgq\" (UniqueName: \"kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.045865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.045733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.046068 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.046050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.046126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.046096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.054661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.054637    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:29.055636 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.055615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7fgq\" (UniqueName: \"kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.146225 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:29.146494 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.146578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdln\" (UniqueName: \"kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.146578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.146980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.146980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.146923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.156132 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.156105    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdln\" (UniqueName: \"kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.230370 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.230344    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"]
Sep 14 13:06:29.231998 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:06:29.231971    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4363b9_cd5e_4bdf_82da_241b32997552.slice/crio-3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f WatchSource:0}: Error finding container 3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f: Status 404 returned error can't find the container with id 3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f
Sep 14 13:06:29.238427 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.238407    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:29.334864 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.334837    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"]
Sep 14 13:06:29.336188 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:06:29.336156    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c24b55_7783_4a05_8fe7_20e0d9fb6511.slice/crio-aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974 WatchSource:0}: Error finding container aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974: Status 404 returned error can't find the container with id aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974
Sep 14 13:06:29.421223 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.421198    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"]
Sep 14 13:06:29.423439 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:06:29.423409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa03a234_046f_4179_a211_2f7cf67f2321.slice/crio-61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235 WatchSource:0}: Error finding container 61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235: Status 404 returned error can't find the container with id 61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235
Sep 14 13:06:29.513484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:29.513437    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"]
Sep 14 13:06:29.522236 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:06:29.522205    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c21d7c3_47c6_4161_afc9_e36845f8de78.slice/crio-cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697 WatchSource:0}: Error finding container cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697: Status 404 returned error can't find the container with id cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697
Sep 14 13:06:30.070714 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.070682    2559 generic.go:356] "Generic (PLEG): container finished" podID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerID="fd2b814db613085e48a8af215fdc8ad66b4fba7387ebde79a27ff3dd23dcbdd4" exitCode=0
Sep 14 13:06:30.071183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.070772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5" event={"ID":"9c21d7c3-47c6-4161-afc9-e36845f8de78","Type":"ContainerDied","Data":"fd2b814db613085e48a8af215fdc8ad66b4fba7387ebde79a27ff3dd23dcbdd4"}
Sep 14 13:06:30.071183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.070830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5" event={"ID":"9c21d7c3-47c6-4161-afc9-e36845f8de78","Type":"ContainerStarted","Data":"cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697"}
Sep 14 13:06:30.072391 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.072374    2559 generic.go:356] "Generic (PLEG): container finished" podID="fa03a234-046f-4179-a211-2f7cf67f2321" containerID="a17e7da4f3983a1da046199dc9f649f049f68d4a76688b3992c93b9233ffef82" exitCode=0
Sep 14 13:06:30.072474 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.072452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz" event={"ID":"fa03a234-046f-4179-a211-2f7cf67f2321","Type":"ContainerDied","Data":"a17e7da4f3983a1da046199dc9f649f049f68d4a76688b3992c93b9233ffef82"}
Sep 14 13:06:30.072531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.072504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz" event={"ID":"fa03a234-046f-4179-a211-2f7cf67f2321","Type":"ContainerStarted","Data":"61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235"}
Sep 14 13:06:30.074123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.074101    2559 generic.go:356] "Generic (PLEG): container finished" podID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerID="1592c4733bc4c9481b545b14f1e8810f92635c38e690927dad2eace15650ac73" exitCode=0
Sep 14 13:06:30.074221 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.074153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp" event={"ID":"49c24b55-7783-4a05-8fe7-20e0d9fb6511","Type":"ContainerDied","Data":"1592c4733bc4c9481b545b14f1e8810f92635c38e690927dad2eace15650ac73"}
Sep 14 13:06:30.074221 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.074213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp" event={"ID":"49c24b55-7783-4a05-8fe7-20e0d9fb6511","Type":"ContainerStarted","Data":"aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974"}
Sep 14 13:06:30.075857 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.075837    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerID="583c78a450ffa607ed84118b0396842b61da9fdb4bf155bf58bdeb2e864b7969" exitCode=0
Sep 14 13:06:30.075956 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.075913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x" event={"ID":"9d4363b9-cd5e-4bdf-82da-241b32997552","Type":"ContainerDied","Data":"583c78a450ffa607ed84118b0396842b61da9fdb4bf155bf58bdeb2e864b7969"}
Sep 14 13:06:30.076018 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:30.075955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x" event={"ID":"9d4363b9-cd5e-4bdf-82da-241b32997552","Type":"ContainerStarted","Data":"3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f"}
Sep 14 13:06:32.092102 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.092069    2559 generic.go:356] "Generic (PLEG): container finished" podID="fa03a234-046f-4179-a211-2f7cf67f2321" containerID="bf3c0d0b01d8fe8d254a919c62f7467ab221ffd9aaeccaa4a1b747f11a5b3a86" exitCode=0
Sep 14 13:06:32.092510 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.092158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz" event={"ID":"fa03a234-046f-4179-a211-2f7cf67f2321","Type":"ContainerDied","Data":"bf3c0d0b01d8fe8d254a919c62f7467ab221ffd9aaeccaa4a1b747f11a5b3a86"}
Sep 14 13:06:32.094227 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.094205    2559 generic.go:356] "Generic (PLEG): container finished" podID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerID="13b4ffbaa3544a1862567f5bf41f68fe415c54206f2316677cdb1d724b527a51" exitCode=0
Sep 14 13:06:32.094315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.094290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp" event={"ID":"49c24b55-7783-4a05-8fe7-20e0d9fb6511","Type":"ContainerDied","Data":"13b4ffbaa3544a1862567f5bf41f68fe415c54206f2316677cdb1d724b527a51"}
Sep 14 13:06:32.096275 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.096253    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerID="a7238e7485290aa0e86953ffc5d04676e1e89450d7dc45d625e4869c832cd590" exitCode=0
Sep 14 13:06:32.096357 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.096322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x" event={"ID":"9d4363b9-cd5e-4bdf-82da-241b32997552","Type":"ContainerDied","Data":"a7238e7485290aa0e86953ffc5d04676e1e89450d7dc45d625e4869c832cd590"}
Sep 14 13:06:32.098566 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.098546    2559 generic.go:356] "Generic (PLEG): container finished" podID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerID="0ea90d5520e4d5592d1e93dfe9216f8611ca534028a35c2bf0d80ab20ede7295" exitCode=0
Sep 14 13:06:32.098653 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:32.098584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5" event={"ID":"9c21d7c3-47c6-4161-afc9-e36845f8de78","Type":"ContainerDied","Data":"0ea90d5520e4d5592d1e93dfe9216f8611ca534028a35c2bf0d80ab20ede7295"}
Sep 14 13:06:33.105548 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.105513    2559 generic.go:356] "Generic (PLEG): container finished" podID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerID="ef8b4523d0c72f41eb6beb850a48de9ec2bffaf48d0dc11fa425caa33dc9c820" exitCode=0
Sep 14 13:06:33.106011 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.105598    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5" event={"ID":"9c21d7c3-47c6-4161-afc9-e36845f8de78","Type":"ContainerDied","Data":"ef8b4523d0c72f41eb6beb850a48de9ec2bffaf48d0dc11fa425caa33dc9c820"}
Sep 14 13:06:33.107685 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.107663    2559 generic.go:356] "Generic (PLEG): container finished" podID="fa03a234-046f-4179-a211-2f7cf67f2321" containerID="696d4b4b06325490c222962a53311616f53d41945bb9dde99ae4e0cef883053c" exitCode=0
Sep 14 13:06:33.107812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.107730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz" event={"ID":"fa03a234-046f-4179-a211-2f7cf67f2321","Type":"ContainerDied","Data":"696d4b4b06325490c222962a53311616f53d41945bb9dde99ae4e0cef883053c"}
Sep 14 13:06:33.109625 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.109602    2559 generic.go:356] "Generic (PLEG): container finished" podID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerID="4c095fd4a87302b9c5d194a9315158f143d99cfffd342e9d20eea15b24338362" exitCode=0
Sep 14 13:06:33.109722 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.109687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp" event={"ID":"49c24b55-7783-4a05-8fe7-20e0d9fb6511","Type":"ContainerDied","Data":"4c095fd4a87302b9c5d194a9315158f143d99cfffd342e9d20eea15b24338362"}
Sep 14 13:06:33.117791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.117766    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerID="8bf252a7e1dc8f2419ec53943a8db74d14e35ff15d61c02803226dcff67407db" exitCode=0
Sep 14 13:06:33.117915 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:33.117818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x" event={"ID":"9d4363b9-cd5e-4bdf-82da-241b32997552","Type":"ContainerDied","Data":"8bf252a7e1dc8f2419ec53943a8db74d14e35ff15d61c02803226dcff67407db"}
Sep 14 13:06:34.278149 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.278121    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:34.289246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.289215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util\") pod \"fa03a234-046f-4179-a211-2f7cf67f2321\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") "
Sep 14 13:06:34.289459 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.289284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle\") pod \"fa03a234-046f-4179-a211-2f7cf67f2321\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") "
Sep 14 13:06:34.289459 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.289326    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7fgq\" (UniqueName: \"kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq\") pod \"fa03a234-046f-4179-a211-2f7cf67f2321\" (UID: \"fa03a234-046f-4179-a211-2f7cf67f2321\") "
Sep 14 13:06:34.290118 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.289924    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle" (OuterVolumeSpecName: "bundle") pod "fa03a234-046f-4179-a211-2f7cf67f2321" (UID: "fa03a234-046f-4179-a211-2f7cf67f2321"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.294742 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.294702    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq" (OuterVolumeSpecName: "kube-api-access-f7fgq") pod "fa03a234-046f-4179-a211-2f7cf67f2321" (UID: "fa03a234-046f-4179-a211-2f7cf67f2321"). InnerVolumeSpecName "kube-api-access-f7fgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:06:34.295544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.295515    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util" (OuterVolumeSpecName: "util") pod "fa03a234-046f-4179-a211-2f7cf67f2321" (UID: "fa03a234-046f-4179-a211-2f7cf67f2321"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.313484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.313455    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:34.326023 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.325999    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:34.332641 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.332623    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:34.390082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.389999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util\") pod \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") "
Sep 14 13:06:34.390082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390035    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util\") pod \"9c21d7c3-47c6-4161-afc9-e36845f8de78\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") "
Sep 14 13:06:34.390082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390053    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxdln\" (UniqueName: \"kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln\") pod \"9c21d7c3-47c6-4161-afc9-e36845f8de78\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") "
Sep 14 13:06:34.390082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390078    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjvw7\" (UniqueName: \"kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7\") pod \"9d4363b9-cd5e-4bdf-82da-241b32997552\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") "
Sep 14 13:06:34.390420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390105    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util\") pod \"9d4363b9-cd5e-4bdf-82da-241b32997552\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") "
Sep 14 13:06:34.390420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390142    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdgrc\" (UniqueName: \"kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc\") pod \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") "
Sep 14 13:06:34.390420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390206    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle\") pod \"9d4363b9-cd5e-4bdf-82da-241b32997552\" (UID: \"9d4363b9-cd5e-4bdf-82da-241b32997552\") "
Sep 14 13:06:34.390420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390235    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle\") pod \"9c21d7c3-47c6-4161-afc9-e36845f8de78\" (UID: \"9c21d7c3-47c6-4161-afc9-e36845f8de78\") "
Sep 14 13:06:34.390420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle\") pod \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\" (UID: \"49c24b55-7783-4a05-8fe7-20e0d9fb6511\") "
Sep 14 13:06:34.390665 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390540    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.390665 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390556    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa03a234-046f-4179-a211-2f7cf67f2321-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.390665 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390570    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7fgq\" (UniqueName: \"kubernetes.io/projected/fa03a234-046f-4179-a211-2f7cf67f2321-kube-api-access-f7fgq\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.391064 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.390987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle" (OuterVolumeSpecName: "bundle") pod "9d4363b9-cd5e-4bdf-82da-241b32997552" (UID: "9d4363b9-cd5e-4bdf-82da-241b32997552"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.391226 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.391149    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle" (OuterVolumeSpecName: "bundle") pod "49c24b55-7783-4a05-8fe7-20e0d9fb6511" (UID: "49c24b55-7783-4a05-8fe7-20e0d9fb6511"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.391590 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.391562    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle" (OuterVolumeSpecName: "bundle") pod "9c21d7c3-47c6-4161-afc9-e36845f8de78" (UID: "9c21d7c3-47c6-4161-afc9-e36845f8de78"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.392789 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.392763    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc" (OuterVolumeSpecName: "kube-api-access-pdgrc") pod "49c24b55-7783-4a05-8fe7-20e0d9fb6511" (UID: "49c24b55-7783-4a05-8fe7-20e0d9fb6511"). InnerVolumeSpecName "kube-api-access-pdgrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:06:34.393251 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.393232    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln" (OuterVolumeSpecName: "kube-api-access-qxdln") pod "9c21d7c3-47c6-4161-afc9-e36845f8de78" (UID: "9c21d7c3-47c6-4161-afc9-e36845f8de78"). InnerVolumeSpecName "kube-api-access-qxdln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:06:34.393848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.393826    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7" (OuterVolumeSpecName: "kube-api-access-mjvw7") pod "9d4363b9-cd5e-4bdf-82da-241b32997552" (UID: "9d4363b9-cd5e-4bdf-82da-241b32997552"). InnerVolumeSpecName "kube-api-access-mjvw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:06:34.395967 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.395946    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util" (OuterVolumeSpecName: "util") pod "49c24b55-7783-4a05-8fe7-20e0d9fb6511" (UID: "49c24b55-7783-4a05-8fe7-20e0d9fb6511"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.396362 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.396343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util" (OuterVolumeSpecName: "util") pod "9c21d7c3-47c6-4161-afc9-e36845f8de78" (UID: "9c21d7c3-47c6-4161-afc9-e36845f8de78"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.449700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.449653    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util" (OuterVolumeSpecName: "util") pod "9d4363b9-cd5e-4bdf-82da-241b32997552" (UID: "9d4363b9-cd5e-4bdf-82da-241b32997552"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:06:34.490946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490909    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.490946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490939    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49c24b55-7783-4a05-8fe7-20e0d9fb6511-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.490946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490947    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490958    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxdln\" (UniqueName: \"kubernetes.io/projected/9c21d7c3-47c6-4161-afc9-e36845f8de78-kube-api-access-qxdln\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490970    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjvw7\" (UniqueName: \"kubernetes.io/projected/9d4363b9-cd5e-4bdf-82da-241b32997552-kube-api-access-mjvw7\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490979    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-util\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490987    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdgrc\" (UniqueName: \"kubernetes.io/projected/49c24b55-7783-4a05-8fe7-20e0d9fb6511-kube-api-access-pdgrc\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.490995    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d4363b9-cd5e-4bdf-82da-241b32997552-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:34.491165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:34.491003    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c21d7c3-47c6-4161-afc9-e36845f8de78-bundle\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:06:35.129518 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.129489    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5"
Sep 14 13:06:35.129676 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.129493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a7s8z5" event={"ID":"9c21d7c3-47c6-4161-afc9-e36845f8de78","Type":"ContainerDied","Data":"cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697"}
Sep 14 13:06:35.129676 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.129618    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf0a95975e07ab20fa7ec2ff7adbe16fb7ce4fd70278a4fe7a70b1bdd66c9697"
Sep 14 13:06:35.131580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.131554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz" event={"ID":"fa03a234-046f-4179-a211-2f7cf67f2321","Type":"ContainerDied","Data":"61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235"}
Sep 14 13:06:35.131750 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.131601    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61a56d31b9443b29ce501c943c52891634ae0baa6d94eab2f95f570e99a24235"
Sep 14 13:06:35.131750 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.131563    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c9q7xz"
Sep 14 13:06:35.133784 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.133765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp"
Sep 14 13:06:35.133897 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.133792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d78fzmp" event={"ID":"49c24b55-7783-4a05-8fe7-20e0d9fb6511","Type":"ContainerDied","Data":"aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974"}
Sep 14 13:06:35.133897 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.133828    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aab53515c50f4d13217ebb4ab6290461fcb1f4b6afd760e2ec03ae0579658974"
Sep 14 13:06:35.135959 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.135937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x" event={"ID":"9d4363b9-cd5e-4bdf-82da-241b32997552","Type":"ContainerDied","Data":"3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f"}
Sep 14 13:06:35.136054 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.135970    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c652n2x"
Sep 14 13:06:35.136130 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:35.135975    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a9fb6bb913a8f834c7bc4c3ac17bcbd7848fc643b98fee1817704e267b3271f"
Sep 14 13:06:55.629356 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629268    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"]
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629597    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629609    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629618    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629623    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629629    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629635    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629641    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629647    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629657    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="pull"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629665    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="pull"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629682    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="extract"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629692    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629699    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="util"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629709    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="pull"
Sep 14 13:06:55.629721 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629716    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="pull"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629730    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="pull"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629740    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="pull"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629752    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="extract"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629760    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="extract"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629768    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="util"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629775    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="util"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629793    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="pull"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629801    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="pull"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629898    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c24b55-7783-4a05-8fe7-20e0d9fb6511" containerName="extract"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629913    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c21d7c3-47c6-4161-afc9-e36845f8de78" containerName="extract"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629924    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa03a234-046f-4179-a211-2f7cf67f2321" containerName="extract"
Sep 14 13:06:55.630320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.629930    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d4363b9-cd5e-4bdf-82da-241b32997552" containerName="extract"
Sep 14 13:06:55.632412 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.632395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.636260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.636238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 14 13:06:55.636382 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.636265    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 14 13:06:55.636382 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.636278    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 14 13:06:55.637258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.637216    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6xpqk\""
Sep 14 13:06:55.637258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.637238    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 14 13:06:55.655499 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.655458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"]
Sep 14 13:06:55.674968 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.674924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9202e18d-8fc6-4498-80d1-4300a80220a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.674968 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.674965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9202e18d-8fc6-4498-80d1-4300a80220a6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.675225 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.675091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88px\" (UniqueName: \"kubernetes.io/projected/9202e18d-8fc6-4498-80d1-4300a80220a6-kube-api-access-p88px\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.776340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.776303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p88px\" (UniqueName: \"kubernetes.io/projected/9202e18d-8fc6-4498-80d1-4300a80220a6-kube-api-access-p88px\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.776521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.776364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9202e18d-8fc6-4498-80d1-4300a80220a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.776521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.776448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9202e18d-8fc6-4498-80d1-4300a80220a6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.777184 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.777164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9202e18d-8fc6-4498-80d1-4300a80220a6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.778928 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.778906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9202e18d-8fc6-4498-80d1-4300a80220a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.786066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.786040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88px\" (UniqueName: \"kubernetes.io/projected/9202e18d-8fc6-4498-80d1-4300a80220a6-kube-api-access-p88px\") pod \"kuadrant-console-plugin-fbdd4f445-cd58v\" (UID: \"9202e18d-8fc6-4498-80d1-4300a80220a6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:55.942291 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:55.942170    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"
Sep 14 13:06:56.221963 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:56.221900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v"]
Sep 14 13:06:56.226107 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:06:56.226075    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9202e18d_8fc6_4498_80d1_4300a80220a6.slice/crio-b5fdb6efceee4b06ad1a1f924ab2d84745fb1679a79365ad44df0a763a02bb3d WatchSource:0}: Error finding container b5fdb6efceee4b06ad1a1f924ab2d84745fb1679a79365ad44df0a763a02bb3d: Status 404 returned error can't find the container with id b5fdb6efceee4b06ad1a1f924ab2d84745fb1679a79365ad44df0a763a02bb3d
Sep 14 13:06:56.243234 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:06:56.243193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v" event={"ID":"9202e18d-8fc6-4498-80d1-4300a80220a6","Type":"ContainerStarted","Data":"b5fdb6efceee4b06ad1a1f924ab2d84745fb1679a79365ad44df0a763a02bb3d"}
Sep 14 13:07:02.281782 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:02.281738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v" event={"ID":"9202e18d-8fc6-4498-80d1-4300a80220a6","Type":"ContainerStarted","Data":"9437c67e7bf103604c3b2a7e866eec09e7d3e6d70ebd3f4599c08539bbcaddd1"}
Sep 14 13:07:02.304892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:02.304831    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-cd58v" podStartSLOduration=2.038070908 podStartE2EDuration="7.304815553s" totalImagesPullingTime="5.266744645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:07:02.302423693 +0000 UTC m=+542.138932539" watchObservedRunningTime="2026-09-14 13:07:02.304815553 +0000 UTC m=+542.141324386"
Sep 14 13:07:49.383187 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.383128    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:07:49.403931 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.403899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.408950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.408928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 14 13:07:49.418747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.418717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:07:49.476215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.476177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:07:49.540262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.540224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8nb\" (UniqueName: \"kubernetes.io/projected/18bba769-84f8-4696-a69d-ce7e20a7d711-kube-api-access-xz8nb\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.540432 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.540301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18bba769-84f8-4696-a69d-ce7e20a7d711-config-file\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.641767 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.641674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8nb\" (UniqueName: \"kubernetes.io/projected/18bba769-84f8-4696-a69d-ce7e20a7d711-kube-api-access-xz8nb\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.641767 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.641757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18bba769-84f8-4696-a69d-ce7e20a7d711-config-file\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.642447 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.642427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/18bba769-84f8-4696-a69d-ce7e20a7d711-config-file\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.651708 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.651689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8nb\" (UniqueName: \"kubernetes.io/projected/18bba769-84f8-4696-a69d-ce7e20a7d711-kube-api-access-xz8nb\") pod \"limitador-limitador-84994f7ffc-tsrf8\" (UID: \"18bba769-84f8-4696-a69d-ce7e20a7d711\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.714556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.714523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:49.967122 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.967089    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:49.970796 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.970772    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:49.974503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.974478    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pgf4p\""
Sep 14 13:07:49.980905 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.980868    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:49.991214 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:49.991189    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:07:49.993113 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:07:49.993081    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bba769_84f8_4696_a69d_ce7e20a7d711.slice/crio-a4140752c7179afc5f74a5253bf654037d44683e5a96ac3cf0d8042ef0d4e64c WatchSource:0}: Error finding container a4140752c7179afc5f74a5253bf654037d44683e5a96ac3cf0d8042ef0d4e64c: Status 404 returned error can't find the container with id a4140752c7179afc5f74a5253bf654037d44683e5a96ac3cf0d8042ef0d4e64c
Sep 14 13:07:50.045925 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.045865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vwv\" (UniqueName: \"kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv\") pod \"authorino-7bcfd8f9cd-j2lbm\" (UID: \"c9a5dc8d-7ae6-40af-be71-0446c986a030\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:50.147218 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.147174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vwv\" (UniqueName: \"kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv\") pod \"authorino-7bcfd8f9cd-j2lbm\" (UID: \"c9a5dc8d-7ae6-40af-be71-0446c986a030\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:50.163811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.163778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vwv\" (UniqueName: \"kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv\") pod \"authorino-7bcfd8f9cd-j2lbm\" (UID: \"c9a5dc8d-7ae6-40af-be71-0446c986a030\") " pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:50.282055 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.281963    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:50.521772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.521733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8" event={"ID":"18bba769-84f8-4696-a69d-ce7e20a7d711","Type":"ContainerStarted","Data":"a4140752c7179afc5f74a5253bf654037d44683e5a96ac3cf0d8042ef0d4e64c"}
Sep 14 13:07:50.556431 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:50.556405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:50.558108 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:07:50.558079    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9a5dc8d_7ae6_40af_be71_0446c986a030.slice/crio-9c3d68a7da63e6fa7631e50d91dcefebecc2385ac59560f0313c1b12e96f986c WatchSource:0}: Error finding container 9c3d68a7da63e6fa7631e50d91dcefebecc2385ac59560f0313c1b12e96f986c: Status 404 returned error can't find the container with id 9c3d68a7da63e6fa7631e50d91dcefebecc2385ac59560f0313c1b12e96f986c
Sep 14 13:07:51.531795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:51.531757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" event={"ID":"c9a5dc8d-7ae6-40af-be71-0446c986a030","Type":"ContainerStarted","Data":"9c3d68a7da63e6fa7631e50d91dcefebecc2385ac59560f0313c1b12e96f986c"}
Sep 14 13:07:52.799268 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:52.799227    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:53.544575 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.544541    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" podUID="c9a5dc8d-7ae6-40af-be71-0446c986a030" containerName="authorino" containerID="cri-o://bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211" gracePeriod=30
Sep 14 13:07:53.544797 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.544546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" event={"ID":"c9a5dc8d-7ae6-40af-be71-0446c986a030","Type":"ContainerStarted","Data":"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"}
Sep 14 13:07:53.546222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.546193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8" event={"ID":"18bba769-84f8-4696-a69d-ce7e20a7d711","Type":"ContainerStarted","Data":"f75872f6dc40409139d491ac0cf6544a329ff7c4f72ac5014b5402d0ab14cbbc"}
Sep 14 13:07:53.546356 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.546342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:07:53.561052 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.561005    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" podStartSLOduration=2.159808873 podStartE2EDuration="4.560984775s" totalImagesPullingTime="2.401175902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:07:53.55956887 +0000 UTC m=+593.396077704" watchObservedRunningTime="2026-09-14 13:07:53.560984775 +0000 UTC m=+593.397493609"
Sep 14 13:07:53.577052 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.577004    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8" podStartSLOduration=1.6175365099999999 podStartE2EDuration="4.576988908s" totalImagesPullingTime="2.959452398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:07:53.575439923 +0000 UTC m=+593.411948759" watchObservedRunningTime="2026-09-14 13:07:53.576988908 +0000 UTC m=+593.413497742"
Sep 14 13:07:53.795082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.795020    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:53.880741 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.880702    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9vwv\" (UniqueName: \"kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv\") pod \"c9a5dc8d-7ae6-40af-be71-0446c986a030\" (UID: \"c9a5dc8d-7ae6-40af-be71-0446c986a030\") "
Sep 14 13:07:53.883014 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.882986    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv" (OuterVolumeSpecName: "kube-api-access-r9vwv") pod "c9a5dc8d-7ae6-40af-be71-0446c986a030" (UID: "c9a5dc8d-7ae6-40af-be71-0446c986a030"). InnerVolumeSpecName "kube-api-access-r9vwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:07:53.982249 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:53.982204    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9vwv\" (UniqueName: \"kubernetes.io/projected/c9a5dc8d-7ae6-40af-be71-0446c986a030-kube-api-access-r9vwv\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:07:54.552709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.552668    2559 generic.go:356] "Generic (PLEG): container finished" podID="c9a5dc8d-7ae6-40af-be71-0446c986a030" containerID="bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211" exitCode=0
Sep 14 13:07:54.552907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.552733    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm"
Sep 14 13:07:54.552907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.552758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" event={"ID":"c9a5dc8d-7ae6-40af-be71-0446c986a030","Type":"ContainerDied","Data":"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"}
Sep 14 13:07:54.552907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.552808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-j2lbm" event={"ID":"c9a5dc8d-7ae6-40af-be71-0446c986a030","Type":"ContainerDied","Data":"9c3d68a7da63e6fa7631e50d91dcefebecc2385ac59560f0313c1b12e96f986c"}
Sep 14 13:07:54.552907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.552826    2559 scope.go:117] "RemoveContainer" containerID="bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"
Sep 14 13:07:54.564656 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.563929    2559 scope.go:117] "RemoveContainer" containerID="bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"
Sep 14 13:07:54.565140 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:07:54.565109    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211\": container with ID starting with bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211 not found: ID does not exist" containerID="bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"
Sep 14 13:07:54.565251 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.565149    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211"} err="failed to get container status \"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211\": rpc error: code = NotFound desc = could not find container \"bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211\": container with ID starting with bf073f7c427f33ef5df3fc94f12d7a6ce4d9ec94207193dc8f06ca9e56cbd211 not found: ID does not exist"
Sep 14 13:07:54.592709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.592681    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:54.596913 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.596864    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-j2lbm"]
Sep 14 13:07:54.683541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:07:54.683510    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9a5dc8d-7ae6-40af-be71-0446c986a030" path="/var/lib/kubelet/pods/c9a5dc8d-7ae6-40af-be71-0446c986a030/volumes"
Sep 14 13:08:00.619830 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:00.619796    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:08:00.621296 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:00.621270    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:08:04.554274 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:04.554236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"
Sep 14 13:08:21.478357 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.478319    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-rz7p7"]
Sep 14 13:08:21.478828 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.478665    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9a5dc8d-7ae6-40af-be71-0446c986a030" containerName="authorino"
Sep 14 13:08:21.478828 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.478676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9a5dc8d-7ae6-40af-be71-0446c986a030" containerName="authorino"
Sep 14 13:08:21.478828 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.478746    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9a5dc8d-7ae6-40af-be71-0446c986a030" containerName="authorino"
Sep 14 13:08:21.483067 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.483048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.485827 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.485785    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pgf4p\""
Sep 14 13:08:21.491943 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.491890    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-rz7p7"]
Sep 14 13:08:21.518158 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.518119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h\") pod \"authorino-557f876f69-rz7p7\" (UID: \"9d0d35ea-68fb-454e-967d-1661569e90e1\") " pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.608486 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.608449    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rz7p7"]
Sep 14 13:08:21.608725 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:08:21.608706    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k5z5h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-rz7p7" podUID="9d0d35ea-68fb-454e-967d-1661569e90e1"
Sep 14 13:08:21.619517 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.619483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h\") pod \"authorino-557f876f69-rz7p7\" (UID: \"9d0d35ea-68fb-454e-967d-1661569e90e1\") " pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.629192 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.629164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h\") pod \"authorino-557f876f69-rz7p7\" (UID: \"9d0d35ea-68fb-454e-967d-1661569e90e1\") " pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.633547 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.633519    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-66grw"]
Sep 14 13:08:21.636844 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.636822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.639438 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.639416    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 14 13:08:21.646092 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.646070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-66grw"]
Sep 14 13:08:21.696544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.696513    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.703452 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.703426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:21.720129 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.720093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.720284 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.720140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rrg\" (UniqueName: \"kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.739450 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.739374    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-66grw"]
Sep 14 13:08:21.739622 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:08:21.739605    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c9rrg tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-66grw" podUID="6434f942-5cdb-4304-a264-3f4c008c0cb8"
Sep 14 13:08:21.820696 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.820653    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h\") pod \"9d0d35ea-68fb-454e-967d-1661569e90e1\" (UID: \"9d0d35ea-68fb-454e-967d-1661569e90e1\") "
Sep 14 13:08:21.820920 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.820776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.820920 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.820815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rrg\" (UniqueName: \"kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.822803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.822763    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h" (OuterVolumeSpecName: "kube-api-access-k5z5h") pod "9d0d35ea-68fb-454e-967d-1661569e90e1" (UID: "9d0d35ea-68fb-454e-967d-1661569e90e1"). InnerVolumeSpecName "kube-api-access-k5z5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:08:21.823178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.823160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.831156 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.831129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rrg\" (UniqueName: \"kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg\") pod \"authorino-6d4dfc649f-66grw\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") " pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:21.921466 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:21.921434    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/9d0d35ea-68fb-454e-967d-1661569e90e1-kube-api-access-k5z5h\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:08:22.702275 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.702249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rz7p7"
Sep 14 13:08:22.702602 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.702249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:22.710390 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.710368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:22.747729 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.747696    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rz7p7"]
Sep 14 13:08:22.754203 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.752428    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-rz7p7"]
Sep 14 13:08:22.826825 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.826788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9rrg\" (UniqueName: \"kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg\") pod \"6434f942-5cdb-4304-a264-3f4c008c0cb8\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") "
Sep 14 13:08:22.827025 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.826852    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert\") pod \"6434f942-5cdb-4304-a264-3f4c008c0cb8\" (UID: \"6434f942-5cdb-4304-a264-3f4c008c0cb8\") "
Sep 14 13:08:22.828865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.828822    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6434f942-5cdb-4304-a264-3f4c008c0cb8" (UID: "6434f942-5cdb-4304-a264-3f4c008c0cb8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:08:22.828988 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.828865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg" (OuterVolumeSpecName: "kube-api-access-c9rrg") pod "6434f942-5cdb-4304-a264-3f4c008c0cb8" (UID: "6434f942-5cdb-4304-a264-3f4c008c0cb8"). InnerVolumeSpecName "kube-api-access-c9rrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:08:22.927519 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.927487    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9rrg\" (UniqueName: \"kubernetes.io/projected/6434f942-5cdb-4304-a264-3f4c008c0cb8-kube-api-access-c9rrg\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:08:22.927519 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:22.927517    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6434f942-5cdb-4304-a264-3f4c008c0cb8-tls-cert\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:08:23.707435 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:23.707400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-66grw"
Sep 14 13:08:23.737841 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:23.737806    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-66grw"]
Sep 14 13:08:23.741935 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:23.741902    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-66grw"]
Sep 14 13:08:24.682285 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:24.682242    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6434f942-5cdb-4304-a264-3f4c008c0cb8" path="/var/lib/kubelet/pods/6434f942-5cdb-4304-a264-3f4c008c0cb8/volumes"
Sep 14 13:08:24.682569 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:08:24.682550    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0d35ea-68fb-454e-967d-1661569e90e1" path="/var/lib/kubelet/pods/9d0d35ea-68fb-454e-967d-1661569e90e1/volumes"
Sep 14 13:09:03.182120 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:03.182083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:09:36.985174 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:36.985137    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:09:51.395743 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.395707    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"]
Sep 14 13:09:51.399368 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.399350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.403393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.403365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 14 13:09:51.403525 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.403439    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 13:09:51.403525 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.403491    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 13:09:51.403632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.403535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d5kw4\""
Sep 14 13:09:51.404472 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.404452    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"]
Sep 14 13:09:51.495715 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdd7\" (UniqueName: \"kubernetes.io/projected/16e97275-e674-4db3-8cbe-a05ac27f7701-kube-api-access-ttdd7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.495896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.495896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.495896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.495896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.496065 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.495902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e97275-e674-4db3-8cbe-a05ac27f7701-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597277 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597277 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e97275-e674-4db3-8cbe-a05ac27f7701-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdd7\" (UniqueName: \"kubernetes.io/projected/16e97275-e674-4db3-8cbe-a05ac27f7701-kube-api-access-ttdd7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597729 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597729 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.597865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.597770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.599562 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.599540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e97275-e674-4db3-8cbe-a05ac27f7701-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.599835 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.599817    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e97275-e674-4db3-8cbe-a05ac27f7701-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.606066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.606048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdd7\" (UniqueName: \"kubernetes.io/projected/16e97275-e674-4db3-8cbe-a05ac27f7701-kube-api-access-ttdd7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gw9nb\" (UID: \"16e97275-e674-4db3-8cbe-a05ac27f7701\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.713128 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.713097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:09:51.987855 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.987830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"]
Sep 14 13:09:51.988806 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:09:51.988781    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e97275_e674_4db3_8cbe_a05ac27f7701.slice/crio-226fca68ab7fc50a78e644bd4e955983513fe62a75f36f8ec1c541a71f8be7e1 WatchSource:0}: Error finding container 226fca68ab7fc50a78e644bd4e955983513fe62a75f36f8ec1c541a71f8be7e1: Status 404 returned error can't find the container with id 226fca68ab7fc50a78e644bd4e955983513fe62a75f36f8ec1c541a71f8be7e1
Sep 14 13:09:51.993138 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:51.993110    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:09:52.157478 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:52.157436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb" event={"ID":"16e97275-e674-4db3-8cbe-a05ac27f7701","Type":"ContainerStarted","Data":"226fca68ab7fc50a78e644bd4e955983513fe62a75f36f8ec1c541a71f8be7e1"}
Sep 14 13:09:52.186406 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:52.186376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:09:53.164284 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:53.164246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb" event={"ID":"16e97275-e674-4db3-8cbe-a05ac27f7701","Type":"ContainerStarted","Data":"207ded8fd2448a15f49d21715bef37423a7816f39fe9d7b42b645002f22b0282"}
Sep 14 13:09:53.181690 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:09:53.181636    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb" podStartSLOduration=1.155532901 podStartE2EDuration="2.181605331s" totalImagesPullingTime="1.02607243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:09:53.180870549 +0000 UTC m=+713.017379383" watchObservedRunningTime="2026-09-14 13:09:53.181605331 +0000 UTC m=+713.018114200"
Sep 14 13:10:01.714233 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:01.714187    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:10:01.714629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:01.714256    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:10:01.726418 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:01.726392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:10:02.222109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:02.222081    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gw9nb"
Sep 14 13:10:04.435743 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:04.435709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:10:13.683400 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.683355    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"]
Sep 14 13:10:13.689865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.689845    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.693014 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.692991    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 14 13:10:13.698846 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.698818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"]
Sep 14 13:10:13.790178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4vpb\" (UniqueName: \"kubernetes.io/projected/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-kube-api-access-w4vpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.790341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.790341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.790341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.790453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.790453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.790363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891722 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4vpb\" (UniqueName: \"kubernetes.io/projected/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-kube-api-access-w4vpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891722 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.891935 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.891860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.892192 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.892166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.892285 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.892187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.892285 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.892232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.893833 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.893805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.893955 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.893898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:13.900971 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:13.900944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4vpb\" (UniqueName: \"kubernetes.io/projected/3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9-kube-api-access-w4vpb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tw2pc\" (UID: \"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:14.001183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:14.001145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:14.275281 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:14.275257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"]
Sep 14 13:10:14.277359 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:10:14.277331    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db84b7a_2e7c_496e_9bdf_5a2a8e6d59e9.slice/crio-80c8e96456802b980f892038816b7fedb9dd8464e498008b8b02dc843ed193a8 WatchSource:0}: Error finding container 80c8e96456802b980f892038816b7fedb9dd8464e498008b8b02dc843ed193a8: Status 404 returned error can't find the container with id 80c8e96456802b980f892038816b7fedb9dd8464e498008b8b02dc843ed193a8
Sep 14 13:10:15.000920 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:15.000866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:10:15.279471 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:15.279386    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc" event={"ID":"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9","Type":"ContainerStarted","Data":"c3c75b7f1bb0763954ae8513c9b115d0a504c0a9850ac869c789b0f22da20092"}
Sep 14 13:10:15.279471 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:15.279437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc" event={"ID":"3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9","Type":"ContainerStarted","Data":"80c8e96456802b980f892038816b7fedb9dd8464e498008b8b02dc843ed193a8"}
Sep 14 13:10:15.305539 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:15.305489    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc" podStartSLOduration=2.077422191 podStartE2EDuration="2.305476239s" totalImagesPullingTime="228.054048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:10:15.304683884 +0000 UTC m=+735.141192723" watchObservedRunningTime="2026-09-14 13:10:15.305476239 +0000 UTC m=+735.141985064"
Sep 14 13:10:24.001816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:24.001768    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:24.002240 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:24.001868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:24.014305 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:24.014275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:24.336193 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:24.336107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tw2pc"
Sep 14 13:10:29.689682 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:29.689644    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:10:40.569960 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.569929    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"]
Sep 14 13:10:40.573607 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.573588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.576381 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.576363    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 14 13:10:40.585539 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.585515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"]
Sep 14 13:10:40.728170 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lr8\" (UniqueName: \"kubernetes.io/projected/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-kube-api-access-82lr8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.728360 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.728360 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.728360 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.728360 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.728536 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.728393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829220 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829220 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829439 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829439 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829439 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829439 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lr8\" (UniqueName: \"kubernetes.io/projected/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-kube-api-access-82lr8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829653 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829712 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.829931 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.829913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.831577 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.831555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.831958 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.831933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.838352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.838332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lr8\" (UniqueName: \"kubernetes.io/projected/66f29da5-06dc-49c6-b07f-d4fcb0a3d362-kube-api-access-82lr8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lhxpw\" (UID: \"66f29da5-06dc-49c6-b07f-d4fcb0a3d362\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:40.887689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:40.887656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:41.159495 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:41.159469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"]
Sep 14 13:10:41.161192 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:10:41.161165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f29da5_06dc_49c6_b07f_d4fcb0a3d362.slice/crio-03ce0cfe69fcc87b412252b1d02ff3a6af90d0569a3ad1abca223f7092d5088f WatchSource:0}: Error finding container 03ce0cfe69fcc87b412252b1d02ff3a6af90d0569a3ad1abca223f7092d5088f: Status 404 returned error can't find the container with id 03ce0cfe69fcc87b412252b1d02ff3a6af90d0569a3ad1abca223f7092d5088f
Sep 14 13:10:41.416161 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:41.416100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw" event={"ID":"66f29da5-06dc-49c6-b07f-d4fcb0a3d362","Type":"ContainerStarted","Data":"0c7ef1533613da467f4067f194fd07b5a4cb86521be8e40dcd921b0c2673ad36"}
Sep 14 13:10:41.416266 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:41.416161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw" event={"ID":"66f29da5-06dc-49c6-b07f-d4fcb0a3d362","Type":"ContainerStarted","Data":"03ce0cfe69fcc87b412252b1d02ff3a6af90d0569a3ad1abca223f7092d5088f"}
Sep 14 13:10:41.435121 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:41.435079    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw" podStartSLOduration=1.249035773 podStartE2EDuration="1.435063847s" totalImagesPullingTime="186.028074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:10:41.433977401 +0000 UTC m=+761.270486236" watchObservedRunningTime="2026-09-14 13:10:41.435063847 +0000 UTC m=+761.271572686"
Sep 14 13:10:42.385038 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:42.385006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:10:50.888591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:50.888549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:50.889110 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:50.888639    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:50.900965 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:50.900938    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:10:51.479157 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:10:51.479131    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lhxpw"
Sep 14 13:11:09.692237 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.692205    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"]
Sep 14 13:11:09.695658 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.695641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.698861 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.698836    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 14 13:11:09.705279 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.705255    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"]
Sep 14 13:11:09.771302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.771302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.771580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98hq\" (UniqueName: \"kubernetes.io/projected/64eb2f17-6155-47a6-b1f8-e5e6ae338add-kube-api-access-n98hq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.771580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.771580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.771580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.771504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.872622 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.872804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.872804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98hq\" (UniqueName: \"kubernetes.io/projected/64eb2f17-6155-47a6-b1f8-e5e6ae338add-kube-api-access-n98hq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.872804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.872804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.873059 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.872859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.873059 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.873029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.873136 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.873079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.873209 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.873191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.874985 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.874963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eb2f17-6155-47a6-b1f8-e5e6ae338add-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.875261 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.875245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eb2f17-6155-47a6-b1f8-e5e6ae338add-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:09.881789 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:09.881767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98hq\" (UniqueName: \"kubernetes.io/projected/64eb2f17-6155-47a6-b1f8-e5e6ae338add-kube-api-access-n98hq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm\" (UID: \"64eb2f17-6155-47a6-b1f8-e5e6ae338add\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:10.005322 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:10.005270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:10.285112 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:10.285088    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"]
Sep 14 13:11:10.287211 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:11:10.287184    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64eb2f17_6155_47a6_b1f8_e5e6ae338add.slice/crio-c31152ece136e3d65c3c808683bcad149a11169bbb754c7a8e67c075f17341b1 WatchSource:0}: Error finding container c31152ece136e3d65c3c808683bcad149a11169bbb754c7a8e67c075f17341b1: Status 404 returned error can't find the container with id c31152ece136e3d65c3c808683bcad149a11169bbb754c7a8e67c075f17341b1
Sep 14 13:11:10.565050 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:10.565019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm" event={"ID":"64eb2f17-6155-47a6-b1f8-e5e6ae338add","Type":"ContainerStarted","Data":"c31152ece136e3d65c3c808683bcad149a11169bbb754c7a8e67c075f17341b1"}
Sep 14 13:11:11.571740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:11.571705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm" event={"ID":"64eb2f17-6155-47a6-b1f8-e5e6ae338add","Type":"ContainerStarted","Data":"986db221de8e089d0ba5e7c0c4326a57906cf1acb450e1cca58484a3c830f2f2"}
Sep 14 13:11:11.589641 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:11.589589    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm" podStartSLOduration=2.333489038 podStartE2EDuration="2.5895717s" totalImagesPullingTime="256.082662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:11:11.588957125 +0000 UTC m=+791.425465959" watchObservedRunningTime="2026-09-14 13:11:11.5895717 +0000 UTC m=+791.426080533"
Sep 14 13:11:12.083433 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:12.083388    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:11:20.006196 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:20.006163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:20.006196 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:20.006206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:20.018973 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:20.018942    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:11:20.629712 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:11:20.629677    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm"
Sep 14 13:12:22.057017 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.056979    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7899-862e13"]
Sep 14 13:12:22.060518 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.060498    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:22.063211 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.063185    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sh8vw\""
Sep 14 13:12:22.070745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.070719    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7899-862e13"]
Sep 14 13:12:22.099228 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.099194    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:12:22.120928 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.120863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8sgj\" (UniqueName: \"kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj\") pod \"test-curl-7899-862e13\" (UID: \"746f031b-5c46-453e-b701-cd4ea0ab2f90\") " pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:22.222232 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.222192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8sgj\" (UniqueName: \"kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj\") pod \"test-curl-7899-862e13\" (UID: \"746f031b-5c46-453e-b701-cd4ea0ab2f90\") " pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:22.234430 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.234397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8sgj\" (UniqueName: \"kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj\") pod \"test-curl-7899-862e13\" (UID: \"746f031b-5c46-453e-b701-cd4ea0ab2f90\") " pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:22.371401 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.371304    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:22.644506 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.644477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7899-862e13"]
Sep 14 13:12:22.646288 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:12:22.646251    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod746f031b_5c46_453e_b701_cd4ea0ab2f90.slice/crio-e86648657882d160bc1347ca8460a0711fce4e0f137e28cd5904b8f345cc63c4 WatchSource:0}: Error finding container e86648657882d160bc1347ca8460a0711fce4e0f137e28cd5904b8f345cc63c4: Status 404 returned error can't find the container with id e86648657882d160bc1347ca8460a0711fce4e0f137e28cd5904b8f345cc63c4
Sep 14 13:12:22.942033 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:22.941942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7899-862e13" event={"ID":"746f031b-5c46-453e-b701-cd4ea0ab2f90","Type":"ContainerStarted","Data":"e86648657882d160bc1347ca8460a0711fce4e0f137e28cd5904b8f345cc63c4"}
Sep 14 13:12:26.968493 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:26.968458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7899-862e13" event={"ID":"746f031b-5c46-453e-b701-cd4ea0ab2f90","Type":"ContainerStarted","Data":"3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e"}
Sep 14 13:12:26.987741 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:26.987691    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7899-862e13" podStartSLOduration=1.411149064 podStartE2EDuration="4.987674694s" totalImagesPullingTime="3.57652563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:26.985231007 +0000 UTC m=+866.821739842" watchObservedRunningTime="2026-09-14 13:12:26.987674694 +0000 UTC m=+866.824183527"
Sep 14 13:12:27.680128 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.680042    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7899-862e13"]
Sep 14 13:12:27.686686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.686640    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7899-862e13"]
Sep 14 13:12:27.820770 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.820728    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7899-577b42"]
Sep 14 13:12:27.821145 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.821131    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" containerName="test-curl-7899-862e13"
Sep 14 13:12:27.821197 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.821147    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" containerName="test-curl-7899-862e13"
Sep 14 13:12:27.821238 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.821225    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" containerName="test-curl-7899-862e13"
Sep 14 13:12:27.824416 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.824399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:27.833975 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.833943    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7899-577b42"]
Sep 14 13:12:27.864208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.864171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6592\" (UniqueName: \"kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592\") pod \"test-curl-7899-577b42\" (UID: \"4af32628-b63d-4a96-8331-3cce77506544\") " pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:27.965659 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.965621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6592\" (UniqueName: \"kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592\") pod \"test-curl-7899-577b42\" (UID: \"4af32628-b63d-4a96-8331-3cce77506544\") " pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:27.974977 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:27.974940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6592\" (UniqueName: \"kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592\") pod \"test-curl-7899-577b42\" (UID: \"4af32628-b63d-4a96-8331-3cce77506544\") " pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:27.975301 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:27.975202    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7899-862e13" container="test-curl-7899-862e13"
Sep 14 13:12:28.134256 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:28.134216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:28.430744 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:28.430712    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7899-577b42"]
Sep 14 13:12:28.433056 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:12:28.433026    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4af32628_b63d_4a96_8331_3cce77506544.slice/crio-3833593fe0e73a0e7baf332ef5350ca9a7c081832880fbfeda7c0d1b30721fa5 WatchSource:0}: Error finding container 3833593fe0e73a0e7baf332ef5350ca9a7c081832880fbfeda7c0d1b30721fa5: Status 404 returned error can't find the container with id 3833593fe0e73a0e7baf332ef5350ca9a7c081832880fbfeda7c0d1b30721fa5
Sep 14 13:12:28.981490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:28.981449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7899-577b42" event={"ID":"4af32628-b63d-4a96-8331-3cce77506544","Type":"ContainerStarted","Data":"a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3"}
Sep 14 13:12:28.981490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:28.981498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7899-577b42" event={"ID":"4af32628-b63d-4a96-8331-3cce77506544","Type":"ContainerStarted","Data":"3833593fe0e73a0e7baf332ef5350ca9a7c081832880fbfeda7c0d1b30721fa5"}
Sep 14 13:12:28.982015 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:28.981521    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7899-862e13" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" containerName="test-curl-7899-862e13" containerID="cri-o://3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e" gracePeriod=2
Sep 14 13:12:29.009827 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:29.009772    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7899-577b42" podStartSLOduration=2.009755003 podStartE2EDuration="2.009755003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:29.008802179 +0000 UTC m=+868.845311012" watchObservedRunningTime="2026-09-14 13:12:29.009755003 +0000 UTC m=+868.846263837"
Sep 14 13:12:29.701118 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:29.701033    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7899-577b42"]
Sep 14 13:12:29.703770 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:29.703738    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7899-577b42"]
Sep 14 13:12:29.987203 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:29.987165    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7899-577b42" container="test-curl-7899-577b42"
Sep 14 13:12:30.993201 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:30.993168    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7899-577b42" podUID="4af32628-b63d-4a96-8331-3cce77506544" containerName="test-curl-7899-577b42" containerID="cri-o://a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3" gracePeriod=2
Sep 14 13:12:31.134437 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:31.134405    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:31.194484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:31.194443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8sgj\" (UniqueName: \"kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj\") pod \"746f031b-5c46-453e-b701-cd4ea0ab2f90\" (UID: \"746f031b-5c46-453e-b701-cd4ea0ab2f90\") "
Sep 14 13:12:31.196674 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:31.196649    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj" (OuterVolumeSpecName: "kube-api-access-w8sgj") pod "746f031b-5c46-453e-b701-cd4ea0ab2f90" (UID: "746f031b-5c46-453e-b701-cd4ea0ab2f90"). InnerVolumeSpecName "kube-api-access-w8sgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:12:31.295330 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:31.295250    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8sgj\" (UniqueName: \"kubernetes.io/projected/746f031b-5c46-453e-b701-cd4ea0ab2f90-kube-api-access-w8sgj\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:12:32.000697 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.000662    2559 generic.go:356] "Generic (PLEG): container finished" podID="746f031b-5c46-453e-b701-cd4ea0ab2f90" containerID="3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e" exitCode=137
Sep 14 13:12:32.000697 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.000702    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:32.001203 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.000726    2559 scope.go:117] "RemoveContainer" containerID="3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e"
Sep 14 13:12:32.010293 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.010273    2559 scope.go:117] "RemoveContainer" containerID="3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e"
Sep 14 13:12:32.010585 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:32.010565    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e\": container with ID starting with 3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e not found: ID does not exist" containerID="3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e"
Sep 14 13:12:32.010661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.010599    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e"} err="failed to get container status \"3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e\": rpc error: code = NotFound desc = could not find container \"3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e\": container with ID starting with 3854932a386abf07d0d9d6cd36c75701b06d05991e126715534211f43d441a7e not found: ID does not exist"
Sep 14 13:12:32.011503 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:32.011476    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7899-862e13\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" pod="opendatahub/test-curl-7899-862e13"
Sep 14 13:12:32.192333 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.192298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:12:32.683497 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:32.683466    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="746f031b-5c46-453e-b701-cd4ea0ab2f90" path="/var/lib/kubelet/pods/746f031b-5c46-453e-b701-cd4ea0ab2f90/volumes"
Sep 14 13:12:33.190871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:33.190839    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:33.214487 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:33.214454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6592\" (UniqueName: \"kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592\") pod \"4af32628-b63d-4a96-8331-3cce77506544\" (UID: \"4af32628-b63d-4a96-8331-3cce77506544\") "
Sep 14 13:12:33.216527 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:33.216499    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592" (OuterVolumeSpecName: "kube-api-access-b6592") pod "4af32628-b63d-4a96-8331-3cce77506544" (UID: "4af32628-b63d-4a96-8331-3cce77506544"). InnerVolumeSpecName "kube-api-access-b6592". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:12:33.316123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:33.316031    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6592\" (UniqueName: \"kubernetes.io/projected/4af32628-b63d-4a96-8331-3cce77506544-kube-api-access-b6592\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:12:34.014848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.014814    2559 generic.go:356] "Generic (PLEG): container finished" podID="4af32628-b63d-4a96-8331-3cce77506544" containerID="a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3" exitCode=137
Sep 14 13:12:34.014848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.014854    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:34.015109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.014921    2559 scope.go:117] "RemoveContainer" containerID="a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3"
Sep 14 13:12:34.024014 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.023995    2559 scope.go:117] "RemoveContainer" containerID="a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3"
Sep 14 13:12:34.024328 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:34.024309    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3\": container with ID starting with a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3 not found: ID does not exist" containerID="a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3"
Sep 14 13:12:34.024381 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.024339    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3"} err="failed to get container status \"a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3\": rpc error: code = NotFound desc = could not find container \"a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3\": container with ID starting with a99d3f990dd5f4e3e5ff872990186b804f4031cb72bd6b8c5ec209968aa092b3 not found: ID does not exist"
Sep 14 13:12:34.025353 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:34.025333    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7899-577b42\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="4af32628-b63d-4a96-8331-3cce77506544" pod="opendatahub/test-curl-7899-577b42"
Sep 14 13:12:34.683195 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:34.683161    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af32628-b63d-4a96-8331-3cce77506544" path="/var/lib/kubelet/pods/4af32628-b63d-4a96-8331-3cce77506544/volumes"
Sep 14 13:12:37.828824 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.828789    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:12:37.829299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.829251    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af32628-b63d-4a96-8331-3cce77506544" containerName="test-curl-7899-577b42"
Sep 14 13:12:37.829299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.829272    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af32628-b63d-4a96-8331-3cce77506544" containerName="test-curl-7899-577b42"
Sep 14 13:12:37.829423 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.829393    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af32628-b63d-4a96-8331-3cce77506544" containerName="test-curl-7899-577b42"
Sep 14 13:12:37.833871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.833844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:37.837141 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.837113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-f96382-serving-cert\""
Sep 14 13:12:37.837294 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.837116    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 14 13:12:37.837294 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.837256    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:12:37.838686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.838668    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 13:12:37.838809 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.838734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p2mv8\""
Sep 14 13:12:37.844934 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.844910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:12:37.959964 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.959928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:37.960166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.959996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:37.960166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.960025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:37.960166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:37.960069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s9s2\" (UniqueName: \"kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.060905 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.060825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.061095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.060937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.061095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.060970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.061095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.061025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s9s2\" (UniqueName: \"kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.061287 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:38.061087    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-f96382-serving-cert: secret "maas-api-e2e-autores-f96382-serving-cert" not found
Sep 14 13:12:38.061287 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:38.061159    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls podName:91cf4220-3ebf-4535-9ab4-bf0cf77684cc nodeName:}" failed. No retries permitted until 2026-09-14 13:12:38.561142561 +0000 UTC m=+878.397651373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls") pod "maas-api-e2e-autores-f96382-58c5d65f5-6skhh" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc") : secret "maas-api-e2e-autores-f96382-serving-cert" not found
Sep 14 13:12:38.061709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.061682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.063469 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.063447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.073244 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.073213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s9s2\" (UniqueName: \"kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.565713 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:38.565674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:38.565886 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:38.565834    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-f96382-serving-cert: secret "maas-api-e2e-autores-f96382-serving-cert" not found
Sep 14 13:12:38.565952 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:38.565918    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls podName:91cf4220-3ebf-4535-9ab4-bf0cf77684cc nodeName:}" failed. No retries permitted until 2026-09-14 13:12:39.565902743 +0000 UTC m=+879.402411559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls") pod "maas-api-e2e-autores-f96382-58c5d65f5-6skhh" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc") : secret "maas-api-e2e-autores-f96382-serving-cert" not found
Sep 14 13:12:39.573980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:39.573938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:39.576403 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:39.576379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"maas-api-e2e-autores-f96382-58c5d65f5-6skhh\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:39.645546 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:39.645490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:39.932674 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:39.932651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:12:39.934770 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:12:39.934744    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cf4220_3ebf_4535_9ab4_bf0cf77684cc.slice/crio-7f5a261f3f0cb0db6e2d858c298064390c774ce29feed9ce4e576d46d1c571f2 WatchSource:0}: Error finding container 7f5a261f3f0cb0db6e2d858c298064390c774ce29feed9ce4e576d46d1c571f2: Status 404 returned error can't find the container with id 7f5a261f3f0cb0db6e2d858c298064390c774ce29feed9ce4e576d46d1c571f2
Sep 14 13:12:40.049808 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:40.049775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" event={"ID":"91cf4220-3ebf-4535-9ab4-bf0cf77684cc","Type":"ContainerStarted","Data":"7f5a261f3f0cb0db6e2d858c298064390c774ce29feed9ce4e576d46d1c571f2"}
Sep 14 13:12:41.206580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.206543    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:12:41.211445 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.211405    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.216376 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.216288    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c893c447-serving-cert\""
Sep 14 13:12:41.231190 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.231151    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:12:41.289796 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.289760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.289973 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.289918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbnf7\" (UniqueName: \"kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.290019 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.289973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.290128 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.290089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.390759 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.390712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbnf7\" (UniqueName: \"kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.390759 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.390765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.391030 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.390852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.391030 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.390913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.391144 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:41.391057    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-serving-cert: secret "maas-api-e2e-ait-c893c447-serving-cert" not found
Sep 14 13:12:41.391144 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:12:41.391120    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls podName:5860e61d-126b-4324-b28e-e9f76eb047ac nodeName:}" failed. No retries permitted until 2026-09-14 13:12:41.891100456 +0000 UTC m=+881.727609269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls") pod "maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" (UID: "5860e61d-126b-4324-b28e-e9f76eb047ac") : secret "maas-api-e2e-ait-c893c447-serving-cert" not found
Sep 14 13:12:41.391702 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.391675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.393737 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.393715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.400636 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.400612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbnf7\" (UniqueName: \"kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.896351 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.896313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:41.898911 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:41.898886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") pod \"maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:42.127692 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:42.127657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:42.630227 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:42.630200    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:12:42.631644 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:12:42.631609    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5860e61d_126b_4324_b28e_e9f76eb047ac.slice/crio-dc0697d4da1c95882fd25d1965c64789b2ff9b4745f14616d5ee690d6cb52d57 WatchSource:0}: Error finding container dc0697d4da1c95882fd25d1965c64789b2ff9b4745f14616d5ee690d6cb52d57: Status 404 returned error can't find the container with id dc0697d4da1c95882fd25d1965c64789b2ff9b4745f14616d5ee690d6cb52d57
Sep 14 13:12:43.076332 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:43.076296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" event={"ID":"91cf4220-3ebf-4535-9ab4-bf0cf77684cc","Type":"ContainerStarted","Data":"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"}
Sep 14 13:12:43.076528 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:43.076506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:43.077644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:43.077618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" event={"ID":"5860e61d-126b-4324-b28e-e9f76eb047ac","Type":"ContainerStarted","Data":"dc0697d4da1c95882fd25d1965c64789b2ff9b4745f14616d5ee690d6cb52d57"}
Sep 14 13:12:43.098227 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:43.098163    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" podStartSLOduration=3.617613134 podStartE2EDuration="6.098139887s" totalImagesPullingTime="2.480526753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:43.097290131 +0000 UTC m=+882.933798965" watchObservedRunningTime="2026-09-14 13:12:43.098139887 +0000 UTC m=+882.934648720"
Sep 14 13:12:44.085242 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:44.085197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" event={"ID":"5860e61d-126b-4324-b28e-e9f76eb047ac","Type":"ContainerStarted","Data":"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"}
Sep 14 13:12:44.085657 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:44.085530    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:44.105585 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:44.105529    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" podStartSLOduration=2.700827581 podStartE2EDuration="3.105514257s" totalImagesPullingTime="404.686676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:44.10337073 +0000 UTC m=+883.939879576" watchObservedRunningTime="2026-09-14 13:12:44.105514257 +0000 UTC m=+883.942023092"
Sep 14 13:12:47.949941 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:47.947774    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:12:47.954647 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:47.954618    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:47.957630 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:47.957602    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-809356-serving-cert\""
Sep 14 13:12:47.959518 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:47.959481    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:12:48.057954 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.057914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.058167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.057995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcw4z\" (UniqueName: \"kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.058167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.058122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.058263 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.058177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.159262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.159224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcw4z\" (UniqueName: \"kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.159453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.159329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.159453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.159366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.159622 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.159499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.160059 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.160036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.161822 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.161799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.161983 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.161959    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.169140 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.169117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcw4z\" (UniqueName: \"kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z\") pod \"maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.290338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.290297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:48.568727 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:48.568700    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:12:48.569972 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:12:48.569943    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865c4e3f_5152_4dc9_b573_6c4832c88e89.slice/crio-1284fdfddda830c7a55145bbb1f7596fe854d81b4b8f9877e2571b09c8652436 WatchSource:0}: Error finding container 1284fdfddda830c7a55145bbb1f7596fe854d81b4b8f9877e2571b09c8652436: Status 404 returned error can't find the container with id 1284fdfddda830c7a55145bbb1f7596fe854d81b4b8f9877e2571b09c8652436
Sep 14 13:12:49.091305 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:49.091268    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:12:49.115458 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:49.115422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" event={"ID":"865c4e3f-5152-4dc9-b573-6c4832c88e89","Type":"ContainerStarted","Data":"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"}
Sep 14 13:12:49.115642 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:49.115480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" event={"ID":"865c4e3f-5152-4dc9-b573-6c4832c88e89","Type":"ContainerStarted","Data":"1284fdfddda830c7a55145bbb1f7596fe854d81b4b8f9877e2571b09c8652436"}
Sep 14 13:12:49.115642 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:49.115506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:12:49.146838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:49.146724    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" podStartSLOduration=1.832850976 podStartE2EDuration="2.146704118s" totalImagesPullingTime="313.853142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:12:49.145861309 +0000 UTC m=+888.982370168" watchObservedRunningTime="2026-09-14 13:12:49.146704118 +0000 UTC m=+888.983212952"
Sep 14 13:12:50.096386 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:50.096350    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:12:55.127255 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:12:55.127174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:13:00.085246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:00.085205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:13:00.660434 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:00.660407    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:13:00.660640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:00.660415    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:13:07.504080 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.504047    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:13:07.504488 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.504256    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" podUID="5860e61d-126b-4324-b28e-e9f76eb047ac" containerName="maas-api" containerID="cri-o://c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01" gracePeriod=30
Sep 14 13:13:07.756635 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.756573    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:13:07.845527 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.845491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") pod \"5860e61d-126b-4324-b28e-e9f76eb047ac\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") "
Sep 14 13:13:07.845710 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.845571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs\") pod \"5860e61d-126b-4324-b28e-e9f76eb047ac\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") "
Sep 14 13:13:07.845710 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.845593    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca\") pod \"5860e61d-126b-4324-b28e-e9f76eb047ac\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") "
Sep 14 13:13:07.845710 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.845616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbnf7\" (UniqueName: \"kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7\") pod \"5860e61d-126b-4324-b28e-e9f76eb047ac\" (UID: \"5860e61d-126b-4324-b28e-e9f76eb047ac\") "
Sep 14 13:13:07.846026 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.845988    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5860e61d-126b-4324-b28e-e9f76eb047ac" (UID: "5860e61d-126b-4324-b28e-e9f76eb047ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:13:07.848035 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.848003    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7" (OuterVolumeSpecName: "kube-api-access-gbnf7") pod "5860e61d-126b-4324-b28e-e9f76eb047ac" (UID: "5860e61d-126b-4324-b28e-e9f76eb047ac"). InnerVolumeSpecName "kube-api-access-gbnf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:13:07.848133 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.848058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5860e61d-126b-4324-b28e-e9f76eb047ac" (UID: "5860e61d-126b-4324-b28e-e9f76eb047ac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:13:07.848133 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.848108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5860e61d-126b-4324-b28e-e9f76eb047ac" (UID: "5860e61d-126b-4324-b28e-e9f76eb047ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:13:07.946738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.946698    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5860e61d-126b-4324-b28e-e9f76eb047ac-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:07.946738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.946732    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbnf7\" (UniqueName: \"kubernetes.io/projected/5860e61d-126b-4324-b28e-e9f76eb047ac-kube-api-access-gbnf7\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:07.946738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.946742    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:07.946738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:07.946750    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5860e61d-126b-4324-b28e-e9f76eb047ac-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:08.219481 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.219442    2559 generic.go:356] "Generic (PLEG): container finished" podID="5860e61d-126b-4324-b28e-e9f76eb047ac" containerID="c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01" exitCode=0
Sep 14 13:13:08.219662 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.219489    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"
Sep 14 13:13:08.219662 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.219528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" event={"ID":"5860e61d-126b-4324-b28e-e9f76eb047ac","Type":"ContainerDied","Data":"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"}
Sep 14 13:13:08.219662 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.219591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn" event={"ID":"5860e61d-126b-4324-b28e-e9f76eb047ac","Type":"ContainerDied","Data":"dc0697d4da1c95882fd25d1965c64789b2ff9b4745f14616d5ee690d6cb52d57"}
Sep 14 13:13:08.219662 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.219619    2559 scope.go:117] "RemoveContainer" containerID="c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"
Sep 14 13:13:08.229834 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.229809    2559 scope.go:117] "RemoveContainer" containerID="c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"
Sep 14 13:13:08.230146 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:13:08.230127    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01\": container with ID starting with c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01 not found: ID does not exist" containerID="c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"
Sep 14 13:13:08.230196 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.230154    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01"} err="failed to get container status \"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01\": rpc error: code = NotFound desc = could not find container \"c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01\": container with ID starting with c241b146ff519572124359be2ef80f7a10536f757298f4f67f65fdf952db7a01 not found: ID does not exist"
Sep 14 13:13:08.244203 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.244174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:13:08.249249 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.249222    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c893c447-56754b4bfc-5gqcn"]
Sep 14 13:13:08.683800 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:08.683717    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5860e61d-126b-4324-b28e-e9f76eb047ac" path="/var/lib/kubelet/pods/5860e61d-126b-4324-b28e-e9f76eb047ac/volumes"
Sep 14 13:13:14.399058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.399022    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:14.399522 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.399504    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5860e61d-126b-4324-b28e-e9f76eb047ac" containerName="maas-api"
Sep 14 13:13:14.399587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.399523    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5860e61d-126b-4324-b28e-e9f76eb047ac" containerName="maas-api"
Sep 14 13:13:14.399628 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.399591    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5860e61d-126b-4324-b28e-e9f76eb047ac" containerName="maas-api"
Sep 14 13:13:14.407535 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.407512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.410468 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.410446    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9b4657d2-serving-cert\""
Sep 14 13:13:14.423373 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.423336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:14.503691 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.503648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.503926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.503699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.503926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.503804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6lz\" (UniqueName: \"kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.503926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.503858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.604744 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.604703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.604744 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.604750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.605129 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.604801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6lz\" (UniqueName: \"kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.605129 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.604833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.605482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.605462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.607364 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.607341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.607469 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.607403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.617796 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.617768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6lz\" (UniqueName: \"kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz\") pod \"maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:14.719175 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:14.719142    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:15.013199 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:15.013041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:15.020020 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:13:15.019989    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac61559_6df1_40de_b576_432b235f7542.slice/crio-5b113b3269d1dcc8bb5ea5ba8193a398371e93251c76cc9b7e580ffeebb44825 WatchSource:0}: Error finding container 5b113b3269d1dcc8bb5ea5ba8193a398371e93251c76cc9b7e580ffeebb44825: Status 404 returned error can't find the container with id 5b113b3269d1dcc8bb5ea5ba8193a398371e93251c76cc9b7e580ffeebb44825
Sep 14 13:13:15.269730 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:15.269603    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" event={"ID":"fac61559-6df1-40de-b576-432b235f7542","Type":"ContainerStarted","Data":"5b113b3269d1dcc8bb5ea5ba8193a398371e93251c76cc9b7e580ffeebb44825"}
Sep 14 13:13:15.612466 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:15.612355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:13:16.277052 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:16.277010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" event={"ID":"fac61559-6df1-40de-b576-432b235f7542","Type":"ContainerStarted","Data":"085222a8cc8b639a6a752dda884d3fdded80f33236b37a97bc2c6bf529595e4a"}
Sep 14 13:13:16.277324 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:16.277083    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:16.300075 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:16.300019    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" podStartSLOduration=1.984328594 podStartE2EDuration="2.300001116s" totalImagesPullingTime="315.672522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:16.29877897 +0000 UTC m=+916.135287817" watchObservedRunningTime="2026-09-14 13:13:16.300001116 +0000 UTC m=+916.136509950"
Sep 14 13:13:22.288740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:22.288712    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:25.869233 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.869188    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:13:25.873984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.873963    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.876559 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.876534    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"openshift-service-ca.crt\""
Sep 14 13:13:25.876690 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.876570    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"kube-root-ca.crt\""
Sep 14 13:13:25.877899 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.877826    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"default-dockercfg-8vrt6\""
Sep 14 13:13:25.878094 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.877961    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"simulator-w0-aea349-kserve-self-signed-certs\""
Sep 14 13:13:25.880672 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.880642    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:13:25.907826 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.907784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrnw\" (UniqueName: \"kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.908053 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.907859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.908053 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.907915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.908053 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.907957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.908053 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.907976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:25.908244 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:25.908105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.008950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.008904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.008962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrnw\" (UniqueName: \"kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009441 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.009531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.009518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.011413 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.011391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.011593 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.011572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.017957 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.017932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrnw\" (UniqueName: \"kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw\") pod \"simulator-w0-aea349-kserve-75bd476f8b-vgt2l\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") " pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.185238 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.185143    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:26.466951 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:26.466906    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:13:26.471915 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:13:26.471851    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd633e40_47b6_42c9_8ebe_5067fe392e37.slice/crio-fa7c3b8b5d243d4f3d0c587e9595722d40ad43f33acfe1f66277ba4509b1c073 WatchSource:0}: Error finding container fa7c3b8b5d243d4f3d0c587e9595722d40ad43f33acfe1f66277ba4509b1c073: Status 404 returned error can't find the container with id fa7c3b8b5d243d4f3d0c587e9595722d40ad43f33acfe1f66277ba4509b1c073
Sep 14 13:13:27.345568 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:27.345527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" event={"ID":"dd633e40-47b6-42c9-8ebe-5067fe392e37","Type":"ContainerStarted","Data":"9b8394798c721a70594727c4399b55bac4fe900798f3f433ad9f8b3029383ecd"}
Sep 14 13:13:27.346065 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:27.345577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" event={"ID":"dd633e40-47b6-42c9-8ebe-5067fe392e37","Type":"ContainerStarted","Data":"fa7c3b8b5d243d4f3d0c587e9595722d40ad43f33acfe1f66277ba4509b1c073"}
Sep 14 13:13:27.365855 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:27.365798    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" podStartSLOduration=2.365778668 podStartE2EDuration="2.365778668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:27.364295123 +0000 UTC m=+927.200803958" watchObservedRunningTime="2026-09-14 13:13:27.365778668 +0000 UTC m=+927.202287502"
Sep 14 13:13:33.286284 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:33.286239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:13:36.186087 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:36.186048    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:36.186499 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:36.186101    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:36.198707 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:36.198676    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:36.408388 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:36.408358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:13:43.286301 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.286265    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:43.288611 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.286492    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" podUID="fac61559-6df1-40de-b576-432b235f7542" containerName="maas-api" containerID="cri-o://085222a8cc8b639a6a752dda884d3fdded80f33236b37a97bc2c6bf529595e4a" gracePeriod=30
Sep 14 13:13:43.437500 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.437468    2559 generic.go:356] "Generic (PLEG): container finished" podID="fac61559-6df1-40de-b576-432b235f7542" containerID="085222a8cc8b639a6a752dda884d3fdded80f33236b37a97bc2c6bf529595e4a" exitCode=0
Sep 14 13:13:43.437660 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.437539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" event={"ID":"fac61559-6df1-40de-b576-432b235f7542","Type":"ContainerDied","Data":"085222a8cc8b639a6a752dda884d3fdded80f33236b37a97bc2c6bf529595e4a"}
Sep 14 13:13:43.543243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.543173    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:43.675459 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.675418    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs\") pod \"fac61559-6df1-40de-b576-432b235f7542\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") "
Sep 14 13:13:43.675701 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.675479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn6lz\" (UniqueName: \"kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz\") pod \"fac61559-6df1-40de-b576-432b235f7542\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") "
Sep 14 13:13:43.675701 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.675506    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca\") pod \"fac61559-6df1-40de-b576-432b235f7542\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") "
Sep 14 13:13:43.675701 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.675571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls\") pod \"fac61559-6df1-40de-b576-432b235f7542\" (UID: \"fac61559-6df1-40de-b576-432b235f7542\") "
Sep 14 13:13:43.675938 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.675906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fac61559-6df1-40de-b576-432b235f7542" (UID: "fac61559-6df1-40de-b576-432b235f7542"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:13:43.677848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.677822    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fac61559-6df1-40de-b576-432b235f7542" (UID: "fac61559-6df1-40de-b576-432b235f7542"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:13:43.677944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.677911    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz" (OuterVolumeSpecName: "kube-api-access-tn6lz") pod "fac61559-6df1-40de-b576-432b235f7542" (UID: "fac61559-6df1-40de-b576-432b235f7542"). InnerVolumeSpecName "kube-api-access-tn6lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:13:43.677944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.677915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fac61559-6df1-40de-b576-432b235f7542" (UID: "fac61559-6df1-40de-b576-432b235f7542"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:13:43.777107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.777068    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:43.777107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.777098    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn6lz\" (UniqueName: \"kubernetes.io/projected/fac61559-6df1-40de-b576-432b235f7542-kube-api-access-tn6lz\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:43.777107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.777109    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac61559-6df1-40de-b576-432b235f7542-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:43.777107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:43.777117    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac61559-6df1-40de-b576-432b235f7542-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:13:44.444676 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.444647    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"
Sep 14 13:13:44.444676 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.444656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b" event={"ID":"fac61559-6df1-40de-b576-432b235f7542","Type":"ContainerDied","Data":"5b113b3269d1dcc8bb5ea5ba8193a398371e93251c76cc9b7e580ffeebb44825"}
Sep 14 13:13:44.445298 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.444745    2559 scope.go:117] "RemoveContainer" containerID="085222a8cc8b639a6a752dda884d3fdded80f33236b37a97bc2c6bf529595e4a"
Sep 14 13:13:44.476647 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.476608    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:44.480654 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.480624    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9b4657d2-56958df6cd-bt75b"]
Sep 14 13:13:44.683661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:44.683608    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac61559-6df1-40de-b576-432b235f7542" path="/var/lib/kubelet/pods/fac61559-6df1-40de-b576-432b235f7542/volumes"
Sep 14 13:13:47.505988 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:47.505946    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:13:49.200092 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.200054    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:13:49.200465 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.200440    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac61559-6df1-40de-b576-432b235f7542" containerName="maas-api"
Sep 14 13:13:49.200465 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.200452    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac61559-6df1-40de-b576-432b235f7542" containerName="maas-api"
Sep 14 13:13:49.200580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.200538    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac61559-6df1-40de-b576-432b235f7542" containerName="maas-api"
Sep 14 13:13:49.205224 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.205204    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.208307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.208280    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-282dcc23-serving-cert\""
Sep 14 13:13:49.215558 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.215533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:13:49.334390 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.334334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.334583 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.334475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65s4c\" (UniqueName: \"kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.334583 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.334537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.334660 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.334583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.435586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.435529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65s4c\" (UniqueName: \"kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.435586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.435596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.435837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.435628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.435837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.435654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.435837 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:13:49.435698    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-serving-cert: secret "maas-api-e2e-ait-282dcc23-serving-cert" not found
Sep 14 13:13:49.435837 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:13:49.435769    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls podName:2c4938a9-128d-4de0-ae5f-ed1c233af087 nodeName:}" failed. No retries permitted until 2026-09-14 13:13:49.935749049 +0000 UTC m=+949.772257864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls") pod "maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" (UID: "2c4938a9-128d-4de0-ae5f-ed1c233af087") : secret "maas-api-e2e-ait-282dcc23-serving-cert" not found
Sep 14 13:13:49.436325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.436305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.438178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.438156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.446202 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.446179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65s4c\" (UniqueName: \"kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.940447 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.940402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:49.942856 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:49.942837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") pod \"maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:50.118290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:50.118251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:50.396448 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:50.396421    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:13:50.397957 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:13:50.397929    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4938a9_128d_4de0_ae5f_ed1c233af087.slice/crio-3430d6985d65b7fc87a9b7b24cf8bfc43df62569a4715f7ee5623d96c38238b5 WatchSource:0}: Error finding container 3430d6985d65b7fc87a9b7b24cf8bfc43df62569a4715f7ee5623d96c38238b5: Status 404 returned error can't find the container with id 3430d6985d65b7fc87a9b7b24cf8bfc43df62569a4715f7ee5623d96c38238b5
Sep 14 13:13:50.477817 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:50.477780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" event={"ID":"2c4938a9-128d-4de0-ae5f-ed1c233af087","Type":"ContainerStarted","Data":"3430d6985d65b7fc87a9b7b24cf8bfc43df62569a4715f7ee5623d96c38238b5"}
Sep 14 13:13:51.485298 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:51.485260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" event={"ID":"2c4938a9-128d-4de0-ae5f-ed1c233af087","Type":"ContainerStarted","Data":"f612635c1f3ddae530804ecf8c0acadbb8eafa3df36f2e23cc46e6cb499bb4ad"}
Sep 14 13:13:51.485678 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:51.485326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:13:51.527429 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:51.527376    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" podStartSLOduration=2.12276038 podStartE2EDuration="2.527360063s" totalImagesPullingTime="404.599683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:51.524811945 +0000 UTC m=+951.361320780" watchObservedRunningTime="2026-09-14 13:13:51.527360063 +0000 UTC m=+951.363868897"
Sep 14 13:13:53.866864 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.866827    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:13:53.870621 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.870605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.874727 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.874693    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"kube-root-ca.crt\""
Sep 14 13:13:53.874907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.874727    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"default-dockercfg-x56km\""
Sep 14 13:13:53.874907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.874729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"simulator-w4-5cedb0-kserve-self-signed-certs\""
Sep 14 13:13:53.874907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.874822    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"openshift-service-ca.crt\""
Sep 14 13:13:53.880915 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.880890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5sg\" (UniqueName: \"kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881020 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.880925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881020 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.880986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881108 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.881060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881143 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.881110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881175 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.881150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.881758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.881739    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:13:53.982439 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5sg\" (UniqueName: \"kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982930 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.982978 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.983021 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.982978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.985010 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.984987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.985198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.985182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:53.993298 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:53.993269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5sg\" (UniqueName: \"kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg\") pod \"simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") " pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:54.180109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:54.180020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:13:54.457100 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:54.457071    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:13:54.458733 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:13:54.458690    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09f12420_68b9_42ab_bc35_6592d4824fad.slice/crio-6dd443f6401b95f21acd18f083ab8e09f8841918853ae2e5c0227ed81ccb726b WatchSource:0}: Error finding container 6dd443f6401b95f21acd18f083ab8e09f8841918853ae2e5c0227ed81ccb726b: Status 404 returned error can't find the container with id 6dd443f6401b95f21acd18f083ab8e09f8841918853ae2e5c0227ed81ccb726b
Sep 14 13:13:54.502766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:54.502736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" event={"ID":"09f12420-68b9-42ab-bc35-6592d4824fad","Type":"ContainerStarted","Data":"6dd443f6401b95f21acd18f083ab8e09f8841918853ae2e5c0227ed81ccb726b"}
Sep 14 13:13:55.510123 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:55.510079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" event={"ID":"09f12420-68b9-42ab-bc35-6592d4824fad","Type":"ContainerStarted","Data":"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"}
Sep 14 13:13:55.531795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:55.531739    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" podStartSLOduration=2.531718583 podStartE2EDuration="2.531718583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:13:55.529422167 +0000 UTC m=+955.365931016" watchObservedRunningTime="2026-09-14 13:13:55.531718583 +0000 UTC m=+955.368227416"
Sep 14 13:13:57.497352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:13:57.497317    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:14:04.181158 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:04.181109    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:14:04.181572 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:04.181185    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:14:04.194088 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:04.194054    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:14:04.572314 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:04.572281    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:14:14.698103 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:14.698070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:14:19.462183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.462146    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:14:19.462654 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.462359    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" podUID="2c4938a9-128d-4de0-ae5f-ed1c233af087" containerName="maas-api" containerID="cri-o://f612635c1f3ddae530804ecf8c0acadbb8eafa3df36f2e23cc46e6cb499bb4ad" gracePeriod=30
Sep 14 13:14:19.650615 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.650563    2559 generic.go:356] "Generic (PLEG): container finished" podID="2c4938a9-128d-4de0-ae5f-ed1c233af087" containerID="f612635c1f3ddae530804ecf8c0acadbb8eafa3df36f2e23cc46e6cb499bb4ad" exitCode=0
Sep 14 13:14:19.650794 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.650681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" event={"ID":"2c4938a9-128d-4de0-ae5f-ed1c233af087","Type":"ContainerDied","Data":"f612635c1f3ddae530804ecf8c0acadbb8eafa3df36f2e23cc46e6cb499bb4ad"}
Sep 14 13:14:19.731430 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.731406    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:14:19.833544 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.833513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca\") pod \"2c4938a9-128d-4de0-ae5f-ed1c233af087\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") "
Sep 14 13:14:19.833727 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.833564    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65s4c\" (UniqueName: \"kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c\") pod \"2c4938a9-128d-4de0-ae5f-ed1c233af087\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") "
Sep 14 13:14:19.833727 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.833603    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") pod \"2c4938a9-128d-4de0-ae5f-ed1c233af087\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") "
Sep 14 13:14:19.833821 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.833731    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs\") pod \"2c4938a9-128d-4de0-ae5f-ed1c233af087\" (UID: \"2c4938a9-128d-4de0-ae5f-ed1c233af087\") "
Sep 14 13:14:19.833996 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.833966    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c4938a9-128d-4de0-ae5f-ed1c233af087" (UID: "2c4938a9-128d-4de0-ae5f-ed1c233af087"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:14:19.834247 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.834222    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4938a9-128d-4de0-ae5f-ed1c233af087-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:19.836029 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.836008    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c4938a9-128d-4de0-ae5f-ed1c233af087" (UID: "2c4938a9-128d-4de0-ae5f-ed1c233af087"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:14:19.836124 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.836102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2c4938a9-128d-4de0-ae5f-ed1c233af087" (UID: "2c4938a9-128d-4de0-ae5f-ed1c233af087"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:14:19.836167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.836115    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c" (OuterVolumeSpecName: "kube-api-access-65s4c") pod "2c4938a9-128d-4de0-ae5f-ed1c233af087" (UID: "2c4938a9-128d-4de0-ae5f-ed1c233af087"). InnerVolumeSpecName "kube-api-access-65s4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:14:19.935109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.935076    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:19.935109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.935102    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c4938a9-128d-4de0-ae5f-ed1c233af087-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:19.935109 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:19.935115    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65s4c\" (UniqueName: \"kubernetes.io/projected/2c4938a9-128d-4de0-ae5f-ed1c233af087-kube-api-access-65s4c\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:20.657811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:20.657779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"
Sep 14 13:14:20.657811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:20.657797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn" event={"ID":"2c4938a9-128d-4de0-ae5f-ed1c233af087","Type":"ContainerDied","Data":"3430d6985d65b7fc87a9b7b24cf8bfc43df62569a4715f7ee5623d96c38238b5"}
Sep 14 13:14:20.658257 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:20.657899    2559 scope.go:117] "RemoveContainer" containerID="f612635c1f3ddae530804ecf8c0acadbb8eafa3df36f2e23cc46e6cb499bb4ad"
Sep 14 13:14:20.686239 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:20.686210    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:14:20.694372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:20.694347    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-282dcc23-59d995d6c7-xbhtn"]
Sep 14 13:14:22.682626 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:22.682595    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c4938a9-128d-4de0-ae5f-ed1c233af087" path="/var/lib/kubelet/pods/2c4938a9-128d-4de0-ae5f-ed1c233af087/volumes"
Sep 14 13:14:24.417020 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.416984    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:14:24.417448 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.417432    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4938a9-128d-4de0-ae5f-ed1c233af087" containerName="maas-api"
Sep 14 13:14:24.417490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.417450    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4938a9-128d-4de0-ae5f-ed1c233af087" containerName="maas-api"
Sep 14 13:14:24.417551 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.417540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4938a9-128d-4de0-ae5f-ed1c233af087" containerName="maas-api"
Sep 14 13:14:24.421845 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.421829    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.427393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.427357    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-f96382\"/\"default-dockercfg-tlm4k\""
Sep 14 13:14:24.427393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.427379    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-f96382\"/\"openshift-service-ca.crt\""
Sep 14 13:14:24.427605 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.427365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-f96382\"/\"autores-model-f96382-kserve-self-signed-certs\""
Sep 14 13:14:24.428307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.427868    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-f96382\"/\"kube-root-ca.crt\""
Sep 14 13:14:24.437857 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.437828    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:14:24.581703 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.581891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.581891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.581891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.581891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.581891 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.581868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxzk\" (UniqueName: \"kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682468 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682468 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxzk\" (UniqueName: \"kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682927 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.682982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.682931    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.683048 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.683017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.684752 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.684727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.685352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.685329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.691219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.691196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxzk\" (UniqueName: \"kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk\") pod \"autores-model-f96382-kserve-dbb6f8db7-22vtw\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") " pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:24.732228 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:24.732191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:25.016251 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:25.015934    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:14:25.019110 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:14:25.019082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4de8ed56_63ab_4256_b116_65051fdc5609.slice/crio-0d28887d9f17f2d5529fc7cd600691d1469b7674f179cfbd0216bdff8789f96d WatchSource:0}: Error finding container 0d28887d9f17f2d5529fc7cd600691d1469b7674f179cfbd0216bdff8789f96d: Status 404 returned error can't find the container with id 0d28887d9f17f2d5529fc7cd600691d1469b7674f179cfbd0216bdff8789f96d
Sep 14 13:14:25.690526 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:25.690489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" event={"ID":"4de8ed56-63ab-4256-b116-65051fdc5609","Type":"ContainerStarted","Data":"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"}
Sep 14 13:14:25.690908 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:25.690540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" event={"ID":"4de8ed56-63ab-4256-b116-65051fdc5609","Type":"ContainerStarted","Data":"0d28887d9f17f2d5529fc7cd600691d1469b7674f179cfbd0216bdff8789f96d"}
Sep 14 13:14:25.720856 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:25.720799    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" podStartSLOduration=1.720783089 podStartE2EDuration="1.720783089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:14:25.720067872 +0000 UTC m=+985.556576707" watchObservedRunningTime="2026-09-14 13:14:25.720783089 +0000 UTC m=+985.557291922"
Sep 14 13:14:27.019892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.019843    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:27.023513 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.023496    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.026905 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.026872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3b45ef72-serving-cert\""
Sep 14 13:14:27.038303 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.038278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:27.208556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.208521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ltv\" (UniqueName: \"kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.208713 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.208583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.208713 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.208634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.208713 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.208657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.310066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.309969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ltv\" (UniqueName: \"kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.310066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.310039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.310332 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.310068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.310332 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.310095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.310919 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.310866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.312581 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.312551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.312681 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.312595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.326351 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.326325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ltv\" (UniqueName: \"kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv\") pod \"maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.334208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.334179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:27.635137 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.634792    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:27.639617 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:14:27.639589    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc384f13_41ab_4c71_b550_a7f166c21d04.slice/crio-2d649fe8e6c1c2439c4960c9e0394f49d4bce5dfd1a975d9decd9168f68cc871 WatchSource:0}: Error finding container 2d649fe8e6c1c2439c4960c9e0394f49d4bce5dfd1a975d9decd9168f68cc871: Status 404 returned error can't find the container with id 2d649fe8e6c1c2439c4960c9e0394f49d4bce5dfd1a975d9decd9168f68cc871
Sep 14 13:14:27.702836 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:27.702799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" event={"ID":"bc384f13-41ab-4c71-b550-a7f166c21d04","Type":"ContainerStarted","Data":"2d649fe8e6c1c2439c4960c9e0394f49d4bce5dfd1a975d9decd9168f68cc871"}
Sep 14 13:14:28.710586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:28.710544    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" event={"ID":"bc384f13-41ab-4c71-b550-a7f166c21d04","Type":"ContainerStarted","Data":"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"}
Sep 14 13:14:28.711117 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:28.710689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:28.733246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:28.733203    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" podStartSLOduration=2.232922458 podStartE2EDuration="2.733187606s" totalImagesPullingTime="500.265148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:14:28.730640442 +0000 UTC m=+988.567149289" watchObservedRunningTime="2026-09-14 13:14:28.733187606 +0000 UTC m=+988.569696439"
Sep 14 13:14:30.389382 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:30.389345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:14:34.722860 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:34.722827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:34.732693 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:34.732671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:34.732693 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:34.732700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:34.745696 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:34.745670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:34.759814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:34.759771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:14:41.168848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.168811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:14:41.172999 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.172974    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.177349 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.177317    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0fcdc6\"/\"test-model-0fcdc6-kserve-self-signed-certs\""
Sep 14 13:14:41.177349 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.177333    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0fcdc6\"/\"kube-root-ca.crt\""
Sep 14 13:14:41.177349 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.177341    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0fcdc6\"/\"openshift-service-ca.crt\""
Sep 14 13:14:41.177650 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.177319    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0fcdc6\"/\"default-dockercfg-km7fr\""
Sep 14 13:14:41.183495 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.183466    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:14:41.235125 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.235302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvz2\" (UniqueName: \"kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.235302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235168    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.235302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.235302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.235302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.235291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336539 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336709 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336873 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.336873 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.336767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvz2\" (UniqueName: \"kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.337031 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.337002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.337194 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.337152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.337481 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.337456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.339008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.338984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.339342 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.339324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.345343 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.345323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvz2\" (UniqueName: \"kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2\") pod \"test-model-0fcdc6-kserve-58d7f54d8f-n6drf\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") " pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.483750 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.483716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:41.763163 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.763134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:14:41.764662 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:14:41.764629    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e94bb59_2d0c_4c02_a7f7_49e3a5fa08d1.slice/crio-cd4c87d37a8e2fef07b0ffd34891a568fb7e896af76bec3864adce02fdb07d00 WatchSource:0}: Error finding container cd4c87d37a8e2fef07b0ffd34891a568fb7e896af76bec3864adce02fdb07d00: Status 404 returned error can't find the container with id cd4c87d37a8e2fef07b0ffd34891a568fb7e896af76bec3864adce02fdb07d00
Sep 14 13:14:41.785683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:41.785653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" event={"ID":"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1","Type":"ContainerStarted","Data":"cd4c87d37a8e2fef07b0ffd34891a568fb7e896af76bec3864adce02fdb07d00"}
Sep 14 13:14:42.793627 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:42.793590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" event={"ID":"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1","Type":"ContainerStarted","Data":"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"}
Sep 14 13:14:42.811265 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:42.811217    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" podStartSLOduration=1.811200253 podStartE2EDuration="1.811200253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:14:42.810408032 +0000 UTC m=+1002.646916866" watchObservedRunningTime="2026-09-14 13:14:42.811200253 +0000 UTC m=+1002.647709086"
Sep 14 13:14:51.484218 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:51.484181    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:51.484641 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:51.484239    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:51.496738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:51.496710    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:51.615758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:51.615722    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:14:51.857291 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:51.857212    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:14:56.270101 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.270067    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:56.270552 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.270346    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" podUID="bc384f13-41ab-4c71-b550-a7f166c21d04" containerName="maas-api" containerID="cri-o://c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129" gracePeriod=30
Sep 14 13:14:56.511969 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.511944    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:56.588556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.588481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2ltv\" (UniqueName: \"kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv\") pod \"bc384f13-41ab-4c71-b550-a7f166c21d04\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") "
Sep 14 13:14:56.588556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.588543    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca\") pod \"bc384f13-41ab-4c71-b550-a7f166c21d04\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") "
Sep 14 13:14:56.588752 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.588604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls\") pod \"bc384f13-41ab-4c71-b550-a7f166c21d04\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") "
Sep 14 13:14:56.588752 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.588672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs\") pod \"bc384f13-41ab-4c71-b550-a7f166c21d04\" (UID: \"bc384f13-41ab-4c71-b550-a7f166c21d04\") "
Sep 14 13:14:56.588963 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.588928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc384f13-41ab-4c71-b550-a7f166c21d04" (UID: "bc384f13-41ab-4c71-b550-a7f166c21d04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:14:56.590982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.590953    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bc384f13-41ab-4c71-b550-a7f166c21d04" (UID: "bc384f13-41ab-4c71-b550-a7f166c21d04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:14:56.591348 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.591322    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc384f13-41ab-4c71-b550-a7f166c21d04" (UID: "bc384f13-41ab-4c71-b550-a7f166c21d04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:14:56.591448 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.591396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv" (OuterVolumeSpecName: "kube-api-access-j2ltv") pod "bc384f13-41ab-4c71-b550-a7f166c21d04" (UID: "bc384f13-41ab-4c71-b550-a7f166c21d04"). InnerVolumeSpecName "kube-api-access-j2ltv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:14:56.689985 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.689858    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ltv\" (UniqueName: \"kubernetes.io/projected/bc384f13-41ab-4c71-b550-a7f166c21d04-kube-api-access-j2ltv\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:56.689985 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.689900    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc384f13-41ab-4c71-b550-a7f166c21d04-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:56.689985 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.689912    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:56.689985 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.689921    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc384f13-41ab-4c71-b550-a7f166c21d04-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:14:56.875166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.875074    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc384f13-41ab-4c71-b550-a7f166c21d04" containerID="c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129" exitCode=0
Sep 14 13:14:56.875166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.875122    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"
Sep 14 13:14:56.875342 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.875157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" event={"ID":"bc384f13-41ab-4c71-b550-a7f166c21d04","Type":"ContainerDied","Data":"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"}
Sep 14 13:14:56.875342 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.875210    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw" event={"ID":"bc384f13-41ab-4c71-b550-a7f166c21d04","Type":"ContainerDied","Data":"2d649fe8e6c1c2439c4960c9e0394f49d4bce5dfd1a975d9decd9168f68cc871"}
Sep 14 13:14:56.875342 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.875233    2559 scope.go:117] "RemoveContainer" containerID="c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"
Sep 14 13:14:56.884669 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.884647    2559 scope.go:117] "RemoveContainer" containerID="c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"
Sep 14 13:14:56.884970 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:14:56.884948    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129\": container with ID starting with c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129 not found: ID does not exist" containerID="c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"
Sep 14 13:14:56.885057 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.884982    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129"} err="failed to get container status \"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129\": rpc error: code = NotFound desc = could not find container \"c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129\": container with ID starting with c008e93173991eba5f12c895fd2c01bd430d839560a3b346d8014c7418c44129 not found: ID does not exist"
Sep 14 13:14:56.905757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.905729    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:56.916552 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:56.916531    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3b45ef72-544f76c79c-gblgw"]
Sep 14 13:14:58.684032 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:14:58.684000    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc384f13-41ab-4c71-b550-a7f166c21d04" path="/var/lib/kubelet/pods/bc384f13-41ab-4c71-b550-a7f166c21d04/volumes"
Sep 14 13:15:00.272779 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.272734    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"]
Sep 14 13:15:00.273178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.273143    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc384f13-41ab-4c71-b550-a7f166c21d04" containerName="maas-api"
Sep 14 13:15:00.273178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.273157    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc384f13-41ab-4c71-b550-a7f166c21d04" containerName="maas-api"
Sep 14 13:15:00.273255 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.273222    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc384f13-41ab-4c71-b550-a7f166c21d04" containerName="maas-api"
Sep 14 13:15:00.276222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.276203    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"]
Sep 14 13:15:00.276340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.276321    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"
Sep 14 13:15:00.279316 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.279296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"
Sep 14 13:15:00.280131 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.280112    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kjv9l\""
Sep 14 13:15:00.287597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.287575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"
Sep 14 13:15:00.289392 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.289368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"]
Sep 14 13:15:00.295144 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.294904    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"]
Sep 14 13:15:00.297242 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.297222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"
Sep 14 13:15:00.299626 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.299605    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"]
Sep 14 13:15:00.312392 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.312369    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"
Sep 14 13:15:00.329603 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.329570    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"]
Sep 14 13:15:00.346783 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.346586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"
Sep 14 13:15:00.627102 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.627078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"]
Sep 14 13:15:00.628833 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:15:00.628808    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fefce37_99e8_4e33_b719_d265614e58d1.slice/crio-cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4 WatchSource:0}: Error finding container cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4: Status 404 returned error can't find the container with id cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4
Sep 14 13:15:00.631060 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.631041    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:15:00.635325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.635302    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"]
Sep 14 13:15:00.636246 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:15:00.636222    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a4e0b9_0727_4cdf_9efc_a0aba3f6520e.slice/crio-0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0 WatchSource:0}: Error finding container 0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0: Status 404 returned error can't find the container with id 0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0
Sep 14 13:15:00.661521 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.661495    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"]
Sep 14 13:15:00.669715 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:15:00.669687    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe8b138_f184_45d0_876c_e4f80df81fd7.slice/crio-ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556 WatchSource:0}: Error finding container ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556: Status 404 returned error can't find the container with id ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556
Sep 14 13:15:00.900229 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.900137    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9" event={"ID":"dbe8b138-f184-45d0-876c-e4f80df81fd7","Type":"ContainerStarted","Data":"ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556"}
Sep 14 13:15:00.901488 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.901455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h" event={"ID":"2fefce37-99e8-4e33-b719-d265614e58d1","Type":"ContainerStarted","Data":"cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4"}
Sep 14 13:15:00.902800 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:00.902774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz" event={"ID":"c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e","Type":"ContainerStarted","Data":"0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0"}
Sep 14 13:15:03.928072 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:03.927974    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9" event={"ID":"dbe8b138-f184-45d0-876c-e4f80df81fd7","Type":"ContainerStarted","Data":"6742f861203022c9dfcaa28f564f526f7ba89b51ea6ea8a7d6ff8cb58eef1b35"}
Sep 14 13:15:03.929770 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:03.929739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz" event={"ID":"c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e","Type":"ContainerStarted","Data":"5d558a895bf274eae0c99c912fe790a549555bd9f2b00effb900be46a95d71f2"}
Sep 14 13:15:03.946995 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:03.946951    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9" podStartSLOduration=1.21163459 podStartE2EDuration="3.946934983s" totalImagesPullingTime="2.735300393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:15:03.944720434 +0000 UTC m=+1023.781229270" watchObservedRunningTime="2026-09-14 13:15:03.946934983 +0000 UTC m=+1023.783443817"
Sep 14 13:15:03.973420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:03.973369    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz" podStartSLOduration=1.20846939 podStartE2EDuration="3.973352617s" totalImagesPullingTime="2.764883227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:15:03.971941117 +0000 UTC m=+1023.808449969" watchObservedRunningTime="2026-09-14 13:15:03.973352617 +0000 UTC m=+1023.809861450"
Sep 14 13:15:04.937289 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.937198    2559 generic.go:356] "Generic (PLEG): container finished" podID="dbe8b138-f184-45d0-876c-e4f80df81fd7" containerID="6742f861203022c9dfcaa28f564f526f7ba89b51ea6ea8a7d6ff8cb58eef1b35" exitCode=0
Sep 14 13:15:04.937289 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.937250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9" event={"ID":"dbe8b138-f184-45d0-876c-e4f80df81fd7","Type":"ContainerDied","Data":"6742f861203022c9dfcaa28f564f526f7ba89b51ea6ea8a7d6ff8cb58eef1b35"}
Sep 14 13:15:04.938964 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.938942    2559 generic.go:356] "Generic (PLEG): container finished" podID="2fefce37-99e8-4e33-b719-d265614e58d1" containerID="b5d0e9cd1ad247c91c580afbba0de2f25687d260d4af2e1b79b3338eddf1700f" exitCode=0
Sep 14 13:15:04.939075 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.939020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h" event={"ID":"2fefce37-99e8-4e33-b719-d265614e58d1","Type":"ContainerDied","Data":"b5d0e9cd1ad247c91c580afbba0de2f25687d260d4af2e1b79b3338eddf1700f"}
Sep 14 13:15:04.940706 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.940677    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e" containerID="5d558a895bf274eae0c99c912fe790a549555bd9f2b00effb900be46a95d71f2" exitCode=0
Sep 14 13:15:04.940706 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:04.940697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz" event={"ID":"c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e","Type":"ContainerDied","Data":"5d558a895bf274eae0c99c912fe790a549555bd9f2b00effb900be46a95d71f2"}
Sep 14 13:15:06.120912 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.120870    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"
Sep 14 13:15:06.124014 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.123992    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"
Sep 14 13:15:06.155602 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.155580    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"
Sep 14 13:15:06.954126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.954053    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h"
Sep 14 13:15:06.954126 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.954088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29823195-smv4h" event={"ID":"2fefce37-99e8-4e33-b719-d265614e58d1","Type":"ContainerDied","Data":"cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4"}
Sep 14 13:15:06.954306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.954139    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc9524448efe0f7a591f292d0a5894333d6134ac2a1456fa907d9b64a4b06db4"
Sep 14 13:15:06.955658 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.955630    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"
Sep 14 13:15:06.955794 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.955685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz" event={"ID":"c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e","Type":"ContainerDied","Data":"0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0"}
Sep 14 13:15:06.955794 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.955727    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e5d8e2c4731ff78103c04fbeeba1856a52b49df0362b5dd284e02e22e80d6e0"
Sep 14 13:15:06.957700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.957616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9" event={"ID":"dbe8b138-f184-45d0-876c-e4f80df81fd7","Type":"ContainerDied","Data":"ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556"}
Sep 14 13:15:06.957700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.957653    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"
Sep 14 13:15:06.957700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:06.957662    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebd299abdb74e20d689afb2291d78ea730738237cce3020e5b7dec86a29d9556"
Sep 14 13:15:10.010592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.010558    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:15:10.011068 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.010799    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" podUID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" containerName="maas-api" containerID="cri-o://0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460" gracePeriod=30
Sep 14 13:15:10.051832 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.051795    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"]
Sep 14 13:15:10.052592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.052557    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-f96382-29823195-67bf9"]
Sep 14 13:15:10.254243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.254207    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:15:10.425656 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.425579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") pod \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") "
Sep 14 13:15:10.425656 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.425612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s9s2\" (UniqueName: \"kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2\") pod \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") "
Sep 14 13:15:10.425656 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.425633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca\") pod \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") "
Sep 14 13:15:10.425926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.425698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs\") pod \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\" (UID: \"91cf4220-3ebf-4535-9ab4-bf0cf77684cc\") "
Sep 14 13:15:10.426102 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.426072    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91cf4220-3ebf-4535-9ab4-bf0cf77684cc" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:15:10.427660 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.427636    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91cf4220-3ebf-4535-9ab4-bf0cf77684cc" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:15:10.427742 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.427725    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2" (OuterVolumeSpecName: "kube-api-access-5s9s2") pod "91cf4220-3ebf-4535-9ab4-bf0cf77684cc" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc"). InnerVolumeSpecName "kube-api-access-5s9s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:10.427852 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.427831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "91cf4220-3ebf-4535-9ab4-bf0cf77684cc" (UID: "91cf4220-3ebf-4535-9ab4-bf0cf77684cc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:15:10.526763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.526737    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:10.526763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.526762    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s9s2\" (UniqueName: \"kubernetes.io/projected/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-kube-api-access-5s9s2\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:10.526947 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.526774    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:10.526947 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.526782    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91cf4220-3ebf-4535-9ab4-bf0cf77684cc-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:10.683371 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.683300    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe8b138-f184-45d0-876c-e4f80df81fd7" path="/var/lib/kubelet/pods/dbe8b138-f184-45d0-876c-e4f80df81fd7/volumes"
Sep 14 13:15:10.982861 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.982829    2559 generic.go:356] "Generic (PLEG): container finished" podID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" containerID="0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460" exitCode=0
Sep 14 13:15:10.983032 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.982869    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"
Sep 14 13:15:10.983032 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.982917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" event={"ID":"91cf4220-3ebf-4535-9ab4-bf0cf77684cc","Type":"ContainerDied","Data":"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"}
Sep 14 13:15:10.983032 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.982972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh" event={"ID":"91cf4220-3ebf-4535-9ab4-bf0cf77684cc","Type":"ContainerDied","Data":"7f5a261f3f0cb0db6e2d858c298064390c774ce29feed9ce4e576d46d1c571f2"}
Sep 14 13:15:10.983032 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.982996    2559 scope.go:117] "RemoveContainer" containerID="0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"
Sep 14 13:15:10.992027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.992013    2559 scope.go:117] "RemoveContainer" containerID="0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"
Sep 14 13:15:10.992292 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:15:10.992265    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460\": container with ID starting with 0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460 not found: ID does not exist" containerID="0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"
Sep 14 13:15:10.992338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:10.992294    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460"} err="failed to get container status \"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460\": rpc error: code = NotFound desc = could not find container \"0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460\": container with ID starting with 0f12e0a508d2551710c0292d13c732fef689cb41cb2b7f4ce42e1344e0122460 not found: ID does not exist"
Sep 14 13:15:11.002745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:11.002723    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:15:11.007324 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:11.007304    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-f96382-58c5d65f5-6skhh"]
Sep 14 13:15:12.683417 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:12.683382    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" path="/var/lib/kubelet/pods/91cf4220-3ebf-4535-9ab4-bf0cf77684cc/volumes"
Sep 14 13:15:13.599216 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:13.599178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:15:15.603316 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:15.603275    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:15:30.622930 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.622850    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" podUID="4de8ed56-63ab-4256-b116-65051fdc5609" containerName="main" containerID="cri-o://f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c" gracePeriod=45
Sep 14 13:15:30.889933 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.889850    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:15:30.918598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.918778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.918778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.918778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918727    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjxzk\" (UniqueName: \"kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.918778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918762    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.919005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918812    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm\") pod \"4de8ed56-63ab-4256-b116-65051fdc5609\" (UID: \"4de8ed56-63ab-4256-b116-65051fdc5609\") "
Sep 14 13:15:30.919005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918867    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache" (OuterVolumeSpecName: "model-cache") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:30.919005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.918930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home" (OuterVolumeSpecName: "home") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:30.919236 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.919213    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:30.919292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.919245    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:30.919292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.919205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:30.921228 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.921195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk" (OuterVolumeSpecName: "kube-api-access-rjxzk") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "kube-api-access-rjxzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:15:30.921372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.921261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:15:30.921372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:30.921296    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm" (OuterVolumeSpecName: "dshm") pod "4de8ed56-63ab-4256-b116-65051fdc5609" (UID: "4de8ed56-63ab-4256-b116-65051fdc5609"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:15:31.020766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.020722    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjxzk\" (UniqueName: \"kubernetes.io/projected/4de8ed56-63ab-4256-b116-65051fdc5609-kube-api-access-rjxzk\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:31.020766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.020759    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:31.020766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.020770    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de8ed56-63ab-4256-b116-65051fdc5609-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:31.021108 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.020783    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de8ed56-63ab-4256-b116-65051fdc5609-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:15:31.096061 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.096027    2559 generic.go:356] "Generic (PLEG): container finished" podID="4de8ed56-63ab-4256-b116-65051fdc5609" containerID="f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c" exitCode=0
Sep 14 13:15:31.096246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.096073    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"
Sep 14 13:15:31.096246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.096107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" event={"ID":"4de8ed56-63ab-4256-b116-65051fdc5609","Type":"ContainerDied","Data":"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"}
Sep 14 13:15:31.096246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.096151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw" event={"ID":"4de8ed56-63ab-4256-b116-65051fdc5609","Type":"ContainerDied","Data":"0d28887d9f17f2d5529fc7cd600691d1469b7674f179cfbd0216bdff8789f96d"}
Sep 14 13:15:31.096246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.096173    2559 scope.go:117] "RemoveContainer" containerID="f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"
Sep 14 13:15:31.106437 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.106413    2559 scope.go:117] "RemoveContainer" containerID="f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"
Sep 14 13:15:31.106851 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:15:31.106826    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c\": container with ID starting with f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c not found: ID does not exist" containerID="f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"
Sep 14 13:15:31.106951 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.106865    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c"} err="failed to get container status \"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c\": rpc error: code = NotFound desc = could not find container \"f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c\": container with ID starting with f37356f73744f4b4595cd1a8e02ff6762b5c1a287cca2e19f7223d806d3d366c not found: ID does not exist"
Sep 14 13:15:31.122754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.122717    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:15:31.128358 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:31.128319    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-f96382/autores-model-f96382-kserve-dbb6f8db7-22vtw"]
Sep 14 13:15:32.683822 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:15:32.683788    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4de8ed56-63ab-4256-b116-65051fdc5609" path="/var/lib/kubelet/pods/4de8ed56-63ab-4256-b116-65051fdc5609/volumes"
Sep 14 13:16:01.461320 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461278    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461643    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461655    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461666    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" containerName="maas-api"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461672    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" containerName="maas-api"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461682    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe8b138-f184-45d0-876c-e4f80df81fd7" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461689    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe8b138-f184-45d0-876c-e4f80df81fd7" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461709    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de8ed56-63ab-4256-b116-65051fdc5609" containerName="main"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461714    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de8ed56-63ab-4256-b116-65051fdc5609" containerName="main"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461722    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fefce37-99e8-4e33-b719-d265614e58d1" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461727    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fefce37-99e8-4e33-b719-d265614e58d1" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461781    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de8ed56-63ab-4256-b116-65051fdc5609" containerName="main"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461789    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461799    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91cf4220-3ebf-4535-9ab4-bf0cf77684cc" containerName="maas-api"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461805    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fefce37-99e8-4e33-b719-d265614e58d1" containerName="cleanup"
Sep 14 13:16:01.461813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.461812    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe8b138-f184-45d0-876c-e4f80df81fd7" containerName="cleanup"
Sep 14 13:16:01.466362 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.466331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.472360 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.472334    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-55cb42-serving-cert\""
Sep 14 13:16:01.495164 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.495140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:16:01.615968 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.615932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.616137 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.615981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.616137 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.616015    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqvj\" (UniqueName: \"kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.616137 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.616040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.716977 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.716865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.716977 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.716960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.717213 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.716993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqvj\" (UniqueName: \"kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.717213 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.717016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.717213 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:16:01.717039    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-serving-cert: secret "maas-api-e2e-explicit-55cb42-serving-cert" not found
Sep 14 13:16:01.717213 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:16:01.717120    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls podName:24315da2-9827-4326-8aab-b3cce4d37176 nodeName:}" failed. No retries permitted until 2026-09-14 13:16:02.217100638 +0000 UTC m=+1082.053609457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls") pod "maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" (UID: "24315da2-9827-4326-8aab-b3cce4d37176") : secret "maas-api-e2e-explicit-55cb42-serving-cert" not found
Sep 14 13:16:01.717680 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.717663    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.719396 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.719377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:01.729979 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:01.729952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqvj\" (UniqueName: \"kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:02.223104 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:02.223072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:02.225552 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:02.225527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") pod \"maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:02.377498 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:02.377461    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:02.661566 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:02.661477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:16:02.666038 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:16:02.666007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24315da2_9827_4326_8aab_b3cce4d37176.slice/crio-db330f619ad6cc3db1ed350f168d54e5feb4cdf52a9cffbcffc9212f58fe2b80 WatchSource:0}: Error finding container db330f619ad6cc3db1ed350f168d54e5feb4cdf52a9cffbcffc9212f58fe2b80: Status 404 returned error can't find the container with id db330f619ad6cc3db1ed350f168d54e5feb4cdf52a9cffbcffc9212f58fe2b80
Sep 14 13:16:03.276160 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:03.276131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" event={"ID":"24315da2-9827-4326-8aab-b3cce4d37176","Type":"ContainerStarted","Data":"db330f619ad6cc3db1ed350f168d54e5feb4cdf52a9cffbcffc9212f58fe2b80"}
Sep 14 13:16:04.292765 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:04.292720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" event={"ID":"24315da2-9827-4326-8aab-b3cce4d37176","Type":"ContainerStarted","Data":"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"}
Sep 14 13:16:04.293210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:04.292917    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:04.317970 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:04.317912    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" podStartSLOduration=2.736053797 podStartE2EDuration="3.317867488s" totalImagesPullingTime="581.813691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:04.317317542 +0000 UTC m=+1084.153826375" watchObservedRunningTime="2026-09-14 13:16:04.317867488 +0000 UTC m=+1084.154376323"
Sep 14 13:16:10.304724 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:10.304691    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:16:10.996247 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:10.996212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:16:20.167182 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.167151    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:16:20.170866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.170844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.173826 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.173806    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"premium-w0-aea349-kserve-self-signed-certs\""
Sep 14 13:16:20.183578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.182575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:16:20.196249 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.196376 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.196376 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.196478 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.196532 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.196532 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.196511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sxs2\" (UniqueName: \"kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.297758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.297741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sxs2\" (UniqueName: \"kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.298179 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.298151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.298179 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.298174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.298371 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.298248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.299944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.299923    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.300353 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.300334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.307346 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.307325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sxs2\" (UniqueName: \"kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2\") pod \"premium-w0-aea349-kserve-656b859675-dp4vd\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") " pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.480054 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.480020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:20.762425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:20.762393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:16:20.763728 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:16:20.763702    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeb8e862_f906_4dc9_8a92_b4cf74969eed.slice/crio-5c9c71bfce05e3e460d2bd52b71457f8b2d9ab280b01cfee6296f18e49506160 WatchSource:0}: Error finding container 5c9c71bfce05e3e460d2bd52b71457f8b2d9ab280b01cfee6296f18e49506160: Status 404 returned error can't find the container with id 5c9c71bfce05e3e460d2bd52b71457f8b2d9ab280b01cfee6296f18e49506160
Sep 14 13:16:21.388816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:21.388776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" event={"ID":"deb8e862-f906-4dc9-8a92-b4cf74969eed","Type":"ContainerStarted","Data":"a810056d0a16830b2b494fcaf17bc8e05f3520769d8474d88da612a714c133cd"}
Sep 14 13:16:21.388816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:21.388824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" event={"ID":"deb8e862-f906-4dc9-8a92-b4cf74969eed","Type":"ContainerStarted","Data":"5c9c71bfce05e3e460d2bd52b71457f8b2d9ab280b01cfee6296f18e49506160"}
Sep 14 13:16:21.444065 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:21.444020    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" podStartSLOduration=1.444003946 podStartE2EDuration="1.444003946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:21.441032969 +0000 UTC m=+1101.277541816" watchObservedRunningTime="2026-09-14 13:16:21.444003946 +0000 UTC m=+1101.280512780"
Sep 14 13:16:27.414903 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.414850    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:16:27.418595 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.418571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.421646 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.421623    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"premium-w4-5cedb0-kserve-self-signed-certs\""
Sep 14 13:16:27.432507 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.432481    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:16:27.462835 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.462807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.462940 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.462841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.462940 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.462867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.463018 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.462968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.463018 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.462997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tth2n\" (UniqueName: \"kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.463018 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.463014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564155 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564287 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564287 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564287 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564287 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tth2n\" (UniqueName: \"kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564617 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564665 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.564731 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.564669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.566465 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.566446    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.566732 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.566715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.573214 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.573191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tth2n\" (UniqueName: \"kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n\") pod \"premium-w4-5cedb0-kserve-6cd957b7b5-n78k2\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") " pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:27.730574 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:27.730535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:28.008915 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:28.008886    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:16:28.009716 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:16:28.009691    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64e4d92a_3611_4d7a_9336_52fca7223853.slice/crio-72072266b0b8e67fe49deb91f5950746b3b093921fc4b4bcda870eae810ef705 WatchSource:0}: Error finding container 72072266b0b8e67fe49deb91f5950746b3b093921fc4b4bcda870eae810ef705: Status 404 returned error can't find the container with id 72072266b0b8e67fe49deb91f5950746b3b093921fc4b4bcda870eae810ef705
Sep 14 13:16:28.435202 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:28.435113    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" event={"ID":"64e4d92a-3611-4d7a-9336-52fca7223853","Type":"ContainerStarted","Data":"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"}
Sep 14 13:16:28.435202 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:28.435161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" event={"ID":"64e4d92a-3611-4d7a-9336-52fca7223853","Type":"ContainerStarted","Data":"72072266b0b8e67fe49deb91f5950746b3b093921fc4b4bcda870eae810ef705"}
Sep 14 13:16:28.455156 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:28.455107    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" podStartSLOduration=1.455090646 podStartE2EDuration="1.455090646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:28.453289755 +0000 UTC m=+1108.289798591" watchObservedRunningTime="2026-09-14 13:16:28.455090646 +0000 UTC m=+1108.291599480"
Sep 14 13:16:28.697400 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:28.697322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:16:30.480976 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:30.480944    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:30.481350 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:30.481206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:30.493242 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:30.493216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:31.478257 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:31.478206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:16:37.497578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.497541    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:16:37.501243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.501227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.504482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.504460    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-809356\"/\"default-dockercfg-22mt8\""
Sep 14 13:16:37.505865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.505843    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-809356\"/\"kube-root-ca.crt\""
Sep 14 13:16:37.505984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.505855    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-809356\"/\"openshift-service-ca.crt\""
Sep 14 13:16:37.505984 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.505930    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-809356\"/\"test-model-809356-kserve-self-signed-certs\""
Sep 14 13:16:37.515091 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.515064    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:16:37.561067 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.561267 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.561267 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tr5z\" (UniqueName: \"kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.561267 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.561267 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.561510 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.561318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662181 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tr5z\" (UniqueName: \"kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662692 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662770 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.662770 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.662756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.664783 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.664759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.665382 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.665354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.684372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.684340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tr5z\" (UniqueName: \"kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z\") pod \"test-model-809356-kserve-85dcf9cfcf-bzvv7\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") " pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:37.731341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.731308    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:37.731518 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.731357    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:37.744182 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.744151    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:37.811751 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:37.811664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:38.100190 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:38.100160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:16:38.101135 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:16:38.101110    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab314408_60bc_496f_9459_3cb786e543b2.slice/crio-7e87006603ef7f712657c8fc75bb0ddf9af2deccb1f28639f7b69997b1a023dd WatchSource:0}: Error finding container 7e87006603ef7f712657c8fc75bb0ddf9af2deccb1f28639f7b69997b1a023dd: Status 404 returned error can't find the container with id 7e87006603ef7f712657c8fc75bb0ddf9af2deccb1f28639f7b69997b1a023dd
Sep 14 13:16:38.500766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:38.500723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" event={"ID":"ab314408-60bc-496f-9459-3cb786e543b2","Type":"ContainerStarted","Data":"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"}
Sep 14 13:16:38.501309 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:38.500772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" event={"ID":"ab314408-60bc-496f-9459-3cb786e543b2","Type":"ContainerStarted","Data":"7e87006603ef7f712657c8fc75bb0ddf9af2deccb1f28639f7b69997b1a023dd"}
Sep 14 13:16:38.512327 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:38.512303    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:16:38.665643 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:38.665586    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" podStartSLOduration=1.665570077 podStartE2EDuration="1.665570077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:16:38.660296916 +0000 UTC m=+1118.496805752" watchObservedRunningTime="2026-09-14 13:16:38.665570077 +0000 UTC m=+1118.502078911"
Sep 14 13:16:47.812210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:47.812176    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:47.812210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:47.812216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:47.824607 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:47.824580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:16:48.511261 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:48.511225    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:16:48.574303 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:16:48.574267    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:17:17.005936 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:17:17.005894    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:17:44.992075 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:17:44.992040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:18:00.704083 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:00.704052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:18:00.708279 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:00.708252    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:18:13.914307 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:13.914271    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:18:42.724982 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.724944    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:18:42.728698 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.728677    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.731728 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.731707    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-7f78b4-serving-cert\""
Sep 14 13:18:42.742102 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.742078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:18:42.888955 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.888919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.889151 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.889055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5s8k\" (UniqueName: \"kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.889151 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.889107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.889151 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.889138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.990260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.990164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5s8k\" (UniqueName: \"kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.990260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.990216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.990457 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.990336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.990457 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.990423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.990582 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:18:42.990561    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-serving-cert: secret "maas-api-e2e-shared-b-w2-7f78b4-serving-cert" not found
Sep 14 13:18:42.990644 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:18:42.990634    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls podName:9f9296c1-bce4-4047-8f8d-ab548bc4d4ea nodeName:}" failed. No retries permitted until 2026-09-14 13:18:43.490618553 +0000 UTC m=+1243.327127369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" (UID: "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea") : secret "maas-api-e2e-shared-b-w2-7f78b4-serving-cert" not found
Sep 14 13:18:42.991025 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.991009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:42.992616 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:42.992594    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:43.000228 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:43.000203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5s8k\" (UniqueName: \"kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:43.496445 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:43.496400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:43.498997 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:43.498974    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:43.640448 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:43.640410    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:43.919120 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:43.919091    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:18:43.920147 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:18:43.920111    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9296c1_bce4_4047_8f8d_ab548bc4d4ea.slice/crio-6f317c389f4230d4dfc926f2cd729f2b2c5dceb1b339a604660df80d1a54cf2b WatchSource:0}: Error finding container 6f317c389f4230d4dfc926f2cd729f2b2c5dceb1b339a604660df80d1a54cf2b: Status 404 returned error can't find the container with id 6f317c389f4230d4dfc926f2cd729f2b2c5dceb1b339a604660df80d1a54cf2b
Sep 14 13:18:44.236754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:44.236711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" event={"ID":"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea","Type":"ContainerStarted","Data":"6f317c389f4230d4dfc926f2cd729f2b2c5dceb1b339a604660df80d1a54cf2b"}
Sep 14 13:18:45.243730 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.243695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" event={"ID":"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea","Type":"ContainerStarted","Data":"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"}
Sep 14 13:18:45.244136 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.243818    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:45.292181 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.292127    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" podStartSLOduration=2.83722639 podStartE2EDuration="3.292109289s" totalImagesPullingTime="454.882899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:18:45.290319429 +0000 UTC m=+1245.126828266" watchObservedRunningTime="2026-09-14 13:18:45.292109289 +0000 UTC m=+1245.128618123"
Sep 14 13:18:45.530705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.530616    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:18:45.530856 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.530818    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" podUID="24315da2-9827-4326-8aab-b3cce4d37176" containerName="maas-api" containerID="cri-o://330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293" gracePeriod=30
Sep 14 13:18:45.784931 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.784841    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:18:45.922763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.922726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs\") pod \"24315da2-9827-4326-8aab-b3cce4d37176\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") "
Sep 14 13:18:45.922763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.922766    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca\") pod \"24315da2-9827-4326-8aab-b3cce4d37176\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") "
Sep 14 13:18:45.923007 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.922932    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdqvj\" (UniqueName: \"kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj\") pod \"24315da2-9827-4326-8aab-b3cce4d37176\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") "
Sep 14 13:18:45.923007 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.922967    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") pod \"24315da2-9827-4326-8aab-b3cce4d37176\" (UID: \"24315da2-9827-4326-8aab-b3cce4d37176\") "
Sep 14 13:18:45.923253 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.923227    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24315da2-9827-4326-8aab-b3cce4d37176" (UID: "24315da2-9827-4326-8aab-b3cce4d37176"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:18:45.923352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.923339    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24315da2-9827-4326-8aab-b3cce4d37176-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:18:45.925107 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.925079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24315da2-9827-4326-8aab-b3cce4d37176" (UID: "24315da2-9827-4326-8aab-b3cce4d37176"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:18:45.925243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.925134    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj" (OuterVolumeSpecName: "kube-api-access-sdqvj") pod "24315da2-9827-4326-8aab-b3cce4d37176" (UID: "24315da2-9827-4326-8aab-b3cce4d37176"). InnerVolumeSpecName "kube-api-access-sdqvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:18:45.925243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:45.925207    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "24315da2-9827-4326-8aab-b3cce4d37176" (UID: "24315da2-9827-4326-8aab-b3cce4d37176"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:18:46.023960 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.023925    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdqvj\" (UniqueName: \"kubernetes.io/projected/24315da2-9827-4326-8aab-b3cce4d37176-kube-api-access-sdqvj\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.023960 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.023955    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.023960 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.023965    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24315da2-9827-4326-8aab-b3cce4d37176-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:18:46.252280 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.252241    2559 generic.go:356] "Generic (PLEG): container finished" podID="24315da2-9827-4326-8aab-b3cce4d37176" containerID="330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293" exitCode=0
Sep 14 13:18:46.252704 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.252305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"
Sep 14 13:18:46.252704 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.252321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" event={"ID":"24315da2-9827-4326-8aab-b3cce4d37176","Type":"ContainerDied","Data":"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"}
Sep 14 13:18:46.252704 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.252380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx" event={"ID":"24315da2-9827-4326-8aab-b3cce4d37176","Type":"ContainerDied","Data":"db330f619ad6cc3db1ed350f168d54e5feb4cdf52a9cffbcffc9212f58fe2b80"}
Sep 14 13:18:46.252704 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.252413    2559 scope.go:117] "RemoveContainer" containerID="330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"
Sep 14 13:18:46.263315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.263294    2559 scope.go:117] "RemoveContainer" containerID="330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"
Sep 14 13:18:46.263594 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:18:46.263577    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293\": container with ID starting with 330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293 not found: ID does not exist" containerID="330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"
Sep 14 13:18:46.263666 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.263602    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293"} err="failed to get container status \"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293\": rpc error: code = NotFound desc = could not find container \"330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293\": container with ID starting with 330be528d4ef51db3bedc1081611550187de1d479d69cc6d8731bcf6a03c3293 not found: ID does not exist"
Sep 14 13:18:46.361146 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.361108    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:18:46.363580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.363559    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-55cb42-5b67c556bf-h4qgx"]
Sep 14 13:18:46.683070 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:46.682994    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24315da2-9827-4326-8aab-b3cce4d37176" path="/var/lib/kubelet/pods/24315da2-9827-4326-8aab-b3cce4d37176/volumes"
Sep 14 13:18:51.258460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:51.258431    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:18:53.693598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:18:53.693519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:19:06.440552 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.440513    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7887-415c61"]
Sep 14 13:19:06.440973 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.440953    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24315da2-9827-4326-8aab-b3cce4d37176" containerName="maas-api"
Sep 14 13:19:06.440973 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.440966    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24315da2-9827-4326-8aab-b3cce4d37176" containerName="maas-api"
Sep 14 13:19:06.441068 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.441058    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24315da2-9827-4326-8aab-b3cce4d37176" containerName="maas-api"
Sep 14 13:19:06.445314 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.445298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:06.449143 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.449113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sh8vw\""
Sep 14 13:19:06.451842 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.451816    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-415c61"]
Sep 14 13:19:06.541562 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.541525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmf8h\" (UniqueName: \"kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h\") pod \"test-curl-7887-415c61\" (UID: \"e9565e8c-88b7-422c-bfb6-768755e19065\") " pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:06.642783 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.642738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmf8h\" (UniqueName: \"kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h\") pod \"test-curl-7887-415c61\" (UID: \"e9565e8c-88b7-422c-bfb6-768755e19065\") " pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:06.652394 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.652370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmf8h\" (UniqueName: \"kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h\") pod \"test-curl-7887-415c61\" (UID: \"e9565e8c-88b7-422c-bfb6-768755e19065\") " pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:06.756142 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:06.756108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:07.031714 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:07.031688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-415c61"]
Sep 14 13:19:07.033241 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:07.033209    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9565e8c_88b7_422c_bfb6_768755e19065.slice/crio-31679415a8c9f7dd2cb34837196666e867b78490adac06b29ed3bf31af6d8ba5 WatchSource:0}: Error finding container 31679415a8c9f7dd2cb34837196666e867b78490adac06b29ed3bf31af6d8ba5: Status 404 returned error can't find the container with id 31679415a8c9f7dd2cb34837196666e867b78490adac06b29ed3bf31af6d8ba5
Sep 14 13:19:07.383274 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:07.383181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-415c61" event={"ID":"e9565e8c-88b7-422c-bfb6-768755e19065","Type":"ContainerStarted","Data":"93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620"}
Sep 14 13:19:07.383274 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:07.383229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-415c61" event={"ID":"e9565e8c-88b7-422c-bfb6-768755e19065","Type":"ContainerStarted","Data":"31679415a8c9f7dd2cb34837196666e867b78490adac06b29ed3bf31af6d8ba5"}
Sep 14 13:19:07.401531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:07.401473    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7887-415c61" podStartSLOduration=1.401458716 podStartE2EDuration="1.401458716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:07.399323555 +0000 UTC m=+1267.235832390" watchObservedRunningTime="2026-09-14 13:19:07.401458716 +0000 UTC m=+1267.237967551"
Sep 14 13:19:08.185954 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.185845    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7887-415c61"]
Sep 14 13:19:08.192944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.192910    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7887-415c61"]
Sep 14 13:19:08.324997 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.324960    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7887-71bf77"]
Sep 14 13:19:08.325378 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.325364    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" containerName="test-curl-7887-415c61"
Sep 14 13:19:08.325436 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.325381    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" containerName="test-curl-7887-415c61"
Sep 14 13:19:08.325469 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.325450    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" containerName="test-curl-7887-415c61"
Sep 14 13:19:08.328505 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.328489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:08.348572 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.348538    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-71bf77"]
Sep 14 13:19:08.389851 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:08.389821    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7887-415c61" container="test-curl-7887-415c61"
Sep 14 13:19:08.462470 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.462441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gx7f\" (UniqueName: \"kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f\") pod \"test-curl-7887-71bf77\" (UID: \"0d242518-04a8-4183-9b09-4ba1083723de\") " pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:08.563911 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.563853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gx7f\" (UniqueName: \"kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f\") pod \"test-curl-7887-71bf77\" (UID: \"0d242518-04a8-4183-9b09-4ba1083723de\") " pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:08.573760 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.573723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gx7f\" (UniqueName: \"kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f\") pod \"test-curl-7887-71bf77\" (UID: \"0d242518-04a8-4183-9b09-4ba1083723de\") " pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:08.638021 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.637992    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:08.922362 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:08.922273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-71bf77"]
Sep 14 13:19:08.926173 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:08.926143    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d242518_04a8_4183_9b09_4ba1083723de.slice/crio-e545c222cd243d3ef662db9ae40c548ec842d23960aa48690419691413a33143 WatchSource:0}: Error finding container e545c222cd243d3ef662db9ae40c548ec842d23960aa48690419691413a33143: Status 404 returned error can't find the container with id e545c222cd243d3ef662db9ae40c548ec842d23960aa48690419691413a33143
Sep 14 13:19:09.397887 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:09.397832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-71bf77" event={"ID":"0d242518-04a8-4183-9b09-4ba1083723de","Type":"ContainerStarted","Data":"7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d"}
Sep 14 13:19:09.398295 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:09.397899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-71bf77" event={"ID":"0d242518-04a8-4183-9b09-4ba1083723de","Type":"ContainerStarted","Data":"e545c222cd243d3ef662db9ae40c548ec842d23960aa48690419691413a33143"}
Sep 14 13:19:09.398295 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:09.397920    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7887-415c61" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" containerName="test-curl-7887-415c61" containerID="cri-o://93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620" gracePeriod=2
Sep 14 13:19:09.424454 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:09.424404    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7887-71bf77" podStartSLOduration=1.424386473 podStartE2EDuration="1.424386473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:09.421807074 +0000 UTC m=+1269.258315908" watchObservedRunningTime="2026-09-14 13:19:09.424386473 +0000 UTC m=+1269.260895307"
Sep 14 13:19:10.202843 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.202752    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7887-71bf77"]
Sep 14 13:19:10.212290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.212254    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7887-71bf77"]
Sep 14 13:19:10.340393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.340354    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7887-0a9275"]
Sep 14 13:19:10.340806 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.340785    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d242518-04a8-4183-9b09-4ba1083723de" containerName="test-curl-7887-71bf77"
Sep 14 13:19:10.340806 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.340803    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d242518-04a8-4183-9b09-4ba1083723de" containerName="test-curl-7887-71bf77"
Sep 14 13:19:10.341039 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.340912    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d242518-04a8-4183-9b09-4ba1083723de" containerName="test-curl-7887-71bf77"
Sep 14 13:19:10.344038 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.344018    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:10.357661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.357632    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-0a9275"]
Sep 14 13:19:10.405050 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:10.405016    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7887-71bf77" container="test-curl-7887-71bf77"
Sep 14 13:19:10.485814 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.485783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs988\" (UniqueName: \"kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988\") pod \"test-curl-7887-0a9275\" (UID: \"b5133289-bd0b-48e6-98ca-c3e6ca37719d\") " pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:10.587108 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.587052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs988\" (UniqueName: \"kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988\") pod \"test-curl-7887-0a9275\" (UID: \"b5133289-bd0b-48e6-98ca-c3e6ca37719d\") " pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:10.600417 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.600393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs988\" (UniqueName: \"kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988\") pod \"test-curl-7887-0a9275\" (UID: \"b5133289-bd0b-48e6-98ca-c3e6ca37719d\") " pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:10.653206 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.653176    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:10.938055 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:10.938025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-0a9275"]
Sep 14 13:19:10.939121 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:10.939096    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5133289_bd0b_48e6_98ca_c3e6ca37719d.slice/crio-329013a4cff21540f402e5a273c49f7f5e5b5531f07bf57929a2e7f6642666ab WatchSource:0}: Error finding container 329013a4cff21540f402e5a273c49f7f5e5b5531f07bf57929a2e7f6642666ab: Status 404 returned error can't find the container with id 329013a4cff21540f402e5a273c49f7f5e5b5531f07bf57929a2e7f6642666ab
Sep 14 13:19:11.412636 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.412596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-0a9275" event={"ID":"b5133289-bd0b-48e6-98ca-c3e6ca37719d","Type":"ContainerStarted","Data":"33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e"}
Sep 14 13:19:11.412999 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.412653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-0a9275" event={"ID":"b5133289-bd0b-48e6-98ca-c3e6ca37719d","Type":"ContainerStarted","Data":"329013a4cff21540f402e5a273c49f7f5e5b5531f07bf57929a2e7f6642666ab"}
Sep 14 13:19:11.412999 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.412754    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7887-71bf77" podUID="0d242518-04a8-4183-9b09-4ba1083723de" containerName="test-curl-7887-71bf77" containerID="cri-o://7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d" gracePeriod=2
Sep 14 13:19:11.444676 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.444624    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7887-0a9275" podStartSLOduration=1.444608636 podStartE2EDuration="1.444608636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:11.442239001 +0000 UTC m=+1271.278747816" watchObservedRunningTime="2026-09-14 13:19:11.444608636 +0000 UTC m=+1271.281117521"
Sep 14 13:19:11.568703 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.568678    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:11.697278 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.697191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmf8h\" (UniqueName: \"kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h\") pod \"e9565e8c-88b7-422c-bfb6-768755e19065\" (UID: \"e9565e8c-88b7-422c-bfb6-768755e19065\") "
Sep 14 13:19:11.699386 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.699357    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h" (OuterVolumeSpecName: "kube-api-access-tmf8h") pod "e9565e8c-88b7-422c-bfb6-768755e19065" (UID: "e9565e8c-88b7-422c-bfb6-768755e19065"). InnerVolumeSpecName "kube-api-access-tmf8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:19:11.798431 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:11.798393    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmf8h\" (UniqueName: \"kubernetes.io/projected/e9565e8c-88b7-422c-bfb6-768755e19065-kube-api-access-tmf8h\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:19:12.143597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.143560    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7887-0a9275"]
Sep 14 13:19:12.151330 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.151299    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7887-0a9275"]
Sep 14 13:19:12.287797 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.287759    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7887-d7c424"]
Sep 14 13:19:12.288202 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.288189    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" containerName="test-curl-7887-0a9275"
Sep 14 13:19:12.288246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.288204    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" containerName="test-curl-7887-0a9275"
Sep 14 13:19:12.288297 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.288269    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" containerName="test-curl-7887-0a9275"
Sep 14 13:19:12.291447 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.291431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:12.305860 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.305833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-d7c424"]
Sep 14 13:19:12.405300 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.405213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbkwj\" (UniqueName: \"kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj\") pod \"test-curl-7887-d7c424\" (UID: \"ea8f20e9-4955-4800-b253-a14d988f1231\") " pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:12.419222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.419188    2559 generic.go:356] "Generic (PLEG): container finished" podID="e9565e8c-88b7-422c-bfb6-768755e19065" containerID="93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620" exitCode=137
Sep 14 13:19:12.419629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.419236    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:12.419629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.419288    2559 scope.go:117] "RemoveContainer" containerID="93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620"
Sep 14 13:19:12.419629 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:12.419493    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7887-0a9275" container="test-curl-7887-0a9275"
Sep 14 13:19:12.429708 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.429690    2559 scope.go:117] "RemoveContainer" containerID="93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620"
Sep 14 13:19:12.430010 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:12.429993    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620\": container with ID starting with 93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620 not found: ID does not exist" containerID="93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620"
Sep 14 13:19:12.430071 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.430022    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620"} err="failed to get container status \"93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620\": rpc error: code = NotFound desc = could not find container \"93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620\": container with ID starting with 93e1695f4812d0ddee3142e6fc1f3ab07a386ad051c8d8a64d9994c5438a2620 not found: ID does not exist"
Sep 14 13:19:12.432395 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:12.432377    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7887-415c61\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" pod="opendatahub/test-curl-7887-415c61"
Sep 14 13:19:12.506611 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.506574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbkwj\" (UniqueName: \"kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj\") pod \"test-curl-7887-d7c424\" (UID: \"ea8f20e9-4955-4800-b253-a14d988f1231\") " pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:12.517821 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.517784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbkwj\" (UniqueName: \"kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj\") pod \"test-curl-7887-d7c424\" (UID: \"ea8f20e9-4955-4800-b253-a14d988f1231\") " pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:12.600374 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.600335    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:12.685087 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.685057    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9565e8c-88b7-422c-bfb6-768755e19065" path="/var/lib/kubelet/pods/e9565e8c-88b7-422c-bfb6-768755e19065/volumes"
Sep 14 13:19:12.876988 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:12.876949    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7887-d7c424"]
Sep 14 13:19:12.880028 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:12.879998    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea8f20e9_4955_4800_b253_a14d988f1231.slice/crio-3a47dc468844d139385673b8ff0fc4e9a90b7b2115a9b44e3b38d3269a358e2c WatchSource:0}: Error finding container 3a47dc468844d139385673b8ff0fc4e9a90b7b2115a9b44e3b38d3269a358e2c: Status 404 returned error can't find the container with id 3a47dc468844d139385673b8ff0fc4e9a90b7b2115a9b44e3b38d3269a358e2c
Sep 14 13:19:13.427358 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.427322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-d7c424" event={"ID":"ea8f20e9-4955-4800-b253-a14d988f1231","Type":"ContainerStarted","Data":"2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840"}
Sep 14 13:19:13.427738 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.427374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7887-d7c424" event={"ID":"ea8f20e9-4955-4800-b253-a14d988f1231","Type":"ContainerStarted","Data":"3a47dc468844d139385673b8ff0fc4e9a90b7b2115a9b44e3b38d3269a358e2c"}
Sep 14 13:19:13.428510 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.428482    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7887-0a9275" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" containerName="test-curl-7887-0a9275" containerID="cri-o://33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e" gracePeriod=2
Sep 14 13:19:13.448057 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.448003    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7887-d7c424" podStartSLOduration=1.447986469 podStartE2EDuration="1.447986469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:13.447430428 +0000 UTC m=+1273.283939263" watchObservedRunningTime="2026-09-14 13:19:13.447986469 +0000 UTC m=+1273.284495302"
Sep 14 13:19:13.572766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.572741    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:13.718324 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.718290    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gx7f\" (UniqueName: \"kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f\") pod \"0d242518-04a8-4183-9b09-4ba1083723de\" (UID: \"0d242518-04a8-4183-9b09-4ba1083723de\") "
Sep 14 13:19:13.720338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.720308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f" (OuterVolumeSpecName: "kube-api-access-9gx7f") pod "0d242518-04a8-4183-9b09-4ba1083723de" (UID: "0d242518-04a8-4183-9b09-4ba1083723de"). InnerVolumeSpecName "kube-api-access-9gx7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:19:13.820236 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:13.820195    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gx7f\" (UniqueName: \"kubernetes.io/projected/0d242518-04a8-4183-9b09-4ba1083723de-kube-api-access-9gx7f\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:19:14.114800 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.114710    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7887-d7c424"]
Sep 14 13:19:14.124115 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.124086    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7887-d7c424"]
Sep 14 13:19:14.435143 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.435057    2559 generic.go:356] "Generic (PLEG): container finished" podID="0d242518-04a8-4183-9b09-4ba1083723de" containerID="7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d" exitCode=137
Sep 14 13:19:14.435143 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.435114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:14.435578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.435153    2559 scope.go:117] "RemoveContainer" containerID="7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d"
Sep 14 13:19:14.435578 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:14.435426    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7887-d7c424" container="test-curl-7887-d7c424"
Sep 14 13:19:14.444630 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.444611    2559 scope.go:117] "RemoveContainer" containerID="7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d"
Sep 14 13:19:14.444946 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:14.444925    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d\": container with ID starting with 7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d not found: ID does not exist" containerID="7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d"
Sep 14 13:19:14.444991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.444958    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d"} err="failed to get container status \"7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d\": rpc error: code = NotFound desc = could not find container \"7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d\": container with ID starting with 7ba07eae9b5c6b23cded5b5699d25a926eaed6e05347df9826872c8187dea50d not found: ID does not exist"
Sep 14 13:19:14.446108 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:14.446085    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7887-71bf77\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="0d242518-04a8-4183-9b09-4ba1083723de" pod="opendatahub/test-curl-7887-71bf77"
Sep 14 13:19:14.683232 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:14.683198    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d242518-04a8-4183-9b09-4ba1083723de" path="/var/lib/kubelet/pods/0d242518-04a8-4183-9b09-4ba1083723de/volumes"
Sep 14 13:19:15.443793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:15.443766    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7887-d7c424" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" containerName="test-curl-7887-d7c424" containerID="cri-o://2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840" gracePeriod=2
Sep 14 13:19:15.615017 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:15.614993    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:15.739462 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:15.739426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs988\" (UniqueName: \"kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988\") pod \"b5133289-bd0b-48e6-98ca-c3e6ca37719d\" (UID: \"b5133289-bd0b-48e6-98ca-c3e6ca37719d\") "
Sep 14 13:19:15.741626 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:15.741592    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988" (OuterVolumeSpecName: "kube-api-access-cs988") pod "b5133289-bd0b-48e6-98ca-c3e6ca37719d" (UID: "b5133289-bd0b-48e6-98ca-c3e6ca37719d"). InnerVolumeSpecName "kube-api-access-cs988". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:19:15.840862 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:15.840819    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs988\" (UniqueName: \"kubernetes.io/projected/b5133289-bd0b-48e6-98ca-c3e6ca37719d-kube-api-access-cs988\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:19:16.454132 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.454096    2559 generic.go:356] "Generic (PLEG): container finished" podID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" containerID="33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e" exitCode=137
Sep 14 13:19:16.454620 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.454142    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:16.454620 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.454147    2559 scope.go:117] "RemoveContainer" containerID="33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e"
Sep 14 13:19:16.463920 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.463894    2559 scope.go:117] "RemoveContainer" containerID="33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e"
Sep 14 13:19:16.464203 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:16.464185    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e\": container with ID starting with 33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e not found: ID does not exist" containerID="33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e"
Sep 14 13:19:16.464259 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.464212    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e"} err="failed to get container status \"33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e\": rpc error: code = NotFound desc = could not find container \"33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e\": container with ID starting with 33f66e06ee60ed91c412eebe4f7fff80658a39a542260474cd19db8c86e1676e not found: ID does not exist"
Sep 14 13:19:16.468309 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:16.468287    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7887-0a9275\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" pod="opendatahub/test-curl-7887-0a9275"
Sep 14 13:19:16.683373 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:16.683329    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5133289-bd0b-48e6-98ca-c3e6ca37719d" path="/var/lib/kubelet/pods/b5133289-bd0b-48e6-98ca-c3e6ca37719d/volumes"
Sep 14 13:19:17.640120 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:17.640095    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:17.768196 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:17.768165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbkwj\" (UniqueName: \"kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj\") pod \"ea8f20e9-4955-4800-b253-a14d988f1231\" (UID: \"ea8f20e9-4955-4800-b253-a14d988f1231\") "
Sep 14 13:19:17.770315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:17.770294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj" (OuterVolumeSpecName: "kube-api-access-lbkwj") pod "ea8f20e9-4955-4800-b253-a14d988f1231" (UID: "ea8f20e9-4955-4800-b253-a14d988f1231"). InnerVolumeSpecName "kube-api-access-lbkwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:19:17.869632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:17.869594    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbkwj\" (UniqueName: \"kubernetes.io/projected/ea8f20e9-4955-4800-b253-a14d988f1231-kube-api-access-lbkwj\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:19:18.470135 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.470100    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea8f20e9-4955-4800-b253-a14d988f1231" containerID="2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840" exitCode=137
Sep 14 13:19:18.470338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.470142    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:18.470338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.470183    2559 scope.go:117] "RemoveContainer" containerID="2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840"
Sep 14 13:19:18.486973 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:18.486930    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7887-d7c424\" is forbidden: User \"system:node:ip-10-0-137-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-35.ec2.internal' and this object" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" pod="opendatahub/test-curl-7887-d7c424"
Sep 14 13:19:18.488606 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.488589    2559 scope.go:117] "RemoveContainer" containerID="2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840"
Sep 14 13:19:18.488936 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:19:18.488913    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840\": container with ID starting with 2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840 not found: ID does not exist" containerID="2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840"
Sep 14 13:19:18.489015 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.488950    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840"} err="failed to get container status \"2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840\": rpc error: code = NotFound desc = could not find container \"2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840\": container with ID starting with 2582eb449f8bbf88137a965811f9f91a428863d2080556492d30285404fdf840 not found: ID does not exist"
Sep 14 13:19:18.683943 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:18.683911    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" path="/var/lib/kubelet/pods/ea8f20e9-4955-4800-b253-a14d988f1231/volumes"
Sep 14 13:19:20.629333 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.629293    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:19:20.629790 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.629689    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" containerName="test-curl-7887-d7c424"
Sep 14 13:19:20.629790 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.629700    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" containerName="test-curl-7887-d7c424"
Sep 14 13:19:20.629790 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.629778    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8f20e9-4955-4800-b253-a14d988f1231" containerName="test-curl-7887-d7c424"
Sep 14 13:19:20.634296 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.634273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.638789 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.638766    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"distinct-w0-aea349-kserve-self-signed-certs\""
Sep 14 13:19:20.664234 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.664201    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:19:20.800290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.800290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.800508 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.800508 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.800508 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lls5\" (UniqueName: \"kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.800610 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.800527    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.901950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.901855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lls5\" (UniqueName: \"kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.901950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.901931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.901988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902414 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902483 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.902483 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.902466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.904484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.904458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.904667 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.904645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.915453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.915430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lls5\" (UniqueName: \"kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5\") pod \"distinct-w0-aea349-kserve-6b47c495f8-n86z9\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:20.943356 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:20.943324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:21.234454 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:21.234424    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67163dc8_4810_440d_82a8_9065dae51501.slice/crio-61290af5446fe5effe39bac732fb93a74aae23d36db9162e5f51b5dcc205ca50 WatchSource:0}: Error finding container 61290af5446fe5effe39bac732fb93a74aae23d36db9162e5f51b5dcc205ca50: Status 404 returned error can't find the container with id 61290af5446fe5effe39bac732fb93a74aae23d36db9162e5f51b5dcc205ca50
Sep 14 13:19:21.235370 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:21.235338    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:19:21.491632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:21.491540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" event={"ID":"67163dc8-4810-440d-82a8-9065dae51501","Type":"ContainerStarted","Data":"c76675ef020976bb4c56ed1616b7825f9071acf7fb5b72081a4aea4d1c775faa"}
Sep 14 13:19:21.491632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:21.491591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" event={"ID":"67163dc8-4810-440d-82a8-9065dae51501","Type":"ContainerStarted","Data":"61290af5446fe5effe39bac732fb93a74aae23d36db9162e5f51b5dcc205ca50"}
Sep 14 13:19:26.119808 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.119735    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" podStartSLOduration=6.119711202 podStartE2EDuration="6.119711202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:21.523038015 +0000 UTC m=+1281.359546860" watchObservedRunningTime="2026-09-14 13:19:26.119711202 +0000 UTC m=+1285.956220037"
Sep 14 13:19:26.122416 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.122392    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:19:26.126296 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.126272    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.130804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.130780    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-92d7d8db-serving-cert\""
Sep 14 13:19:26.139443 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.139413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:19:26.148128 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.148090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88n76\" (UniqueName: \"kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.148261 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.148156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.148261 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.148204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.148334 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.148271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.249580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.249542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88n76\" (UniqueName: \"kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.249812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.249629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.249812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.249697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.249812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.249766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.250457 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.250427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.252483 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.252460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.252577 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.252499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.262701 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.262674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88n76\" (UniqueName: \"kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76\") pod \"maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.437766 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.437675    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:26.731657 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:26.731620    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:19:26.734478 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:26.734451    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342927fc_ed2f_4b0a_9efa_fb7bdcb92f1a.slice/crio-31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d WatchSource:0}: Error finding container 31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d: Status 404 returned error can't find the container with id 31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d
Sep 14 13:19:27.529737 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:27.529695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" event={"ID":"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a","Type":"ContainerStarted","Data":"18d0d97ae85c408b624fb21a30083d41de4e492871d11663820d2344a0be909f"}
Sep 14 13:19:27.530223 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:27.529787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" event={"ID":"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a","Type":"ContainerStarted","Data":"31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d"}
Sep 14 13:19:27.530223 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:27.529853    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:27.566329 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:27.566271    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" podStartSLOduration=1.188960024 podStartE2EDuration="1.566256127s" totalImagesPullingTime="377.296103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:27.564795532 +0000 UTC m=+1287.401304365" watchObservedRunningTime="2026-09-14 13:19:27.566256127 +0000 UTC m=+1287.402764961"
Sep 14 13:19:28.808760 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:28.808717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:19:30.944070 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:30.944017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:30.944472 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:30.944107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:30.956852 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:30.956820    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:31.572618 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:31.572581    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:19:33.541528 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:33.541500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:19:47.623035 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.622995    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:19:47.626937 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.626912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.636380 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.636359    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-045282\"/\"openshift-service-ca.crt\""
Sep 14 13:19:47.637663 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.637641    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-045282\"/\"kube-root-ca.crt\""
Sep 14 13:19:47.637772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.637661    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-045282\"/\"noten-model-045282-kserve-self-signed-certs\""
Sep 14 13:19:47.637772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.637708    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-045282\"/\"default-dockercfg-894wb\""
Sep 14 13:19:47.667042 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.667009    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:19:47.771629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.771812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.771812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cllr\" (UniqueName: \"kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.771933 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.771987 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.771987 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.771983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cllr\" (UniqueName: \"kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873541 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873752 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.873812 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.873726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.875729 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.875706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.876004 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.875987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.883847 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.883820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cllr\" (UniqueName: \"kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr\") pod \"noten-model-045282-kserve-5d5cbf548c-nk29s\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") " pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:47.937482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:47.937434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:48.221454 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:48.221423    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:19:48.222974 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:19:48.222942    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61148b73_c61b_4599_986b_7d7371864641.slice/crio-8b7d992a3e7a0ff155d7ec5c0796c61bdd4b3d48a7e6b80d827d400dc74c3f03 WatchSource:0}: Error finding container 8b7d992a3e7a0ff155d7ec5c0796c61bdd4b3d48a7e6b80d827d400dc74c3f03: Status 404 returned error can't find the container with id 8b7d992a3e7a0ff155d7ec5c0796c61bdd4b3d48a7e6b80d827d400dc74c3f03
Sep 14 13:19:48.668725 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:48.668623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" event={"ID":"61148b73-c61b-4599-986b-7d7371864641","Type":"ContainerStarted","Data":"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"}
Sep 14 13:19:48.668725 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:48.668675    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" event={"ID":"61148b73-c61b-4599-986b-7d7371864641","Type":"ContainerStarted","Data":"8b7d992a3e7a0ff155d7ec5c0796c61bdd4b3d48a7e6b80d827d400dc74c3f03"}
Sep 14 13:19:48.706571 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:48.706515    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" podStartSLOduration=1.706498441 podStartE2EDuration="1.706498441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:19:48.704743749 +0000 UTC m=+1308.541252584" watchObservedRunningTime="2026-09-14 13:19:48.706498441 +0000 UTC m=+1308.543007274"
Sep 14 13:19:57.937758 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:57.937716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:57.938292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:57.937782    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:57.950514 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:57.950484    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:19:58.740210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:19:58.740180    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:20:06.398103 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:06.398057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:20:18.104066 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:18.104033    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:20:18.123980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:18.123940    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:20:24.935029 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:24.934941    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:20:33.143127 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.143080    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" podUID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" containerName="main" containerID="cri-o://2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f" gracePeriod=45
Sep 14 13:20:33.397173 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.397115    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:20:33.546555 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546524    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546723 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546575    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546723 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546723 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546723 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546695    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmvz2\" (UniqueName: \"kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2\") pod \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\" (UID: \"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1\") "
Sep 14 13:20:33.546926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546857    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:33.546926 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home" (OuterVolumeSpecName: "home") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:33.547114 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.546915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:33.547173 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.547150    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.547173 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.547169    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.547245 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.547178    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.549028 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.548998    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm" (OuterVolumeSpecName: "dshm") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:33.549028 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.548997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:20:33.549176 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.549069    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2" (OuterVolumeSpecName: "kube-api-access-xmvz2") pod "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" (UID: "3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1"). InnerVolumeSpecName "kube-api-access-xmvz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:20:33.648188 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.648110    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.648188 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.648141    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmvz2\" (UniqueName: \"kubernetes.io/projected/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-kube-api-access-xmvz2\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.648188 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.648152    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:33.947099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.947006    2559 generic.go:356] "Generic (PLEG): container finished" podID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" containerID="2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f" exitCode=0
Sep 14 13:20:33.947099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.947048    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"
Sep 14 13:20:33.947292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.947086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" event={"ID":"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1","Type":"ContainerDied","Data":"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"}
Sep 14 13:20:33.947292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.947134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf" event={"ID":"3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1","Type":"ContainerDied","Data":"cd4c87d37a8e2fef07b0ffd34891a568fb7e896af76bec3864adce02fdb07d00"}
Sep 14 13:20:33.947292 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.947151    2559 scope.go:117] "RemoveContainer" containerID="2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"
Sep 14 13:20:33.957472 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.957448    2559 scope.go:117] "RemoveContainer" containerID="2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"
Sep 14 13:20:33.957789 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:20:33.957765    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f\": container with ID starting with 2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f not found: ID does not exist" containerID="2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"
Sep 14 13:20:33.957847 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.957800    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f"} err="failed to get container status \"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f\": rpc error: code = NotFound desc = could not find container \"2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f\": container with ID starting with 2415f7e64e94293f02024c2d1ccf1027e9bbe737929fe13cd612666e7479e34f not found: ID does not exist"
Sep 14 13:20:33.971940 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.971911    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:20:33.976099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:33.976075    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0fcdc6/test-model-0fcdc6-kserve-58d7f54d8f-n6drf"]
Sep 14 13:20:34.684287 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:34.684245    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" path="/var/lib/kubelet/pods/3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1/volumes"
Sep 14 13:20:38.401460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:38.401423    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:20:39.955198 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:39.955159    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" podUID="61148b73-c61b-4599-986b-7d7371864641" containerName="main" containerID="cri-o://d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a" gracePeriod=45
Sep 14 13:20:40.219214 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.219191    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:20:40.318726 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318695    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.318918 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318756    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.318918 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318783    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.318918 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.319093 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.319093 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318980    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home" (OuterVolumeSpecName: "home") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:40.319093 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.318999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cllr\" (UniqueName: \"kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr\") pod \"61148b73-c61b-4599-986b-7d7371864641\" (UID: \"61148b73-c61b-4599-986b-7d7371864641\") "
Sep 14 13:20:40.319093 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.319066    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:40.319093 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.319079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache" (OuterVolumeSpecName: "model-cache") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:40.319450 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.319425    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.319450 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.319446    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.319450 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.319456    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.321171 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.321139    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr" (OuterVolumeSpecName: "kube-api-access-9cllr") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "kube-api-access-9cllr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:20:40.321171 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.321161    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm" (OuterVolumeSpecName: "dshm") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:20:40.321330 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.321242    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "61148b73-c61b-4599-986b-7d7371864641" (UID: "61148b73-c61b-4599-986b-7d7371864641"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:20:40.420262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.420221    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61148b73-c61b-4599-986b-7d7371864641-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.420262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.420256    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cllr\" (UniqueName: \"kubernetes.io/projected/61148b73-c61b-4599-986b-7d7371864641-kube-api-access-9cllr\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.420262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.420268    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61148b73-c61b-4599-986b-7d7371864641-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:40.990465 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.990429    2559 generic.go:356] "Generic (PLEG): container finished" podID="61148b73-c61b-4599-986b-7d7371864641" containerID="d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a" exitCode=0
Sep 14 13:20:40.990901 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.990473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" event={"ID":"61148b73-c61b-4599-986b-7d7371864641","Type":"ContainerDied","Data":"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"}
Sep 14 13:20:40.990901 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.990472    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"
Sep 14 13:20:40.990901 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.990506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s" event={"ID":"61148b73-c61b-4599-986b-7d7371864641","Type":"ContainerDied","Data":"8b7d992a3e7a0ff155d7ec5c0796c61bdd4b3d48a7e6b80d827d400dc74c3f03"}
Sep 14 13:20:40.990901 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:40.990528    2559 scope.go:117] "RemoveContainer" containerID="d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"
Sep 14 13:20:41.002681 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:41.002657    2559 scope.go:117] "RemoveContainer" containerID="d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"
Sep 14 13:20:41.003009 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:20:41.002981    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a\": container with ID starting with d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a not found: ID does not exist" containerID="d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"
Sep 14 13:20:41.003127 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:41.003020    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a"} err="failed to get container status \"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a\": rpc error: code = NotFound desc = could not find container \"d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a\": container with ID starting with d0a962a1ef7d0281e373a3d926f8906ca7e155fa5a8f46cbd232e3cfd184536a not found: ID does not exist"
Sep 14 13:20:41.019779 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:41.019747    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:20:41.024288 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:41.024258    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-045282/noten-model-045282-kserve-5d5cbf548c-nk29s"]
Sep 14 13:20:42.685092 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:42.685053    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61148b73-c61b-4599-986b-7d7371864641" path="/var/lib/kubelet/pods/61148b73-c61b-4599-986b-7d7371864641/volumes"
Sep 14 13:20:50.583745 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:50.583711    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:20:55.057167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.057129    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:20:55.057592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.057326    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerName="maas-api" containerID="cri-o://e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c" gracePeriod=30
Sep 14 13:20:55.122208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.122155    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.51:8443/health\": dial tcp 10.132.0.51:8443: connect: connection refused"
Sep 14 13:20:55.303551 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.303523    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:20:55.362753 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.362685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls\") pod \"865c4e3f-5152-4dc9-b573-6c4832c88e89\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") "
Sep 14 13:20:55.362896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.362758    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca\") pod \"865c4e3f-5152-4dc9-b573-6c4832c88e89\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") "
Sep 14 13:20:55.362896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.362857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcw4z\" (UniqueName: \"kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z\") pod \"865c4e3f-5152-4dc9-b573-6c4832c88e89\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") "
Sep 14 13:20:55.362978 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.362930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs\") pod \"865c4e3f-5152-4dc9-b573-6c4832c88e89\" (UID: \"865c4e3f-5152-4dc9-b573-6c4832c88e89\") "
Sep 14 13:20:55.363148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.363117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "865c4e3f-5152-4dc9-b573-6c4832c88e89" (UID: "865c4e3f-5152-4dc9-b573-6c4832c88e89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:20:55.363306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.363290    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/865c4e3f-5152-4dc9-b573-6c4832c88e89-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:55.364907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.364857    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "865c4e3f-5152-4dc9-b573-6c4832c88e89" (UID: "865c4e3f-5152-4dc9-b573-6c4832c88e89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:20:55.364907 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.364868    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "865c4e3f-5152-4dc9-b573-6c4832c88e89" (UID: "865c4e3f-5152-4dc9-b573-6c4832c88e89"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:20:55.365041 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.364978    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z" (OuterVolumeSpecName: "kube-api-access-xcw4z") pod "865c4e3f-5152-4dc9-b573-6c4832c88e89" (UID: "865c4e3f-5152-4dc9-b573-6c4832c88e89"). InnerVolumeSpecName "kube-api-access-xcw4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:20:55.464702 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.464673    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:55.464702 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.464701    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcw4z\" (UniqueName: \"kubernetes.io/projected/865c4e3f-5152-4dc9-b573-6c4832c88e89-kube-api-access-xcw4z\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:55.464862 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:55.464712    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c4e3f-5152-4dc9-b573-6c4832c88e89-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:20:56.081717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.081684    2559 generic.go:356] "Generic (PLEG): container finished" podID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerID="e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c" exitCode=0
Sep 14 13:20:56.082177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.081729    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"
Sep 14 13:20:56.082177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.081769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" event={"ID":"865c4e3f-5152-4dc9-b573-6c4832c88e89","Type":"ContainerDied","Data":"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"}
Sep 14 13:20:56.082177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.081827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq" event={"ID":"865c4e3f-5152-4dc9-b573-6c4832c88e89","Type":"ContainerDied","Data":"1284fdfddda830c7a55145bbb1f7596fe854d81b4b8f9877e2571b09c8652436"}
Sep 14 13:20:56.082177 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.081849    2559 scope.go:117] "RemoveContainer" containerID="e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"
Sep 14 13:20:56.092104 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.092090    2559 scope.go:117] "RemoveContainer" containerID="e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"
Sep 14 13:20:56.092390 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:20:56.092371    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c\": container with ID starting with e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c not found: ID does not exist" containerID="e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"
Sep 14 13:20:56.092454 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.092421    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c"} err="failed to get container status \"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c\": rpc error: code = NotFound desc = could not find container \"e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c\": container with ID starting with e9999fd8d6f1da2d58ffece87467a90465b6286a5102139da9fd3fa9c9bc7a4c not found: ID does not exist"
Sep 14 13:20:56.107531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.107499    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:20:56.115183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.115162    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-809356-6b4d8d7fc-tqllq"]
Sep 14 13:20:56.684496 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:20:56.684466    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" path="/var/lib/kubelet/pods/865c4e3f-5152-4dc9-b573-6c4832c88e89/volumes"
Sep 14 13:21:05.602993 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.602950    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" podUID="ab314408-60bc-496f-9459-3cb786e543b2" containerName="main" containerID="cri-o://046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4" gracePeriod=45
Sep 14 13:21:05.861140 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.861084    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:21:05.962947 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.962869    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.962958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.962984    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tr5z\" (UniqueName: \"kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963073    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963119 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs\") pod \"ab314408-60bc-496f-9459-3cb786e543b2\" (UID: \"ab314408-60bc-496f-9459-3cb786e543b2\") "
Sep 14 13:21:05.963399 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963161    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:05.963399 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:05.963508 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963399    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home" (OuterVolumeSpecName: "home") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:05.963582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963561    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:05.963634 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963587    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:05.963634 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.963602    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:05.965341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.965316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm" (OuterVolumeSpecName: "dshm") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:21:05.965420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.965321    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:21:05.965420 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:05.965385    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z" (OuterVolumeSpecName: "kube-api-access-8tr5z") pod "ab314408-60bc-496f-9459-3cb786e543b2" (UID: "ab314408-60bc-496f-9459-3cb786e543b2"). InnerVolumeSpecName "kube-api-access-8tr5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:21:06.065003 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.064960    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab314408-60bc-496f-9459-3cb786e543b2-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:06.065003 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.064994    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tr5z\" (UniqueName: \"kubernetes.io/projected/ab314408-60bc-496f-9459-3cb786e543b2-kube-api-access-8tr5z\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:06.065003 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.065008    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab314408-60bc-496f-9459-3cb786e543b2-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:21:06.141000 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.140914    2559 generic.go:356] "Generic (PLEG): container finished" podID="ab314408-60bc-496f-9459-3cb786e543b2" containerID="046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4" exitCode=0
Sep 14 13:21:06.141000 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.140958    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"
Sep 14 13:21:06.141192 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.141004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" event={"ID":"ab314408-60bc-496f-9459-3cb786e543b2","Type":"ContainerDied","Data":"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"}
Sep 14 13:21:06.141192 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.141049    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7" event={"ID":"ab314408-60bc-496f-9459-3cb786e543b2","Type":"ContainerDied","Data":"7e87006603ef7f712657c8fc75bb0ddf9af2deccb1f28639f7b69997b1a023dd"}
Sep 14 13:21:06.141192 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.141067    2559 scope.go:117] "RemoveContainer" containerID="046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"
Sep 14 13:21:06.150804 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.150785    2559 scope.go:117] "RemoveContainer" containerID="046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"
Sep 14 13:21:06.151078 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:21:06.151062    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4\": container with ID starting with 046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4 not found: ID does not exist" containerID="046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"
Sep 14 13:21:06.151131 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.151085    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4"} err="failed to get container status \"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4\": rpc error: code = NotFound desc = could not find container \"046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4\": container with ID starting with 046da96d1531ac0e5e33535c1203b2caea23233f0231abae848fc5d7d17fd3d4 not found: ID does not exist"
Sep 14 13:21:06.168988 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.168955    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:21:06.171582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.171556    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-809356/test-model-809356-kserve-85dcf9cfcf-bzvv7"]
Sep 14 13:21:06.683817 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:06.683784    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab314408-60bc-496f-9459-3cb786e543b2" path="/var/lib/kubelet/pods/ab314408-60bc-496f-9459-3cb786e543b2/volumes"
Sep 14 13:21:09.821911 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:09.821859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:21:12.093367 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093330    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:21:12.093748 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093733    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61148b73-c61b-4599-986b-7d7371864641" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093749    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="61148b73-c61b-4599-986b-7d7371864641" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093766    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093771    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093777    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab314408-60bc-496f-9459-3cb786e543b2" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093782    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab314408-60bc-496f-9459-3cb786e543b2" containerName="main"
Sep 14 13:21:12.093793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093795    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerName="maas-api"
Sep 14 13:21:12.094148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093800    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerName="maas-api"
Sep 14 13:21:12.094148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093867    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e94bb59-2d0c-4c02-a7f7-49e3a5fa08d1" containerName="main"
Sep 14 13:21:12.094148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093888    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab314408-60bc-496f-9459-3cb786e543b2" containerName="main"
Sep 14 13:21:12.094148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093899    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="865c4e3f-5152-4dc9-b573-6c4832c88e89" containerName="maas-api"
Sep 14 13:21:12.094148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.093907    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="61148b73-c61b-4599-986b-7d7371864641" containerName="main"
Sep 14 13:21:12.098290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.098270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.101175 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.101154    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"distinct-2-w0-aea349-kserve-self-signed-certs\""
Sep 14 13:21:12.108253 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.108228    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:21:12.232152 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.232338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.232338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.232338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232274    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7nzw\" (UniqueName: \"kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.232338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.232498 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.232365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.332909 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.332863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.332919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7nzw\" (UniqueName: \"kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.332980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333455 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333402    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.333455 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.333432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.335377 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.335351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.335666 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.335644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.345246 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.345178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7nzw\" (UniqueName: \"kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw\") pod \"distinct-2-w0-aea349-kserve-7765879789-fwp6k\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") " pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.408734 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.408694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:12.688773 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:12.688744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:21:12.689824 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:21:12.689799    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda276bee1_795a_4c1b_8bfb_1fdf2fd117e0.slice/crio-a2b5259fdf9ccf08159ab7740f2afc04d8c8a2b9aee2c6ba91b6bbf59135e854 WatchSource:0}: Error finding container a2b5259fdf9ccf08159ab7740f2afc04d8c8a2b9aee2c6ba91b6bbf59135e854: Status 404 returned error can't find the container with id a2b5259fdf9ccf08159ab7740f2afc04d8c8a2b9aee2c6ba91b6bbf59135e854
Sep 14 13:21:13.184514 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:13.184475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" event={"ID":"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0","Type":"ContainerStarted","Data":"0d5b6b67487ffc74ba2f7b3f23ffc2483478bf3cdfb2028e9cc681c769b95fdc"}
Sep 14 13:21:13.184925 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:13.184520    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" event={"ID":"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0","Type":"ContainerStarted","Data":"a2b5259fdf9ccf08159ab7740f2afc04d8c8a2b9aee2c6ba91b6bbf59135e854"}
Sep 14 13:21:13.211099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:13.211041    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" podStartSLOduration=1.211024438 podStartE2EDuration="1.211024438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:21:13.209455881 +0000 UTC m=+1393.045964737" watchObservedRunningTime="2026-09-14 13:21:13.211024438 +0000 UTC m=+1393.047533272"
Sep 14 13:21:22.408821 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:22.408780    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:22.409298 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:22.408841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:22.422069 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:22.422040    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:23.255229 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:23.255195    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:21:32.697164 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:21:32.697129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:22:00.834076 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:00.834034    2559 scope.go:117] "RemoveContainer" containerID="6742f861203022c9dfcaa28f564f526f7ba89b51ea6ea8a7d6ff8cb58eef1b35"
Sep 14 13:22:03.635744 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:03.635709    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:22:10.305029 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.304997    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:22:10.309981 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.309961    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.313626 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.313604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-231820-serving-cert\""
Sep 14 13:22:10.339319 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.339290    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:22:10.396629 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.396602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.396773 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.396636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8v2p\" (UniqueName: \"kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.396773 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.396732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.396847 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.396786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.498165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.498132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.498340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.498170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8v2p\" (UniqueName: \"kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.498340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.498242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.498340 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.498299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.498827 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.498803    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.500702 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.500680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.500791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.500712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.509137 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.509113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8v2p\" (UniqueName: \"kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p\") pod \"maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.619578 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.619499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:10.946451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.946335    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:22:10.958395 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:22:10.954608    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23535ef3_279b_4697_afe3_b8ad38539fe4.slice/crio-d176cc7de61c4c9df4635003b3f7bcb255d79e3b78c9e5ce0fcb10c807e23bd1 WatchSource:0}: Error finding container d176cc7de61c4c9df4635003b3f7bcb255d79e3b78c9e5ce0fcb10c807e23bd1: Status 404 returned error can't find the container with id d176cc7de61c4c9df4635003b3f7bcb255d79e3b78c9e5ce0fcb10c807e23bd1
Sep 14 13:22:10.959290 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:10.959269    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:22:11.524962 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:11.524927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" event={"ID":"23535ef3-279b-4697-afe3-b8ad38539fe4","Type":"ContainerStarted","Data":"539cf9a41c94db280d3e56eccaa86a91098d9175555af6cc5adb2ba784f9b1ec"}
Sep 14 13:22:11.525362 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:11.525031    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:11.525362 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:11.525061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" event={"ID":"23535ef3-279b-4697-afe3-b8ad38539fe4","Type":"ContainerStarted","Data":"d176cc7de61c4c9df4635003b3f7bcb255d79e3b78c9e5ce0fcb10c807e23bd1"}
Sep 14 13:22:11.574686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:11.574639    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" podStartSLOduration=1.199325272 podStartE2EDuration="1.574624341s" totalImagesPullingTime="375.299069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:22:11.572219948 +0000 UTC m=+1451.408728795" watchObservedRunningTime="2026-09-14 13:22:11.574624341 +0000 UTC m=+1451.411133175"
Sep 14 13:22:17.536754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:17.536720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:22:19.328342 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.328301    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:22:19.328815 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.328543    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" podUID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" containerName="maas-api" containerID="cri-o://18d0d97ae85c408b624fb21a30083d41de4e492871d11663820d2344a0be909f" gracePeriod=30
Sep 14 13:22:19.574095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.574067    2559 generic.go:356] "Generic (PLEG): container finished" podID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" containerID="18d0d97ae85c408b624fb21a30083d41de4e492871d11663820d2344a0be909f" exitCode=0
Sep 14 13:22:19.574240 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.574151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" event={"ID":"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a","Type":"ContainerDied","Data":"18d0d97ae85c408b624fb21a30083d41de4e492871d11663820d2344a0be909f"}
Sep 14 13:22:19.574291 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.574237    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj" event={"ID":"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a","Type":"ContainerDied","Data":"31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d"}
Sep 14 13:22:19.574291 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.574262    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31a7b9d437762dcb6bfc6fba098b7f1e8783e04f8e3341646c74d4f7d0c4910d"
Sep 14 13:22:19.588586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.588524    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:22:19.679597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.679566    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs\") pod \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") "
Sep 14 13:22:19.679597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.679602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls\") pod \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") "
Sep 14 13:22:19.679793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.679692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88n76\" (UniqueName: \"kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76\") pod \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") "
Sep 14 13:22:19.679793 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.679710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca\") pod \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\" (UID: \"342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a\") "
Sep 14 13:22:19.680173 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.680140    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" (UID: "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:22:19.681787 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.681759    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" (UID: "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:22:19.681942 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.681799    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76" (OuterVolumeSpecName: "kube-api-access-88n76") pod "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" (UID: "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a"). InnerVolumeSpecName "kube-api-access-88n76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:22:19.681942 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.681860    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" (UID: "342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:22:19.780434 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.780410    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:22:19.780434 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.780431    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:22:19.780599 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.780442    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88n76\" (UniqueName: \"kubernetes.io/projected/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-kube-api-access-88n76\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:22:19.780599 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:19.780452    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:22:20.583244 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:20.583216    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"
Sep 14 13:22:20.628856 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:20.628826    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:22:20.631352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:20.631327    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-92d7d8db-56bcd8c47f-bkjlj"]
Sep 14 13:22:20.685253 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:20.685230    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" path="/var/lib/kubelet/pods/342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a/volumes"
Sep 14 13:22:24.344042 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.344007    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:22:24.344436 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.344423    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" containerName="maas-api"
Sep 14 13:22:24.344486 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.344438    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" containerName="maas-api"
Sep 14 13:22:24.344532 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.344521    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="342927fc-ed2f-4b0a-9efa-fb7bdcb92f1a" containerName="maas-api"
Sep 14 13:22:24.347839 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.347822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.351166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.351145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"e2e-conflict-b-ed40dcb4-kserve-self-signed-certs\""
Sep 14 13:22:24.364699 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.364673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:22:24.423497 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzpck\" (UniqueName: \"kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.423620 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.423620 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.423698 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.423698 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.423762 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.423730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525226 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525226 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525430 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525430 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525559 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525559 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzpck\" (UniqueName: \"kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525666 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525633    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525712 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.525813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.525792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.527522 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.527494    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.527773 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.527756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.538914 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.538892    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzpck\" (UniqueName: \"kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck\") pod \"e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") " pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.656951 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.656869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:24.942608 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:24.942584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:22:24.944661 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:22:24.944635    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b2bc8d0_1a63_4374_b228_6036bd888035.slice/crio-a0cd4ce5042831f1866eebe88b5935efc3a51b92e5b2c0656f75206a219ce57b WatchSource:0}: Error finding container a0cd4ce5042831f1866eebe88b5935efc3a51b92e5b2c0656f75206a219ce57b: Status 404 returned error can't find the container with id a0cd4ce5042831f1866eebe88b5935efc3a51b92e5b2c0656f75206a219ce57b
Sep 14 13:22:25.613429 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:25.613387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" event={"ID":"3b2bc8d0-1a63-4374-b228-6036bd888035","Type":"ContainerStarted","Data":"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"}
Sep 14 13:22:25.613792 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:25.613437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" event={"ID":"3b2bc8d0-1a63-4374-b228-6036bd888035","Type":"ContainerStarted","Data":"a0cd4ce5042831f1866eebe88b5935efc3a51b92e5b2c0656f75206a219ce57b"}
Sep 14 13:22:34.657001 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:34.656964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:34.657489 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:34.657044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:34.670475 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:34.670452    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:34.712757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:34.712714    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" podStartSLOduration=10.712701483 podStartE2EDuration="10.712701483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:22:25.6754335 +0000 UTC m=+1465.511942334" watchObservedRunningTime="2026-09-14 13:22:34.712701483 +0000 UTC m=+1474.549210347"
Sep 14 13:22:35.686138 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:35.686103    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:22:45.547695 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:22:45.547655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:23:00.743082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:00.743049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:23:00.749379 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:00.749360    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:23:18.322097 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:18.322062    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:23:22.201023 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:22.200983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:23:33.341586 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.341468    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" podUID="3b2bc8d0-1a63-4374-b228-6036bd888035" containerName="main" containerID="cri-o://f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2" gracePeriod=45
Sep 14 13:23:33.600351 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.600281    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:23:33.698538 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698503    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.698538 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzpck\" (UniqueName: \"kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.698791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.698791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698644    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.698791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698670    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.698791 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home\") pod \"3b2bc8d0-1a63-4374-b228-6036bd888035\" (UID: \"3b2bc8d0-1a63-4374-b228-6036bd888035\") "
Sep 14 13:23:33.699035 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698859    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:33.699035 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.698947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:33.699161 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.699141    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:33.699223 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.699163    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:33.699278 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.699246    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home" (OuterVolumeSpecName: "home") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:33.701015 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.700995    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm" (OuterVolumeSpecName: "dshm") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:23:33.701099 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.701074    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:23:33.701153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.701136    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck" (OuterVolumeSpecName: "kube-api-access-nzpck") pod "3b2bc8d0-1a63-4374-b228-6036bd888035" (UID: "3b2bc8d0-1a63-4374-b228-6036bd888035"). InnerVolumeSpecName "kube-api-access-nzpck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:23:33.799769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.799724    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:33.799769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.799756    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b2bc8d0-1a63-4374-b228-6036bd888035-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:33.799769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.799767    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b2bc8d0-1a63-4374-b228-6036bd888035-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:33.799769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:33.799777    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzpck\" (UniqueName: \"kubernetes.io/projected/3b2bc8d0-1a63-4374-b228-6036bd888035-kube-api-access-nzpck\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:23:34.015670 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.015634    2559 generic.go:356] "Generic (PLEG): container finished" podID="3b2bc8d0-1a63-4374-b228-6036bd888035" containerID="f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2" exitCode=0
Sep 14 13:23:34.015892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.015682    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"
Sep 14 13:23:34.015892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.015712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" event={"ID":"3b2bc8d0-1a63-4374-b228-6036bd888035","Type":"ContainerDied","Data":"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"}
Sep 14 13:23:34.015892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.015754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww" event={"ID":"3b2bc8d0-1a63-4374-b228-6036bd888035","Type":"ContainerDied","Data":"a0cd4ce5042831f1866eebe88b5935efc3a51b92e5b2c0656f75206a219ce57b"}
Sep 14 13:23:34.015892 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.015772    2559 scope.go:117] "RemoveContainer" containerID="f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"
Sep 14 13:23:34.025772 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.025753    2559 scope.go:117] "RemoveContainer" containerID="f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"
Sep 14 13:23:34.026084 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:23:34.026063    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2\": container with ID starting with f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2 not found: ID does not exist" containerID="f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"
Sep 14 13:23:34.026166 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.026091    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2"} err="failed to get container status \"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2\": rpc error: code = NotFound desc = could not find container \"f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2\": container with ID starting with f4bd909012f0596e3683571b33e511fb0c7840db8b4da55979087b3a83fb9be2 not found: ID does not exist"
Sep 14 13:23:34.053986 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.053947    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:23:34.058325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.058294    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/e2e-conflict-b-ed40dcb4-kserve-b86b59fd5-vrgww"]
Sep 14 13:23:34.683679 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:34.683646    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2bc8d0-1a63-4374-b228-6036bd888035" path="/var/lib/kubelet/pods/3b2bc8d0-1a63-4374-b228-6036bd888035/volumes"
Sep 14 13:23:51.541826 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.541790    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:23:51.544277 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.542229    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2bc8d0-1a63-4374-b228-6036bd888035" containerName="main"
Sep 14 13:23:51.544277 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.542242    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2bc8d0-1a63-4374-b228-6036bd888035" containerName="main"
Sep 14 13:23:51.544277 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.542328    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2bc8d0-1a63-4374-b228-6036bd888035" containerName="main"
Sep 14 13:23:51.545285 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.545262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685372 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685573 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjcg\" (UniqueName: \"kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685573 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685573 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685742 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.685742 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.685607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786308 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786520 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjcg\" (UniqueName: \"kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786520 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786520 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786520 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786520 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.786952 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.786837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:51.788665 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:51.788645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:52.786992 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:23:52.786954    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Sep 14 13:23:52.787401 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:23:52.787055    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs podName:03c68d79-1b6b-429e-a5ea-520596efffe0 nodeName:}" failed. No retries permitted until 2026-09-14 13:23:53.287036274 +0000 UTC m=+1553.123545087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs") pod "auth-test-model-231820-kserve-d8cd8c78c-7ht8w" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0") : failed to sync secret cache: timed out waiting for the condition
Sep 14 13:23:53.301947 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:53.301910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:53.371846 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:53.371815    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-231820\"/\"kube-root-ca.crt\""
Sep 14 13:23:53.416683 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:53.416655    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-231820\"/\"default-dockercfg-sfwnd\""
Sep 14 13:23:53.763935 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:53.763872    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-231820\"/\"openshift-service-ca.crt\""
Sep 14 13:23:53.773075 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:53.773044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjcg\" (UniqueName: \"kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:54.303118 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:23:54.303080    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Sep 14 13:23:54.303530 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:23:54.303180    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs podName:03c68d79-1b6b-429e-a5ea-520596efffe0 nodeName:}" failed. No retries permitted until 2026-09-14 13:23:55.303163914 +0000 UTC m=+1555.139672726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs") pod "auth-test-model-231820-kserve-d8cd8c78c-7ht8w" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0") : failed to sync secret cache: timed out waiting for the condition
Sep 14 13:23:55.321991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:55.321944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:55.808531 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:55.808493    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-231820\"/\"auth-test-model-231820-kserve-self-signed-certs\""
Sep 14 13:23:55.814549 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:55.814517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"auth-test-model-231820-kserve-d8cd8c78c-7ht8w\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") " pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:56.054748 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:56.054702    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:23:56.157740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:56.157706    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:23:59.309693 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:23:59.309661    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:23:59.311115 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:23:59.311090    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03c68d79_1b6b_429e_a5ea_520596efffe0.slice/crio-6898b22b085fdd49b783d7ba4adf6d70615c8f62b6a873056423d02955b0f4ee WatchSource:0}: Error finding container 6898b22b085fdd49b783d7ba4adf6d70615c8f62b6a873056423d02955b0f4ee: Status 404 returned error can't find the container with id 6898b22b085fdd49b783d7ba4adf6d70615c8f62b6a873056423d02955b0f4ee
Sep 14 13:24:00.165086 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:00.165046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" event={"ID":"03c68d79-1b6b-429e-a5ea-520596efffe0","Type":"ContainerStarted","Data":"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"}
Sep 14 13:24:00.165260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:00.165097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" event={"ID":"03c68d79-1b6b-429e-a5ea-520596efffe0","Type":"ContainerStarted","Data":"6898b22b085fdd49b783d7ba4adf6d70615c8f62b6a873056423d02955b0f4ee"}
Sep 14 13:24:00.185267 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:00.185206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" podStartSLOduration=15.185188169 podStartE2EDuration="15.185188169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:24:00.184527165 +0000 UTC m=+1560.021036002" watchObservedRunningTime="2026-09-14 13:24:00.185188169 +0000 UTC m=+1560.021697013"
Sep 14 13:24:03.000771 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:03.000728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:24:06.055250 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:06.055205    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:24:06.055250 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:06.055253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:24:06.067990 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:06.067959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:24:06.212831 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:06.212797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:24:08.846552 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.846510    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:24:08.850349 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.850330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.937191 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.937155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5cedb0\"/\"distinct-w4-5cedb0-kserve-self-signed-certs\""
Sep 14 13:24:08.952837 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.952803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:24:08.958798 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.958764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxn9\" (UniqueName: \"kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.958968 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.958820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.958968 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.958950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.959072 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.958999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.959135 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.959069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:08.959187 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:08.959130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060112 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxn9\" (UniqueName: \"kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060634 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060695 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.060787 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.060768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.062616 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.062593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.062923 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.062905    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.075020 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.074986    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxn9\" (UniqueName: \"kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9\") pod \"distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") " pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.159654 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.159560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:09.441763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:09.441733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:24:09.443630 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:24:09.443598    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfe9a923_427c_470b_a41c_c960fd009ce2.slice/crio-e5203c5588afd69bea7418db89abef33c64ab3e3b8885bae899bc8fd329dfd0a WatchSource:0}: Error finding container e5203c5588afd69bea7418db89abef33c64ab3e3b8885bae899bc8fd329dfd0a: Status 404 returned error can't find the container with id e5203c5588afd69bea7418db89abef33c64ab3e3b8885bae899bc8fd329dfd0a
Sep 14 13:24:10.229319 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:10.229277    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" event={"ID":"dfe9a923-427c-470b-a41c-c960fd009ce2","Type":"ContainerStarted","Data":"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"}
Sep 14 13:24:10.229767 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:10.229329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" event={"ID":"dfe9a923-427c-470b-a41c-c960fd009ce2","Type":"ContainerStarted","Data":"e5203c5588afd69bea7418db89abef33c64ab3e3b8885bae899bc8fd329dfd0a"}
Sep 14 13:24:10.251556 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:10.251503    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" podStartSLOduration=2.251485212 podStartE2EDuration="2.251485212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:24:10.251129318 +0000 UTC m=+1570.087638153" watchObservedRunningTime="2026-09-14 13:24:10.251485212 +0000 UTC m=+1570.087994045"
Sep 14 13:24:19.160057 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:19.160006    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:19.160461 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:19.160080    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:19.172785 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:19.172753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:19.295401 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:19.295364    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:24:23.852747 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:23.852693    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:13Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:13Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:13Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:13Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-137-35.ec2.internal\": Patch \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-35.ec2.internal/status?timeout=10s\": context deadline exceeded"
Sep 14 13:24:27.334303 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:27.334265    2559 generic.go:356] "Generic (PLEG): container finished" podID="223616a1-345f-41c1-bde8-87570e6d6c3e" containerID="dbdd2b691fd61d473e199d07af6644123dd966bd025ac0e18e4309d434d171fc" exitCode=1
Sep 14 13:24:27.334757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:27.334344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" event={"ID":"223616a1-345f-41c1-bde8-87570e6d6c3e","Type":"ContainerDied","Data":"dbdd2b691fd61d473e199d07af6644123dd966bd025ac0e18e4309d434d171fc"}
Sep 14 13:24:27.334757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:27.334724    2559 scope.go:117] "RemoveContainer" containerID="dbdd2b691fd61d473e199d07af6644123dd966bd025ac0e18e4309d434d171fc"
Sep 14 13:24:28.342592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:28.342555    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" event={"ID":"223616a1-345f-41c1-bde8-87570e6d6c3e","Type":"ContainerStarted","Data":"df9339fa5d8a45e24e0ef0d5cf57699945d7b90cd1be567bb8e668bfd54f77b7"}
Sep 14 13:24:28.343092 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:28.342762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:24:32.268960 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:32.268908    2559 controller.go:195] "Failed to update lease" err="Put \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-35.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 14 13:24:33.853802 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:33.853764    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-35.ec2.internal\": Get \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-35.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 14 13:24:40.390053 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:40.390008    2559 patch_prober.go:28] interesting pod/lws-controller-manager-6b9c8bb87f-pjls8 container/manager namespace/openshift-lws-operator: Readiness probe status=failure output="Get \"http://10.132.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 13:24:40.390528 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:40.390104    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" podUID="223616a1-345f-41c1-bde8-87570e6d6c3e" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:24:42.269649 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:42.269605    2559 controller.go:195] "Failed to update lease" err="Put \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:24:49.274957 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:49.274908    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:39Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:39Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:39Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-14T13:24:39Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-137-35.ec2.internal\": Patch \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-35.ec2.internal/status?timeout=10s\": context deadline exceeded"
Sep 14 13:24:50.128063 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:50.128014    2559 patch_prober.go:28] interesting pod/lws-controller-manager-6b9c8bb87f-pjls8 container/manager namespace/openshift-lws-operator: Liveness probe status=failure output="Get \"http://10.132.0.32:8081/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 13:24:50.128249 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:50.128106    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" podUID="223616a1-345f-41c1-bde8-87570e6d6c3e" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.32:8081/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:24:50.390114 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:50.390020    2559 patch_prober.go:28] interesting pod/lws-controller-manager-6b9c8bb87f-pjls8 container/manager namespace/openshift-lws-operator: Readiness probe status=failure output="Get \"http://10.132.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 13:24:50.390114 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:50.390083    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8" podUID="223616a1-345f-41c1-bde8-87570e6d6c3e" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.32:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 13:24:52.270371 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:24:52.270319    2559 controller.go:195] "Failed to update lease" err="Put \"https://a85140165f9694c368b01f9bfd6452db-56b2447ac959d963.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-35.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 14 13:24:59.349337 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:24:59.349264    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b9c8bb87f-pjls8"
Sep 14 13:25:28.325705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:28.325671    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:25:28.340108 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:28.340071    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:25:34.737041 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:34.736999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:25:43.345456 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.345387    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" podUID="dfe9a923-427c-470b-a41c-c960fd009ce2" containerName="main" containerID="cri-o://48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809" gracePeriod=45
Sep 14 13:25:43.358727 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.358675    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" podUID="64e4d92a-3611-4d7a-9336-52fca7223853" containerName="main" containerID="cri-o://9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3" gracePeriod=45
Sep 14 13:25:43.624401 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.624375    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:25:43.627278 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.627259    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:25:43.647592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647566    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.647717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.647717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647619    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.647717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.647717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.647717 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647688    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647754    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tth2n\" (UniqueName: \"kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647789    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647818    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home" (OuterVolumeSpecName: "home") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647948    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sxn9\" (UniqueName: \"kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9\") pod \"dfe9a923-427c-470b-a41c-c960fd009ce2\" (UID: \"dfe9a923-427c-470b-a41c-c960fd009ce2\") "
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647977    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache" (OuterVolumeSpecName: "model-cache") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.648008 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.647997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir\") pod \"64e4d92a-3611-4d7a-9336-52fca7223853\" (UID: \"64e4d92a-3611-4d7a-9336-52fca7223853\") "
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648157    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648421    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home" (OuterVolumeSpecName: "home") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648468    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648484    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.648503 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648496    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.648815 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.648609    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.650077 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:25:43.650347 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650325    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:25:43.650454 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650425    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm" (OuterVolumeSpecName: "dshm") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.650508 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650423    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n" (OuterVolumeSpecName: "kube-api-access-tth2n") pod "64e4d92a-3611-4d7a-9336-52fca7223853" (UID: "64e4d92a-3611-4d7a-9336-52fca7223853"). InnerVolumeSpecName "kube-api-access-tth2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:25:43.650592 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm" (OuterVolumeSpecName: "dshm") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:43.650651 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.650635    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9" (OuterVolumeSpecName: "kube-api-access-9sxn9") pod "dfe9a923-427c-470b-a41c-c960fd009ce2" (UID: "dfe9a923-427c-470b-a41c-c960fd009ce2"). InnerVolumeSpecName "kube-api-access-9sxn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:25:43.749587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749550    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfe9a923-427c-470b-a41c-c960fd009ce2-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749580    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749594    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfe9a923-427c-470b-a41c-c960fd009ce2-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749691    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749708    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tth2n\" (UniqueName: \"kubernetes.io/projected/64e4d92a-3611-4d7a-9336-52fca7223853-kube-api-access-tth2n\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749723    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64e4d92a-3611-4d7a-9336-52fca7223853-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749738    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sxn9\" (UniqueName: \"kubernetes.io/projected/dfe9a923-427c-470b-a41c-c960fd009ce2-kube-api-access-9sxn9\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.749870 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.749750    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64e4d92a-3611-4d7a-9336-52fca7223853-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:43.808264 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.808228    2559 generic.go:356] "Generic (PLEG): container finished" podID="dfe9a923-427c-470b-a41c-c960fd009ce2" containerID="48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809" exitCode=0
Sep 14 13:25:43.808460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.808275    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"
Sep 14 13:25:43.808460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.808310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" event={"ID":"dfe9a923-427c-470b-a41c-c960fd009ce2","Type":"ContainerDied","Data":"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"}
Sep 14 13:25:43.808460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.808350    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j" event={"ID":"dfe9a923-427c-470b-a41c-c960fd009ce2","Type":"ContainerDied","Data":"e5203c5588afd69bea7418db89abef33c64ab3e3b8885bae899bc8fd329dfd0a"}
Sep 14 13:25:43.808460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.808371    2559 scope.go:117] "RemoveContainer" containerID="48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"
Sep 14 13:25:43.809869 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.809840    2559 generic.go:356] "Generic (PLEG): container finished" podID="64e4d92a-3611-4d7a-9336-52fca7223853" containerID="9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3" exitCode=0
Sep 14 13:25:43.810027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.809919    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"
Sep 14 13:25:43.810027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.809929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" event={"ID":"64e4d92a-3611-4d7a-9336-52fca7223853","Type":"ContainerDied","Data":"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"}
Sep 14 13:25:43.810027 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.809983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2" event={"ID":"64e4d92a-3611-4d7a-9336-52fca7223853","Type":"ContainerDied","Data":"72072266b0b8e67fe49deb91f5950746b3b093921fc4b4bcda870eae810ef705"}
Sep 14 13:25:43.821308 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.821279    2559 scope.go:117] "RemoveContainer" containerID="48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"
Sep 14 13:25:43.821834 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:25:43.821812    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809\": container with ID starting with 48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809 not found: ID does not exist" containerID="48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"
Sep 14 13:25:43.821944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.821842    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809"} err="failed to get container status \"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809\": rpc error: code = NotFound desc = could not find container \"48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809\": container with ID starting with 48f77d26ecd085c677685a36bec38e7b3095c4fbbe0657579a1223a8a97bd809 not found: ID does not exist"
Sep 14 13:25:43.821944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.821859    2559 scope.go:117] "RemoveContainer" containerID="9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"
Sep 14 13:25:43.830299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.830276    2559 scope.go:117] "RemoveContainer" containerID="9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"
Sep 14 13:25:43.830534 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:25:43.830511    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3\": container with ID starting with 9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3 not found: ID does not exist" containerID="9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"
Sep 14 13:25:43.830602 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:43.830546    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3"} err="failed to get container status \"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3\": rpc error: code = NotFound desc = could not find container \"9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3\": container with ID starting with 9b1212b9b4f538de4303d7970782a5447bb2f76a764a9fe5b47b83d8d2ab6ae3 not found: ID does not exist"
Sep 14 13:25:49.756931 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:49.756840    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" podUID="09f12420-68b9-42ab-bc35-6592d4824fad" containerName="main" containerID="cri-o://9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2" gracePeriod=45
Sep 14 13:25:50.010813 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.010751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:25:50.117581 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117539    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.117581 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.117838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117631    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.117838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117738    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.117838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.118038 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs5sg\" (UniqueName: \"kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg\") pod \"09f12420-68b9-42ab-bc35-6592d4824fad\" (UID: \"09f12420-68b9-42ab-bc35-6592d4824fad\") "
Sep 14 13:25:50.118038 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.117938    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache" (OuterVolumeSpecName: "model-cache") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:50.118038 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.118004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:50.118160 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.118065    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home" (OuterVolumeSpecName: "home") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:50.118236 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.118219    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.118276 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.118238    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.118276 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.118249    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.119967 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.119946    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg" (OuterVolumeSpecName: "kube-api-access-bs5sg") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "kube-api-access-bs5sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:25:50.120352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.120327    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:25:50.120352 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.120335    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm" (OuterVolumeSpecName: "dshm") pod "09f12420-68b9-42ab-bc35-6592d4824fad" (UID: "09f12420-68b9-42ab-bc35-6592d4824fad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:25:50.219005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.218965    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f12420-68b9-42ab-bc35-6592d4824fad-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.219005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.218999    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs5sg\" (UniqueName: \"kubernetes.io/projected/09f12420-68b9-42ab-bc35-6592d4824fad-kube-api-access-bs5sg\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.219005 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.219010    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f12420-68b9-42ab-bc35-6592d4824fad-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:25:50.853305 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.853268    2559 generic.go:356] "Generic (PLEG): container finished" podID="09f12420-68b9-42ab-bc35-6592d4824fad" containerID="9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2" exitCode=0
Sep 14 13:25:50.853686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.853314    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"
Sep 14 13:25:50.853686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.853350    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" event={"ID":"09f12420-68b9-42ab-bc35-6592d4824fad","Type":"ContainerDied","Data":"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"}
Sep 14 13:25:50.853686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.853392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb" event={"ID":"09f12420-68b9-42ab-bc35-6592d4824fad","Type":"ContainerDied","Data":"6dd443f6401b95f21acd18f083ab8e09f8841918853ae2e5c0227ed81ccb726b"}
Sep 14 13:25:50.853686 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.853410    2559 scope.go:117] "RemoveContainer" containerID="9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"
Sep 14 13:25:50.862773 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.862757    2559 scope.go:117] "RemoveContainer" containerID="9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"
Sep 14 13:25:50.863071 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:25:50.863052    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2\": container with ID starting with 9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2 not found: ID does not exist" containerID="9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"
Sep 14 13:25:50.863146 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:50.863078    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2"} err="failed to get container status \"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2\": rpc error: code = NotFound desc = could not find container \"9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2\": container with ID starting with 9f76c9842334d590f7b6a21d01f7000610536dd60dbd088b78363bc37521b6a2 not found: ID does not exist"
Sep 14 13:25:55.980817 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:55.980771    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:25:55.999579 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:55.999548    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/simulator-w4-5cedb0-kserve-5df8ff54d-pbhzb"]
Sep 14 13:25:56.050051 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.050018    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:25:56.064627 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.064596    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/premium-w4-5cedb0-kserve-6cd957b7b5-n78k2"]
Sep 14 13:25:56.108802 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.108769    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:25:56.127055 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.127024    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5cedb0/distinct-w4-5cedb0-kserve-5dbcf8c9b8-x6p2j"]
Sep 14 13:25:56.683403 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.683361    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f12420-68b9-42ab-bc35-6592d4824fad" path="/var/lib/kubelet/pods/09f12420-68b9-42ab-bc35-6592d4824fad/volumes"
Sep 14 13:25:56.683869 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.683845    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e4d92a-3611-4d7a-9336-52fca7223853" path="/var/lib/kubelet/pods/64e4d92a-3611-4d7a-9336-52fca7223853/volumes"
Sep 14 13:25:56.684315 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:25:56.684295    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe9a923-427c-470b-a41c-c960fd009ce2" path="/var/lib/kubelet/pods/dfe9a923-427c-470b-a41c-c960fd009ce2/volumes"
Sep 14 13:26:00.897347 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:26:00.897304    2559 scope.go:117] "RemoveContainer" containerID="18d0d97ae85c408b624fb21a30083d41de4e492871d11663820d2344a0be909f"
Sep 14 13:26:01.404950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:26:01.404917    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:27:02.391501 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:02.391465    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:27:22.156227 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.156188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:27:22.156658 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.156387    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" podUID="23535ef3-279b-4697-afe3-b8ad38539fe4" containerName="maas-api" containerID="cri-o://539cf9a41c94db280d3e56eccaa86a91098d9175555af6cc5adb2ba784f9b1ec" gracePeriod=30
Sep 14 13:27:22.391299 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.391270    2559 generic.go:356] "Generic (PLEG): container finished" podID="23535ef3-279b-4697-afe3-b8ad38539fe4" containerID="539cf9a41c94db280d3e56eccaa86a91098d9175555af6cc5adb2ba784f9b1ec" exitCode=0
Sep 14 13:27:22.391485 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.391352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" event={"ID":"23535ef3-279b-4697-afe3-b8ad38539fe4","Type":"ContainerDied","Data":"539cf9a41c94db280d3e56eccaa86a91098d9175555af6cc5adb2ba784f9b1ec"}
Sep 14 13:27:22.418736 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.418664    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:27:22.516989 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.516959    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca\") pod \"23535ef3-279b-4697-afe3-b8ad38539fe4\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") "
Sep 14 13:27:22.517159 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.516995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls\") pod \"23535ef3-279b-4697-afe3-b8ad38539fe4\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") "
Sep 14 13:27:22.517159 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.517034    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs\") pod \"23535ef3-279b-4697-afe3-b8ad38539fe4\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") "
Sep 14 13:27:22.517159 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.517148    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8v2p\" (UniqueName: \"kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p\") pod \"23535ef3-279b-4697-afe3-b8ad38539fe4\" (UID: \"23535ef3-279b-4697-afe3-b8ad38539fe4\") "
Sep 14 13:27:22.517363 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.517333    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23535ef3-279b-4697-afe3-b8ad38539fe4" (UID: "23535ef3-279b-4697-afe3-b8ad38539fe4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:27:22.517587 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.517565    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23535ef3-279b-4697-afe3-b8ad38539fe4-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:22.519215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.519186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23535ef3-279b-4697-afe3-b8ad38539fe4" (UID: "23535ef3-279b-4697-afe3-b8ad38539fe4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:27:22.519215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.519209    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23535ef3-279b-4697-afe3-b8ad38539fe4" (UID: "23535ef3-279b-4697-afe3-b8ad38539fe4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:27:22.519358 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.519284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p" (OuterVolumeSpecName: "kube-api-access-d8v2p") pod "23535ef3-279b-4697-afe3-b8ad38539fe4" (UID: "23535ef3-279b-4697-afe3-b8ad38539fe4"). InnerVolumeSpecName "kube-api-access-d8v2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:27:22.618479 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.618429    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:22.618479 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.618475    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23535ef3-279b-4697-afe3-b8ad38539fe4-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:22.618479 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:22.618485    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8v2p\" (UniqueName: \"kubernetes.io/projected/23535ef3-279b-4697-afe3-b8ad38539fe4-kube-api-access-d8v2p\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:23.398757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:23.398726    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"
Sep 14 13:27:23.399273 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:23.398771    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft" event={"ID":"23535ef3-279b-4697-afe3-b8ad38539fe4","Type":"ContainerDied","Data":"d176cc7de61c4c9df4635003b3f7bcb255d79e3b78c9e5ce0fcb10c807e23bd1"}
Sep 14 13:27:23.399273 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:23.398854    2559 scope.go:117] "RemoveContainer" containerID="539cf9a41c94db280d3e56eccaa86a91098d9175555af6cc5adb2ba784f9b1ec"
Sep 14 13:27:23.449986 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:23.449948    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:27:23.463919 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:23.463870    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-231820-6d74cd5fbc-9ttft"]
Sep 14 13:27:24.689371 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:24.689335    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23535ef3-279b-4697-afe3-b8ad38539fe4" path="/var/lib/kubelet/pods/23535ef3-279b-4697-afe3-b8ad38539fe4/volumes"
Sep 14 13:27:28.445345 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:28.445306    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:27:31.023580 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023540    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023939    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23535ef3-279b-4697-afe3-b8ad38539fe4" containerName="maas-api"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023951    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23535ef3-279b-4697-afe3-b8ad38539fe4" containerName="maas-api"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023964    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e4d92a-3611-4d7a-9336-52fca7223853" containerName="main"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023969    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e4d92a-3611-4d7a-9336-52fca7223853" containerName="main"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023983    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f12420-68b9-42ab-bc35-6592d4824fad" containerName="main"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023988    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f12420-68b9-42ab-bc35-6592d4824fad" containerName="main"
Sep 14 13:27:31.023991 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023994    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe9a923-427c-470b-a41c-c960fd009ce2" containerName="main"
Sep 14 13:27:31.024219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.023999    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe9a923-427c-470b-a41c-c960fd009ce2" containerName="main"
Sep 14 13:27:31.024219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.024059    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f12420-68b9-42ab-bc35-6592d4824fad" containerName="main"
Sep 14 13:27:31.024219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.024068    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe9a923-427c-470b-a41c-c960fd009ce2" containerName="main"
Sep 14 13:27:31.024219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.024075    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e4d92a-3611-4d7a-9336-52fca7223853" containerName="main"
Sep 14 13:27:31.024219 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.024081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23535ef3-279b-4697-afe3-b8ad38539fe4" containerName="maas-api"
Sep 14 13:27:31.028424 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.028406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.031536 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.031511    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-aea349\"/\"embedding-w0-aea349-kserve-self-signed-certs\""
Sep 14 13:27:31.043947 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.043919    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:27:31.098927 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.098861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.098927 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.098928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.099162 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.099011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.099162 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.099028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.099162 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.099067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.099306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.099191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdvg\" (UniqueName: \"kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.199733 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdvg\" (UniqueName: \"kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.199733 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200056 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200056 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200056 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200056 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.199922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200281 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.200244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200328 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.200244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.200412 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.200338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.202167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.202136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.202462 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.202442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.214980 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.214958    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdvg\" (UniqueName: \"kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg\") pod \"embedding-w0-aea349-kserve-646bb944c9-2ds6p\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") " pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.337577 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.337482    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:31.639433 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:31.639406    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:27:31.640725 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:27:31.640699    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e498028_5ba1_46bc_8d89_ce629734837c.slice/crio-43f17f00461bec2957aab9a33d01cf7e0d5b9f19af5c2cc2a6c36fee11dd9b31 WatchSource:0}: Error finding container 43f17f00461bec2957aab9a33d01cf7e0d5b9f19af5c2cc2a6c36fee11dd9b31: Status 404 returned error can't find the container with id 43f17f00461bec2957aab9a33d01cf7e0d5b9f19af5c2cc2a6c36fee11dd9b31
Sep 14 13:27:32.438797 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:32.438760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:27:32.454178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:32.454140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" event={"ID":"1e498028-5ba1-46bc-8d89-ce629734837c","Type":"ContainerStarted","Data":"8e6174415cc66f3337641a499107422317c8288a2496e9eda5c598b41acf38c1"}
Sep 14 13:27:32.454338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:32.454186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" event={"ID":"1e498028-5ba1-46bc-8d89-ce629734837c","Type":"ContainerStarted","Data":"43f17f00461bec2957aab9a33d01cf7e0d5b9f19af5c2cc2a6c36fee11dd9b31"}
Sep 14 13:27:32.490095 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:32.490036    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" podStartSLOduration=2.490022423 podStartE2EDuration="2.490022423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:27:32.488386064 +0000 UTC m=+1772.324894900" watchObservedRunningTime="2026-09-14 13:27:32.490022423 +0000 UTC m=+1772.326531256"
Sep 14 13:27:41.337854 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:41.337812    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:41.338475 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:41.337868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:41.350117 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:41.350089    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:41.517818 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:41.517785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:27:43.464906 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.464847    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" podUID="03c68d79-1b6b-429e-a5ea-520596efffe0" containerName="main" containerID="cri-o://c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121" gracePeriod=45
Sep 14 13:27:43.715866 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.715795    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:27:43.811187 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rjcg\" (UniqueName: \"kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811355 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811355 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811347    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811481 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811372    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811539 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811500    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811539 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811529    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir\") pod \"03c68d79-1b6b-429e-a5ea-520596efffe0\" (UID: \"03c68d79-1b6b-429e-a5ea-520596efffe0\") "
Sep 14 13:27:43.811643 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home" (OuterVolumeSpecName: "home") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:43.811700 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811655    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache" (OuterVolumeSpecName: "model-cache") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:43.811905 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811847    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:43.812043 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811943    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:43.812043 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.811958    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:43.813597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.813567    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm" (OuterVolumeSpecName: "dshm") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:27:43.813724 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.813602    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg" (OuterVolumeSpecName: "kube-api-access-5rjcg") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "kube-api-access-5rjcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:27:43.813950 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.813923    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03c68d79-1b6b-429e-a5ea-520596efffe0" (UID: "03c68d79-1b6b-429e-a5ea-520596efffe0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:27:43.912754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.912720    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c68d79-1b6b-429e-a5ea-520596efffe0-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:43.912754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.912747    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:43.912754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.912757    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rjcg\" (UniqueName: \"kubernetes.io/projected/03c68d79-1b6b-429e-a5ea-520596efffe0-kube-api-access-5rjcg\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:43.913022 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:43.912765    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c68d79-1b6b-429e-a5ea-520596efffe0-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:27:44.530754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.530716    2559 generic.go:356] "Generic (PLEG): container finished" podID="03c68d79-1b6b-429e-a5ea-520596efffe0" containerID="c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121" exitCode=0
Sep 14 13:27:44.531258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.530773    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"
Sep 14 13:27:44.531258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.530808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" event={"ID":"03c68d79-1b6b-429e-a5ea-520596efffe0","Type":"ContainerDied","Data":"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"}
Sep 14 13:27:44.531258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.530853    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w" event={"ID":"03c68d79-1b6b-429e-a5ea-520596efffe0","Type":"ContainerDied","Data":"6898b22b085fdd49b783d7ba4adf6d70615c8f62b6a873056423d02955b0f4ee"}
Sep 14 13:27:44.531258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.530897    2559 scope.go:117] "RemoveContainer" containerID="c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"
Sep 14 13:27:44.541060 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.541042    2559 scope.go:117] "RemoveContainer" containerID="c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"
Sep 14 13:27:44.541302 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:27:44.541281    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121\": container with ID starting with c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121 not found: ID does not exist" containerID="c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"
Sep 14 13:27:44.541346 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.541317    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121"} err="failed to get container status \"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121\": rpc error: code = NotFound desc = could not find container \"c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121\": container with ID starting with c67c72e25ec30e08ea053bff2d3b39951433d99c0d100760df6d9701c03f1121 not found: ID does not exist"
Sep 14 13:27:44.568834 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.568804    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:27:44.590437 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.590402    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-231820/auth-test-model-231820-kserve-d8cd8c78c-7ht8w"]
Sep 14 13:27:44.683763 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:44.683732    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c68d79-1b6b-429e-a5ea-520596efffe0" path="/var/lib/kubelet/pods/03c68d79-1b6b-429e-a5ea-520596efffe0/volumes"
Sep 14 13:27:59.449546 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:27:59.449509    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:28:00.782560 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:00.782535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:28:00.789517 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:00.789494    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:28:22.550128 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:22.550094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:28:22.570260 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:22.570228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:28:22.596475 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:22.596450    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:28:22.612306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:22.612284    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:28:22.636059 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:22.636037    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:28:24.847426 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:24.847395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:28:34.985776 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:34.985737    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"]
Sep 14 13:28:34.999644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:34.999614    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-aea349-29823195-bt2qz"]
Sep 14 13:28:36.683428 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:36.683396    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e" path="/var/lib/kubelet/pods/c8a4e0b9-0727-4cdf-9efc-a0aba3f6520e/volumes"
Sep 14 13:28:37.568860 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.568791    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" podUID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" containerName="main" containerID="cri-o://0d5b6b67487ffc74ba2f7b3f23ffc2483478bf3cdfb2028e9cc681c769b95fdc" gracePeriod=45
Sep 14 13:28:37.588361 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.588329    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" podUID="67163dc8-4810-440d-82a8-9065dae51501" containerName="main" containerID="cri-o://c76675ef020976bb4c56ed1616b7825f9071acf7fb5b72081a4aea4d1c775faa" gracePeriod=45
Sep 14 13:28:37.613970 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.613942    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" podUID="1e498028-5ba1-46bc-8d89-ce629734837c" containerName="main" containerID="cri-o://8e6174415cc66f3337641a499107422317c8288a2496e9eda5c598b41acf38c1" gracePeriod=45
Sep 14 13:28:37.630810 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.630781    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" podUID="deb8e862-f906-4dc9-8a92-b4cf74969eed" containerName="main" containerID="cri-o://a810056d0a16830b2b494fcaf17bc8e05f3520769d8474d88da612a714c133cd" gracePeriod=45
Sep 14 13:28:37.653279 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.653231    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" podUID="dd633e40-47b6-42c9-8ebe-5067fe392e37" containerName="main" containerID="cri-o://9b8394798c721a70594727c4399b55bac4fe900798f3f433ad9f8b3029383ecd" gracePeriod=45
Sep 14 13:28:37.839241 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.839210    2559 generic.go:356] "Generic (PLEG): container finished" podID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" containerID="0d5b6b67487ffc74ba2f7b3f23ffc2483478bf3cdfb2028e9cc681c769b95fdc" exitCode=0
Sep 14 13:28:37.839671 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.839287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" event={"ID":"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0","Type":"ContainerDied","Data":"0d5b6b67487ffc74ba2f7b3f23ffc2483478bf3cdfb2028e9cc681c769b95fdc"}
Sep 14 13:28:37.841049 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.841025    2559 generic.go:356] "Generic (PLEG): container finished" podID="deb8e862-f906-4dc9-8a92-b4cf74969eed" containerID="a810056d0a16830b2b494fcaf17bc8e05f3520769d8474d88da612a714c133cd" exitCode=0
Sep 14 13:28:37.841178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.841052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" event={"ID":"deb8e862-f906-4dc9-8a92-b4cf74969eed","Type":"ContainerDied","Data":"a810056d0a16830b2b494fcaf17bc8e05f3520769d8474d88da612a714c133cd"}
Sep 14 13:28:37.842786 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.842768    2559 generic.go:356] "Generic (PLEG): container finished" podID="dd633e40-47b6-42c9-8ebe-5067fe392e37" containerID="9b8394798c721a70594727c4399b55bac4fe900798f3f433ad9f8b3029383ecd" exitCode=0
Sep 14 13:28:37.842865 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.842837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" event={"ID":"dd633e40-47b6-42c9-8ebe-5067fe392e37","Type":"ContainerDied","Data":"9b8394798c721a70594727c4399b55bac4fe900798f3f433ad9f8b3029383ecd"}
Sep 14 13:28:37.844608 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.844590    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e498028-5ba1-46bc-8d89-ce629734837c" containerID="8e6174415cc66f3337641a499107422317c8288a2496e9eda5c598b41acf38c1" exitCode=0
Sep 14 13:28:37.844699 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.844656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" event={"ID":"1e498028-5ba1-46bc-8d89-ce629734837c","Type":"ContainerDied","Data":"8e6174415cc66f3337641a499107422317c8288a2496e9eda5c598b41acf38c1"}
Sep 14 13:28:37.846205 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.846171    2559 generic.go:356] "Generic (PLEG): container finished" podID="67163dc8-4810-440d-82a8-9065dae51501" containerID="c76675ef020976bb4c56ed1616b7825f9071acf7fb5b72081a4aea4d1c775faa" exitCode=0
Sep 14 13:28:37.846280 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.846230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" event={"ID":"67163dc8-4810-440d-82a8-9065dae51501","Type":"ContainerDied","Data":"c76675ef020976bb4c56ed1616b7825f9071acf7fb5b72081a4aea4d1c775faa"}
Sep 14 13:28:37.957653 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.957627    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:28:37.962476 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.962453    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:28:37.978811 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.978792    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:28:37.981930 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.981913    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:28:37.985262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:37.985245    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:28:38.003319 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003297    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003329    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003384    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003437    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdvg\" (UniqueName: \"kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003485    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003526    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003555    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lls5\" (UniqueName: \"kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003631 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.003946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs\") pod \"67163dc8-4810-440d-82a8-9065dae51501\" (UID: \"67163dc8-4810-440d-82a8-9065dae51501\") "
Sep 14 13:28:38.003946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003646    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache" (OuterVolumeSpecName: "model-cache") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.003946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home\") pod \"1e498028-5ba1-46bc-8d89-ce629734837c\" (UID: \"1e498028-5ba1-46bc-8d89-ce629734837c\") "
Sep 14 13:28:38.003946 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.003866    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home" (OuterVolumeSpecName: "home") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.004152 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004085    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home" (OuterVolumeSpecName: "home") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.004210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004185    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.004210 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004207    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.004317 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004221    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.004317 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004234    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.004317 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004255    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.004425 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.004404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.005728 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.005704    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:28:38.005958 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.005931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:28:38.006068 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.006042    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm" (OuterVolumeSpecName: "dshm") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.006213 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.006197    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg" (OuterVolumeSpecName: "kube-api-access-7gdvg") pod "1e498028-5ba1-46bc-8d89-ce629734837c" (UID: "1e498028-5ba1-46bc-8d89-ce629734837c"). InnerVolumeSpecName "kube-api-access-7gdvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:38.006262 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.006197    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm" (OuterVolumeSpecName: "dshm") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.006297 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.006267    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5" (OuterVolumeSpecName: "kube-api-access-6lls5") pod "67163dc8-4810-440d-82a8-9065dae51501" (UID: "67163dc8-4810-440d-82a8-9065dae51501"). InnerVolumeSpecName "kube-api-access-6lls5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:38.105215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105132    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.105215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.105215 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105211    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105242    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105279    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105365    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sxs2\" (UniqueName: \"kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.105482 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7nzw\" (UniqueName: \"kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105499    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105508    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home" (OuterVolumeSpecName: "home") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105529    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home\") pod \"deb8e862-f906-4dc9-8a92-b4cf74969eed\" (UID: \"deb8e862-f906-4dc9-8a92-b4cf74969eed\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105675    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrnw\" (UniqueName: \"kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw\") pod \"dd633e40-47b6-42c9-8ebe-5067fe392e37\" (UID: \"dd633e40-47b6-42c9-8ebe-5067fe392e37\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105711    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir\") pod \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\" (UID: \"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0\") "
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105788    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache" (OuterVolumeSpecName: "model-cache") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106058 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.105937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106292    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106306    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdvg\" (UniqueName: \"kubernetes.io/projected/1e498028-5ba1-46bc-8d89-ce629734837c-kube-api-access-7gdvg\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106323    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106337    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106350    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e498028-5ba1-46bc-8d89-ce629734837c-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106366    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lls5\" (UniqueName: \"kubernetes.io/projected/67163dc8-4810-440d-82a8-9065dae51501-kube-api-access-6lls5\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106380    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67163dc8-4810-440d-82a8-9065dae51501-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106393    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106405    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106418    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e498028-5ba1-46bc-8d89-ce629734837c-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106431    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67163dc8-4810-440d-82a8-9065dae51501-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106445    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.106582 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106459    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.107435 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.106659    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home" (OuterVolumeSpecName: "home") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.108230 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.108199    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw" (OuterVolumeSpecName: "kube-api-access-h7nzw") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "kube-api-access-h7nzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:38.108525 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.108503    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home" (OuterVolumeSpecName: "home") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.108704 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.108683    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.109218 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.109190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:28:38.109484 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.109454    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:28:38.109759 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.109730    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm" (OuterVolumeSpecName: "dshm") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.109848 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.109824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm" (OuterVolumeSpecName: "dshm") pod "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" (UID: "a276bee1-795a-4c1b-8bfb-1fdf2fd117e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.110134 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.110090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2" (OuterVolumeSpecName: "kube-api-access-7sxs2") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "kube-api-access-7sxs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:38.110460 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.110435    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm" (OuterVolumeSpecName: "dshm") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 13:28:38.110575 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.110555    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "deb8e862-f906-4dc9-8a92-b4cf74969eed" (UID: "deb8e862-f906-4dc9-8a92-b4cf74969eed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:28:38.110929 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.110858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw" (OuterVolumeSpecName: "kube-api-access-rtrnw") pod "dd633e40-47b6-42c9-8ebe-5067fe392e37" (UID: "dd633e40-47b6-42c9-8ebe-5067fe392e37"). InnerVolumeSpecName "kube-api-access-rtrnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:28:38.207509 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207476    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207509 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207509    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207522    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207536    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207548    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-tmp-dir\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207559    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207572    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sxs2\" (UniqueName: \"kubernetes.io/projected/deb8e862-f906-4dc9-8a92-b4cf74969eed-kube-api-access-7sxs2\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207586    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8e862-f906-4dc9-8a92-b4cf74969eed-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207599    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7nzw\" (UniqueName: \"kubernetes.io/projected/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0-kube-api-access-h7nzw\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207611    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-model-cache\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207625    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd633e40-47b6-42c9-8ebe-5067fe392e37-tls-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207637    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8e862-f906-4dc9-8a92-b4cf74969eed-home\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207649    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd633e40-47b6-42c9-8ebe-5067fe392e37-dshm\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.207689 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.207661    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtrnw\" (UniqueName: \"kubernetes.io/projected/dd633e40-47b6-42c9-8ebe-5067fe392e37-kube-api-access-rtrnw\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:28:38.853466 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.853386    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"
Sep 14 13:28:38.853466 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.853406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9" event={"ID":"67163dc8-4810-440d-82a8-9065dae51501","Type":"ContainerDied","Data":"61290af5446fe5effe39bac732fb93a74aae23d36db9162e5f51b5dcc205ca50"}
Sep 14 13:28:38.853466 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.853456    2559 scope.go:117] "RemoveContainer" containerID="c76675ef020976bb4c56ed1616b7825f9071acf7fb5b72081a4aea4d1c775faa"
Sep 14 13:28:38.854976 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.854951    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"
Sep 14 13:28:38.855374 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.854978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k" event={"ID":"a276bee1-795a-4c1b-8bfb-1fdf2fd117e0","Type":"ContainerDied","Data":"a2b5259fdf9ccf08159ab7740f2afc04d8c8a2b9aee2c6ba91b6bbf59135e854"}
Sep 14 13:28:38.856733 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.856712    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"
Sep 14 13:28:38.856842 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.856735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd" event={"ID":"deb8e862-f906-4dc9-8a92-b4cf74969eed","Type":"ContainerDied","Data":"5c9c71bfce05e3e460d2bd52b71457f8b2d9ab280b01cfee6296f18e49506160"}
Sep 14 13:28:38.858547 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.858529    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"
Sep 14 13:28:38.858632 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.858561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l" event={"ID":"dd633e40-47b6-42c9-8ebe-5067fe392e37","Type":"ContainerDied","Data":"fa7c3b8b5d243d4f3d0c587e9595722d40ad43f33acfe1f66277ba4509b1c073"}
Sep 14 13:28:38.860187 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.860167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p" event={"ID":"1e498028-5ba1-46bc-8d89-ce629734837c","Type":"ContainerDied","Data":"43f17f00461bec2957aab9a33d01cf7e0d5b9f19af5c2cc2a6c36fee11dd9b31"}
Sep 14 13:28:38.860257 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.860233    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"
Sep 14 13:28:38.864328 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.864312    2559 scope.go:117] "RemoveContainer" containerID="0d5b6b67487ffc74ba2f7b3f23ffc2483478bf3cdfb2028e9cc681c769b95fdc"
Sep 14 13:28:38.874194 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.874157    2559 scope.go:117] "RemoveContainer" containerID="a810056d0a16830b2b494fcaf17bc8e05f3520769d8474d88da612a714c133cd"
Sep 14 13:28:38.882089 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.882072    2559 scope.go:117] "RemoveContainer" containerID="9b8394798c721a70594727c4399b55bac4fe900798f3f433ad9f8b3029383ecd"
Sep 14 13:28:38.889499 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.889486    2559 scope.go:117] "RemoveContainer" containerID="8e6174415cc66f3337641a499107422317c8288a2496e9eda5c598b41acf38c1"
Sep 14 13:28:38.911644 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.911622    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:28:38.934715 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.934691    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-2-w0-aea349-kserve-7765879789-fwp6k"]
Sep 14 13:28:38.973220 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.973200    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:28:38.981579 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:38.981559    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/distinct-w0-aea349-kserve-6b47c495f8-n86z9"]
Sep 14 13:28:39.031349 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.031325    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:28:39.061188 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.061162    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/embedding-w0-aea349-kserve-646bb944c9-2ds6p"]
Sep 14 13:28:39.110953 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.110891    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:28:39.118563 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.118541    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/simulator-w0-aea349-kserve-75bd476f8b-vgt2l"]
Sep 14 13:28:39.173598 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.173576    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:28:39.193514 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:39.193496    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-aea349/premium-w0-aea349-kserve-656b859675-dp4vd"]
Sep 14 13:28:40.684158 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:40.684125    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e498028-5ba1-46bc-8d89-ce629734837c" path="/var/lib/kubelet/pods/1e498028-5ba1-46bc-8d89-ce629734837c/volumes"
Sep 14 13:28:40.684536 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:40.684497    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67163dc8-4810-440d-82a8-9065dae51501" path="/var/lib/kubelet/pods/67163dc8-4810-440d-82a8-9065dae51501/volumes"
Sep 14 13:28:40.684831 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:40.684818    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" path="/var/lib/kubelet/pods/a276bee1-795a-4c1b-8bfb-1fdf2fd117e0/volumes"
Sep 14 13:28:40.685481 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:40.685465    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd633e40-47b6-42c9-8ebe-5067fe392e37" path="/var/lib/kubelet/pods/dd633e40-47b6-42c9-8ebe-5067fe392e37/volumes"
Sep 14 13:28:40.685824 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:40.685812    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb8e862-f906-4dc9-8a92-b4cf74969eed" path="/var/lib/kubelet/pods/deb8e862-f906-4dc9-8a92-b4cf74969eed/volumes"
Sep 14 13:28:52.539122 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:28:52.539080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:29:00.965222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:00.965185    2559 scope.go:117] "RemoveContainer" containerID="5d558a895bf274eae0c99c912fe790a549555bd9f2b00effb900be46a95d71f2"
Sep 14 13:29:11.542456 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:11.542416    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:29:27.576620 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.576545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:29:27.577029 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.576774    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" podUID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" containerName="maas-api" containerID="cri-o://d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c" gracePeriod=30
Sep 14 13:29:27.818306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.818281    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:29:27.949174 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.949085    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5s8k\" (UniqueName: \"kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k\") pod \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") "
Sep 14 13:29:27.949174 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.949133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca\") pod \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") "
Sep 14 13:29:27.949174 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.949174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs\") pod \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") "
Sep 14 13:29:27.949405 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.949216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") pod \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\" (UID: \"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea\") "
Sep 14 13:29:27.949507 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.949485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" (UID: "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:29:27.951398 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.951356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" (UID: "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:29:27.951516 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.951377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" (UID: "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:29:27.951516 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:27.951485    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k" (OuterVolumeSpecName: "kube-api-access-f5s8k") pod "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" (UID: "9f9296c1-bce4-4047-8f8d-ab548bc4d4ea"). InnerVolumeSpecName "kube-api-access-f5s8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:29:28.050640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.050599    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.050640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.050627    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5s8k\" (UniqueName: \"kubernetes.io/projected/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-kube-api-access-f5s8k\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.050640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.050638    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.050640 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.050648    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:29:28.141472 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.141435    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" containerID="d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c" exitCode=0
Sep 14 13:29:28.141673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.141480    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"
Sep 14 13:29:28.141673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.141506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" event={"ID":"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea","Type":"ContainerDied","Data":"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"}
Sep 14 13:29:28.141673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.141558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr" event={"ID":"9f9296c1-bce4-4047-8f8d-ab548bc4d4ea","Type":"ContainerDied","Data":"6f317c389f4230d4dfc926f2cd729f2b2c5dceb1b339a604660df80d1a54cf2b"}
Sep 14 13:29:28.141673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.141588    2559 scope.go:117] "RemoveContainer" containerID="d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"
Sep 14 13:29:28.151234 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.151217    2559 scope.go:117] "RemoveContainer" containerID="d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"
Sep 14 13:29:28.151521 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:29:28.151499    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c\": container with ID starting with d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c not found: ID does not exist" containerID="d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"
Sep 14 13:29:28.151591 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.151533    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c"} err="failed to get container status \"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c\": rpc error: code = NotFound desc = could not find container \"d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c\": container with ID starting with d35ff5cb41ddc2fed731fa91fcf44558e6881430b46ffa5ecf81224b26fee33c not found: ID does not exist"
Sep 14 13:29:28.175705 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.175677    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:29:28.183272 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.183248    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7f78b4-7dc55b9b56-jn2xr"]
Sep 14 13:29:28.683007 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:28.682978    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" path="/var/lib/kubelet/pods/9f9296c1-bce4-4047-8f8d-ab548bc4d4ea/volumes"
Sep 14 13:29:30.311647 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:30.311612    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:29:41.163090 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:29:41.163049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:31:03.289165 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:31:03.289121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:31:30.477443 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:31:30.477407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:31:38.583325 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:31:38.583286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:31:45.578345 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:31:45.578305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:32:07.689911 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:32:07.689863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:32:13.681680 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:32:13.681641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:33:00.818553 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:33:00.818520    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:33:00.835708 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:33:00.835685    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8jch_973513d5-904f-4e9b-8b01-cc403a4e44d9/ovn-acl-logging/0.log"
Sep 14 13:33:39.099673 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:33:39.099630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:33:45.709739 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:33:45.709701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:33:54.394944 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:33:54.394852    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:02.911209 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:02.911168    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:15.190317 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:15.190281    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:24.991545 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:24.991508    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:31.575547 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.575515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:31.906898 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.906804    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907228    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb8e862-f906-4dc9-8a92-b4cf74969eed" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907253    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb8e862-f906-4dc9-8a92-b4cf74969eed" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907266    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd633e40-47b6-42c9-8ebe-5067fe392e37" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907274    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd633e40-47b6-42c9-8ebe-5067fe392e37" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907293    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67163dc8-4810-440d-82a8-9065dae51501" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907302    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="67163dc8-4810-440d-82a8-9065dae51501" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907322    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" containerName="maas-api"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907331    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" containerName="maas-api"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907347    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907355    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907387    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c68d79-1b6b-429e-a5ea-520596efffe0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907395    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c68d79-1b6b-429e-a5ea-520596efffe0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907406    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e498028-5ba1-46bc-8d89-ce629734837c" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907415    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e498028-5ba1-46bc-8d89-ce629734837c" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907507    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="67163dc8-4810-440d-82a8-9065dae51501" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907517    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a276bee1-795a-4c1b-8bfb-1fdf2fd117e0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907527    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9296c1-bce4-4047-8f8d-ab548bc4d4ea" containerName="maas-api"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907535    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e498028-5ba1-46bc-8d89-ce629734837c" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907545    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c68d79-1b6b-429e-a5ea-520596efffe0" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907553    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd633e40-47b6-42c9-8ebe-5067fe392e37" containerName="main"
Sep 14 13:34:31.907816 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.907561    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb8e862-f906-4dc9-8a92-b4cf74969eed" containerName="main"
Sep 14 13:34:31.910779 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.910763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:31.914185 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.914137    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 14 13:34:31.915336 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.915275    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 13:34:31.915458 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.915336    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p2mv8\""
Sep 14 13:34:31.915458 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.915395    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 13:34:31.915458 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.915426    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 14 13:34:31.934754 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.934733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:31.992288 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.992259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:31.992418 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.992358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:31.992418 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.992385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd46f\" (UniqueName: \"kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:31.992490 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:31.992417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.093634 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.093606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.093739 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.093676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.093739 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.093699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd46f\" (UniqueName: \"kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.093739 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.093723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.094453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.094427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.096338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.096308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.096431 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.096373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.104306 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.104283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd46f\" (UniqueName: \"kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f\") pod \"maas-api-58bc4d7659-9fggp\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") " pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.221789 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.221763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:32.494369 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.494345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:32.495953 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:34:32.495923    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efa5aea_1dac_4f8b_8581_ca3f421d695e.slice/crio-a2e441243c322fe03d98a12dd5877be44fccb4d68d8ade09c92b08d99668831b WatchSource:0}: Error finding container a2e441243c322fe03d98a12dd5877be44fccb4d68d8ade09c92b08d99668831b: Status 404 returned error can't find the container with id a2e441243c322fe03d98a12dd5877be44fccb4d68d8ade09c92b08d99668831b
Sep 14 13:34:32.497171 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.497153    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 13:34:32.787898 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:32.787811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" event={"ID":"6efa5aea-1dac-4f8b-8581-ca3f421d695e","Type":"ContainerStarted","Data":"a2e441243c322fe03d98a12dd5877be44fccb4d68d8ade09c92b08d99668831b"}
Sep 14 13:34:33.794464 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:33.794427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" event={"ID":"6efa5aea-1dac-4f8b-8581-ca3f421d695e","Type":"ContainerStarted","Data":"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"}
Sep 14 13:34:33.794830 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:33.794558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:33.816245 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:33.816199    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" podStartSLOduration=2.249957254 podStartE2EDuration="2.816186025s" totalImagesPullingTime="566.228771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:34:33.814711839 +0000 UTC m=+2193.651220673" watchObservedRunningTime="2026-09-14 13:34:33.816186025 +0000 UTC m=+2193.652694864"
Sep 14 13:34:39.397449 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:39.397407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:39.806243 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:39.806209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:40.063838 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.063750    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"]
Sep 14 13:34:40.067183 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.067167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.077601 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.077574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"]
Sep 14 13:34:40.169393 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.169363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-openshift-service-ca\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.169543 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.169402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-maas-api-tls\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.169543 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.169441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmf6v\" (UniqueName: \"kubernetes.io/projected/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-kube-api-access-zmf6v\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.169543 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.169505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-metrics-certs\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.270744 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.270713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-openshift-service-ca\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.270872 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.270751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-maas-api-tls\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.270872 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.270787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmf6v\" (UniqueName: \"kubernetes.io/projected/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-kube-api-access-zmf6v\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.270872 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.270834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-metrics-certs\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.271387 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.271351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-openshift-service-ca\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.273346 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.273326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-maas-api-tls\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.273434 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.273374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-metrics-certs\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.278755 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.278736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmf6v\" (UniqueName: \"kubernetes.io/projected/07f958bd-5467-4b03-a2a5-dd423bb8b0d2-kube-api-access-zmf6v\") pod \"maas-api-85cc6df5f9-b87ll\" (UID: \"07f958bd-5467-4b03-a2a5-dd423bb8b0d2\") " pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.378302 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.378215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:40.658312 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.658282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"]
Sep 14 13:34:40.659310 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:34:40.659283    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f958bd_5467_4b03_a2a5_dd423bb8b0d2.slice/crio-24d0ade92e3c91ea2eac1b3eafd04a332a7d8e99a12a134dc922159a917091fb WatchSource:0}: Error finding container 24d0ade92e3c91ea2eac1b3eafd04a332a7d8e99a12a134dc922159a917091fb: Status 404 returned error can't find the container with id 24d0ade92e3c91ea2eac1b3eafd04a332a7d8e99a12a134dc922159a917091fb
Sep 14 13:34:40.836453 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:40.836420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll" event={"ID":"07f958bd-5467-4b03-a2a5-dd423bb8b0d2","Type":"ContainerStarted","Data":"24d0ade92e3c91ea2eac1b3eafd04a332a7d8e99a12a134dc922159a917091fb"}
Sep 14 13:34:41.843734 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:41.843698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll" event={"ID":"07f958bd-5467-4b03-a2a5-dd423bb8b0d2","Type":"ContainerStarted","Data":"0d1a73634d929194a805f598cd2e99e9232c1eb1511ff26d918c4c6264d60446"}
Sep 14 13:34:41.844179 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:41.843763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:41.861079 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:41.860993    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll" podStartSLOduration=1.5583024760000002 podStartE2EDuration="1.860974901s" totalImagesPullingTime="302.672425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 13:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:34:41.860675479 +0000 UTC m=+2201.697184327" watchObservedRunningTime="2026-09-14 13:34:41.860974901 +0000 UTC m=+2201.697483734"
Sep 14 13:34:46.382056 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:46.382020    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:47.854519 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:47.854491    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85cc6df5f9-b87ll"
Sep 14 13:34:47.907603 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:47.907563    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:47.907792 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:47.907770    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" podUID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" containerName="maas-api" containerID="cri-o://b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5" gracePeriod=30
Sep 14 13:34:48.155321 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.155295    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:48.244593 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.244554    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls\") pod \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") "
Sep 14 13:34:48.244762 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.244673    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca\") pod \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") "
Sep 14 13:34:48.244762 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.244708    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs\") pod \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") "
Sep 14 13:34:48.244762 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.244746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd46f\" (UniqueName: \"kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f\") pod \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\" (UID: \"6efa5aea-1dac-4f8b-8581-ca3f421d695e\") "
Sep 14 13:34:48.245148 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.245119    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6efa5aea-1dac-4f8b-8581-ca3f421d695e" (UID: "6efa5aea-1dac-4f8b-8581-ca3f421d695e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 13:34:48.246769 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.246740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6efa5aea-1dac-4f8b-8581-ca3f421d695e" (UID: "6efa5aea-1dac-4f8b-8581-ca3f421d695e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:34:48.246952 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.246927    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6efa5aea-1dac-4f8b-8581-ca3f421d695e" (UID: "6efa5aea-1dac-4f8b-8581-ca3f421d695e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 13:34:48.247018 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.246997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f" (OuterVolumeSpecName: "kube-api-access-dd46f") pod "6efa5aea-1dac-4f8b-8581-ca3f421d695e" (UID: "6efa5aea-1dac-4f8b-8581-ca3f421d695e"). InnerVolumeSpecName "kube-api-access-dd46f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 13:34:48.346373 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.346337    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6efa5aea-1dac-4f8b-8581-ca3f421d695e-openshift-service-ca\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:34:48.346373 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.346367    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-metrics-certs\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:34:48.346373 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.346377    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd46f\" (UniqueName: \"kubernetes.io/projected/6efa5aea-1dac-4f8b-8581-ca3f421d695e-kube-api-access-dd46f\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:34:48.346596 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.346385    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6efa5aea-1dac-4f8b-8581-ca3f421d695e-maas-api-tls\") on node \"ip-10-0-137-35.ec2.internal\" DevicePath \"\""
Sep 14 13:34:48.882778 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.882743    2559 generic.go:356] "Generic (PLEG): container finished" podID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" containerID="b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5" exitCode=0
Sep 14 13:34:48.883222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.882799    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"
Sep 14 13:34:48.883222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.882813    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" event={"ID":"6efa5aea-1dac-4f8b-8581-ca3f421d695e","Type":"ContainerDied","Data":"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"}
Sep 14 13:34:48.883222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.882857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp" event={"ID":"6efa5aea-1dac-4f8b-8581-ca3f421d695e","Type":"ContainerDied","Data":"a2e441243c322fe03d98a12dd5877be44fccb4d68d8ade09c92b08d99668831b"}
Sep 14 13:34:48.883222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.882895    2559 scope.go:117] "RemoveContainer" containerID="b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"
Sep 14 13:34:48.892251 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.892228    2559 scope.go:117] "RemoveContainer" containerID="b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"
Sep 14 13:34:48.892514 ip-10-0-137-35 kubenswrapper[2559]: E0914 13:34:48.892496    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5\": container with ID starting with b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5 not found: ID does not exist" containerID="b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"
Sep 14 13:34:48.892561 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.892521    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5"} err="failed to get container status \"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5\": rpc error: code = NotFound desc = could not find container \"b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5\": container with ID starting with b652a36a2f41cee15d3eb08e23b506582dd60dd1ce94eb2417070b2d8542adb5 not found: ID does not exist"
Sep 14 13:34:48.902178 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.902152    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:48.906127 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:48.906096    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-58bc4d7659-9fggp"]
Sep 14 13:34:50.683019 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:50.682983    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" path="/var/lib/kubelet/pods/6efa5aea-1dac-4f8b-8581-ca3f421d695e/volumes"
Sep 14 13:34:51.475563 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:51.475531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:34:58.291871 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:34:58.291832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-tsrf8"]
Sep 14 13:35:07.765225 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:07.765194    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-mgllv_a7e9e984-a5fd-40a1-af22-28ac819dbfce/copy-manifests/0.log"
Sep 14 13:35:07.773494 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:07.773472    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-mgllv_a7e9e984-a5fd-40a1-af22-28ac819dbfce/manager/0.log"
Sep 14 13:35:08.233094 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:08.233064    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85cc6df5f9-b87ll_07f958bd-5467-4b03-a2a5-dd423bb8b0d2/maas-api/0.log"
Sep 14 13:35:08.454258 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:08.454227    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29823195-smv4h_2fefce37-99e8-4e33-b719-d265614e58d1/cleanup/0.log"
Sep 14 13:35:09.793480 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:09.793450    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-cd58v_9202e18d-8fc6-4498-80d1-4300a80220a6/kuadrant-console-plugin/0.log"
Sep 14 13:35:10.047583 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:10.047507    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-tsrf8_18bba769-84f8-4696-a69d-ce7e20a7d711/limitador/0.log"
Sep 14 13:35:10.843082 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:10.843052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8fdbb99c-w7h4f_da10d5a5-26fc-468f-80b5-cd2d50f53851/kube-auth-proxy/0.log"
Sep 14 13:35:11.315499 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:11.315461    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfb5dc75b-tzm4f_34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9/router/0.log"
Sep 14 13:35:11.779563 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:11.779532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gw9nb_16e97275-e674-4db3-8cbe-a05ac27f7701/main/0.log"
Sep 14 13:35:12.006193 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:12.006158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tw2pc_3db84b7a-2e7c-496e-9bdf-5a2a8e6d59e9/main/0.log"
Sep 14 13:35:12.229450 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:12.229423    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lhxpw_66f29da5-06dc-49c6-b07f-d4fcb0a3d362/main/0.log"
Sep 14 13:35:12.340175 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:12.340142    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gvgzm_64eb2f17-6155-47a6-b1f8-e5e6ae338add/main/0.log"
Sep 14 13:35:21.005649 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:21.005616    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-crf9v_c2028780-5f7e-4ceb-8333-a6b1daf07c05/global-pull-secret-syncer/0.log"
Sep 14 13:35:21.166691 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:21.166660    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnc7p_993a1fa2-5aa8-4fb2-b7d7-b3f5446158ff/konnectivity-agent/0.log"
Sep 14 13:35:21.256350 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:21.256278    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-35.ec2.internal_e14f36cc9cd4b7b9c71314199a9dd97e/haproxy/0.log"
Sep 14 13:35:25.459901 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:25.459853    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-cd58v_9202e18d-8fc6-4498-80d1-4300a80220a6/kuadrant-console-plugin/0.log"
Sep 14 13:35:25.545832 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:25.545804    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-tsrf8_18bba769-84f8-4696-a69d-ce7e20a7d711/limitador/0.log"
Sep 14 13:35:27.033411 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.033378    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/alertmanager/0.log"
Sep 14 13:35:27.059842 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.059813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/config-reloader/0.log"
Sep 14 13:35:27.084421 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.084396    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/kube-rbac-proxy-web/0.log"
Sep 14 13:35:27.114333 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.114305    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/kube-rbac-proxy/0.log"
Sep 14 13:35:27.142747 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.142698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/kube-rbac-proxy-metric/0.log"
Sep 14 13:35:27.171341 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.171316    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/prom-label-proxy/0.log"
Sep 14 13:35:27.196416 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.196391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9ce7b02-3890-4019-ae37-fabada11c34d/init-config-reloader/0.log"
Sep 14 13:35:27.268567 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.268538    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mrsd_40595e35-e5d2-48de-874c-c6419bc4449a/kube-state-metrics/0.log"
Sep 14 13:35:27.289612 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.289515    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mrsd_40595e35-e5d2-48de-874c-c6419bc4449a/kube-rbac-proxy-main/0.log"
Sep 14 13:35:27.312606 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.312584    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mrsd_40595e35-e5d2-48de-874c-c6419bc4449a/kube-rbac-proxy-self/0.log"
Sep 14 13:35:27.371153 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.371125    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-kn29p_59a9ab3b-92a9-4bd9-bfd0-614c3c6bcfc6/monitoring-plugin/0.log"
Sep 14 13:35:27.400760 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.400731    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67jzm_7199a045-e839-4f91-9bde-5c6efc05f08d/node-exporter/0.log"
Sep 14 13:35:27.426435 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.426412    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67jzm_7199a045-e839-4f91-9bde-5c6efc05f08d/kube-rbac-proxy/0.log"
Sep 14 13:35:27.451451 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.451428    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-67jzm_7199a045-e839-4f91-9bde-5c6efc05f08d/init-textfile/0.log"
Sep 14 13:35:27.644547 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.644467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wwdgf_bf8a897b-e809-4c56-8f02-ea9ec52d8a17/kube-rbac-proxy-main/0.log"
Sep 14 13:35:27.677305 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.677281    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wwdgf_bf8a897b-e809-4c56-8f02-ea9ec52d8a17/kube-rbac-proxy-self/0.log"
Sep 14 13:35:27.705167 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.705142    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wwdgf_bf8a897b-e809-4c56-8f02-ea9ec52d8a17/openshift-state-metrics/0.log"
Sep 14 13:35:27.980940 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:27.980909    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-2m6k6_fb4285b1-8e47-4557-9a65-80e6821c585e/prometheus-operator/0.log"
Sep 14 13:35:28.011553 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:28.011526    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-2m6k6_fb4285b1-8e47-4557-9a65-80e6821c585e/kube-rbac-proxy/0.log"
Sep 14 13:35:28.067222 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:28.067192    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-wqlcl_60ca7160-7583-4ac4-8111-fab93391faa0/prometheus-operator-admission-webhook/0.log"
Sep 14 13:35:31.350338 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.350291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"]
Sep 14 13:35:31.350720 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.350709    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" containerName="maas-api"
Sep 14 13:35:31.350764 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.350724    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" containerName="maas-api"
Sep 14 13:35:31.350800 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.350792    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6efa5aea-1dac-4f8b-8581-ca3f421d695e" containerName="maas-api"
Sep 14 13:35:31.354164 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.354145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.357157 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.357135    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv987\"/\"kube-root-ca.crt\""
Sep 14 13:35:31.358512 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.358494    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rv987\"/\"default-dockercfg-rvpnh\""
Sep 14 13:35:31.358622 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.358494    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rv987\"/\"openshift-service-ca.crt\""
Sep 14 13:35:31.363890 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.363853    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"]
Sep 14 13:35:31.441308 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.441276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-proc\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.441308 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.441309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-podres\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.441538 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.441339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88nlr\" (UniqueName: \"kubernetes.io/projected/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-kube-api-access-88nlr\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.441538 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.441427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-sys\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.441538 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.441469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-lib-modules\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542542 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-proc\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542542 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-podres\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88nlr\" (UniqueName: \"kubernetes.io/projected/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-kube-api-access-88nlr\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-sys\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-proc\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-lib-modules\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-sys\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-podres\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.542803 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.542786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-lib-modules\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.551671 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.551646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88nlr\" (UniqueName: \"kubernetes.io/projected/739a309a-5e8c-4b57-a867-a0a28dfb0b8e-kube-api-access-88nlr\") pod \"perf-node-gather-daemonset-w84ns\" (UID: \"739a309a-5e8c-4b57-a867-a0a28dfb0b8e\") " pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.665052 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.664957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:31.939387 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:31.939299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"]
Sep 14 13:35:31.940936 ip-10-0-137-35 kubenswrapper[2559]: W0914 13:35:31.940908    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod739a309a_5e8c_4b57_a867_a0a28dfb0b8e.slice/crio-8daa7269101bd2cd54ff2f31baa34acd07e2da27d9b5bf312dda2c1a51e916b5 WatchSource:0}: Error finding container 8daa7269101bd2cd54ff2f31baa34acd07e2da27d9b5bf312dda2c1a51e916b5: Status 404 returned error can't find the container with id 8daa7269101bd2cd54ff2f31baa34acd07e2da27d9b5bf312dda2c1a51e916b5
Sep 14 13:35:32.124612 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:32.124577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns" event={"ID":"739a309a-5e8c-4b57-a867-a0a28dfb0b8e","Type":"ContainerStarted","Data":"1efb0843fc84788cb8a1480b67b920aad8c36ffe015c0c2c72905f5dbd64e8ba"}
Sep 14 13:35:32.124795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:32.124637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns" event={"ID":"739a309a-5e8c-4b57-a867-a0a28dfb0b8e","Type":"ContainerStarted","Data":"8daa7269101bd2cd54ff2f31baa34acd07e2da27d9b5bf312dda2c1a51e916b5"}
Sep 14 13:35:32.124795 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:32.124755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:32.142323 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:32.142274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns" podStartSLOduration=1.142258009 podStartE2EDuration="1.142258009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 13:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 13:35:32.140316818 +0000 UTC m=+2251.976825665" watchObservedRunningTime="2026-09-14 13:35:32.142258009 +0000 UTC m=+2251.978766884"
Sep 14 13:35:33.294856 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:33.294816    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r28ld_dca459ee-1d98-4ab8-83d8-f1aadab5a7c2/dns/0.log"
Sep 14 13:35:33.318896 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:33.318848    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r28ld_dca459ee-1d98-4ab8-83d8-f1aadab5a7c2/kube-rbac-proxy/0.log"
Sep 14 13:35:33.401740 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:33.401720    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-42gqn_e7533ba1-9705-411d-ad8f-d099e90a6f7e/dns-node-resolver/0.log"
Sep 14 13:35:34.064381 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:34.064351    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwjsd_53170467-8c0d-4b4b-ae4f-40d5af9cdfde/node-ca/0.log"
Sep 14 13:35:35.582844 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:35.582818    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8fdbb99c-w7h4f_da10d5a5-26fc-468f-80b5-cd2d50f53851/kube-auth-proxy/0.log"
Sep 14 13:35:35.722028 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:35.721993    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfb5dc75b-tzm4f_34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9/router/0.log"
Sep 14 13:35:36.630597 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:36.630561    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4kqw_61bc7287-f2f6-48a0-83ec-16338aaa7e5a/serve-healthcheck-canary/0.log"
Sep 14 13:35:37.172634 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:37.172601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-z75ld_65e6469a-50ab-4c5f-baea-782c744a3328/insights-operator/0.log"
Sep 14 13:35:37.173379 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:37.173360    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-z75ld_65e6469a-50ab-4c5f-baea-782c744a3328/insights-operator/1.log"
Sep 14 13:35:37.443094 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:37.443020    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjp_955dfa97-f575-418c-a8e1-5db579097e89/kube-rbac-proxy/0.log"
Sep 14 13:35:37.467236 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:37.467208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjp_955dfa97-f575-418c-a8e1-5db579097e89/exporter/0.log"
Sep 14 13:35:37.491422 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:37.491394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-smwjp_955dfa97-f575-418c-a8e1-5db579097e89/extractor/0.log"
Sep 14 13:35:38.145757 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:38.145727    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rv987/perf-node-gather-daemonset-w84ns"
Sep 14 13:35:40.368150 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:40.368124    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-mgllv_a7e9e984-a5fd-40a1-af22-28ac819dbfce/manager/0.log"
Sep 14 13:35:40.391801 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:40.391770    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b94df8b4-mgllv_a7e9e984-a5fd-40a1-af22-28ac819dbfce/copy-manifests/0.log"
Sep 14 13:35:41.909661 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:41.909582    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b9c8bb87f-pjls8_223616a1-345f-41c1-bde8-87570e6d6c3e/manager/1.log"
Sep 14 13:35:41.910014 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:41.909861    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b9c8bb87f-pjls8_223616a1-345f-41c1-bde8-87570e6d6c3e/manager/0.log"
Sep 14 13:35:42.454017 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:42.453993    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8fdbb99c-w7h4f_da10d5a5-26fc-468f-80b5-cd2d50f53851/kube-auth-proxy/0.log"
Sep 14 13:35:42.548295 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:42.548269    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfb5dc75b-tzm4f_34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9/router/0.log"
Sep 14 13:35:44.448208 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:44.448169    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8fdbb99c-w7h4f_da10d5a5-26fc-468f-80b5-cd2d50f53851/kube-auth-proxy/0.log"
Sep 14 13:35:44.554760 ip-10-0-137-35 kubenswrapper[2559]: I0914 13:35:44.554737    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bfb5dc75b-tzm4f_34f3c7f6-c8fd-401c-bd30-0a8f87cb36a9/router/0.log"