Jul 20 19:25:30.168176 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 19:25:30.168187 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 19:25:30.168196 ip-10-0-132-45 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 19:25:30.168511 ip-10-0-132-45 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 19:25:40.284671 ip-10-0-132-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 19:25:40.284693 ip-10-0-132-45 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a03d92b0f90040a0b9b683b076efb4e7 --
Jul 20 19:27:37.777063 ip-10-0-132-45 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.636445    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640847    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640861    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640864    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640867    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640871    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640874    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640877    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.653207 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640880    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640883    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640886    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640889    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640893    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640896    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640898    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640901    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640904    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640907    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640910    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640913    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640916    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640919    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640930    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640934    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640937    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640940    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640943    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640946    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.654508 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640949    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640952    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640955    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640958    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640960    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640963    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640966    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640969    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640972    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640975    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640977    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640980    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640984    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640988    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640993    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.640997    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641000    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641003    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641006    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641009    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.655402 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641012    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641015    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641018    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641020    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641023    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641026    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641028    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641031    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641034    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641037    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641040    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641043    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641046    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641048    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641051    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641054    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641056    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641059    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641062    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641065    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.657617 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641067    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641070    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641073    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641076    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641080    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641082    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641085    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641087    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641090    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641093    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641095    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641098    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641101    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641104    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641106    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641109    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641112    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641115    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641118    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.658478 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641124    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641127    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641130    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641133    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641137    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641141    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641145    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641148    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641150    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641154    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641157    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641160    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641162    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641972    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641982    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641985    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641988    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641991    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641994    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.659782 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.641998    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642001    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642004    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642007    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642009    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642012    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642015    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642018    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642021    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642024    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642027    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642030    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642032    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642035    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642038    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642041    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642044    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642047    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642049    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642052    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.660651 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642055    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642058    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642061    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642064    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642066    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642069    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642072    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642075    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642077    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642080    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642083    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642086    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642089    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642093    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642095    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642098    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642101    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642104    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642107    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642109    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.662397 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642112    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642115    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642118    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642121    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642126    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642129    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642133    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642136    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642139    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642142    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642144    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642147    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642150    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642153    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642156    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642160    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642162    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642165    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642168    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642171    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.663258 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642173    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642176    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642179    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642181    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642184    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642188    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642191    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642194    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642198    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642201    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642204    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642207    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642210    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642213    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642216    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642219    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642221    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642224    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642227    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.664998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642229    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642232    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642235    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642238    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642240    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642243    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642246    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642248    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642251    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642253    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642256    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642259    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642262    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642264    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642664    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642669    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642672    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642676    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642679    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642683    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.665878 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642686    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642690    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642693    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642695    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642698    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642701    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642704    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642708    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642713    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642716    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642719    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642722    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642725    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642728    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642731    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642734    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642738    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642740    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642743    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642746    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.668507 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642750    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642753    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642755    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642758    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642761    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642765    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642769    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642772    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642775    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642778    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642781    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642784    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642787    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642790    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642792    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642795    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642798    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642801    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642804    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642807    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.669378 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642809    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642812    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642814    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642817    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642820    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642824    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642827    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642846    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642850    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642853    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642855    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642858    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642861    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642864    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642867    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642869    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642872    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642875    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642878    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642880    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.671602 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642887    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642890    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642892    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642895    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642898    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642901    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642904    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642907    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642910    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642913    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642916    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642920    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642924    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642927    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642931    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642934    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642939    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642942    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642944    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.672476 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642947    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642950    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642953    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642956    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642958    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642961    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642964    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642967    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642969    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642972    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642975    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642977    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642980    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.642984    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643052    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643064    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643070    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643076    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643080    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643084    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643088    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:27:38.673361 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643092    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643096    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643099    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643102    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643106    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643110    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643113    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643116    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643121    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643124    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643127    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643132    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643135    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643138    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643141    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643145    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643149    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643152    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643156    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643159    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643162    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643165    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643168    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643171    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:27:38.674253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643176    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643181    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643184    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643187    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643190    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643193    2571 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643197    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643202    2571 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643205    2571 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643208    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643211    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643214    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643218    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643221    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643225    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643228    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643233    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643236    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643239    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643242    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643244    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643247    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643251    2571 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643255    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643258    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:27:38.677333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643261    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643265    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643268    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643271    2571 flags.go:64] FLAG: --help="false"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643275    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643278    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643281    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643286    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643290    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643293    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643296    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643299    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643302    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643305    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643313    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643316    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643319    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643322    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643325    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643329    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643332    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643335    2571 flags.go:64] FLAG: --lock-file=""
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643338    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643343    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:27:38.678641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643346    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643356    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643359    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643362    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643366    2571 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643369    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643372    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643375    2571 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643378    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643383    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643386    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643391    2571 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643394    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643397    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643400    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643405    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643408    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643411    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643414    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643424    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643427    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643431    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643434    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:27:38.680401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643438    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643444    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643447    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643450    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643453    2571 flags.go:64] FLAG: --port="10250"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643456    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643459    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f96e7e8ca6dd550"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643462    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643465    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643470    2571 flags.go:64] FLAG: --register-node="true"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643473    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643477    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643480    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643483    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643486    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643490    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643493    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643496    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643499    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643503    2571 flags.go:64] FLAG: --runonce="false"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643506    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643510    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643513    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643516    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643521    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643524    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:27:38.681270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643527    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643530    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643533    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643537    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643539    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643542    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643545    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643552    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643555    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643560    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643563    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643566    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643570    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643573    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643576    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643582    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643585    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643588    2571 flags.go:64] FLAG: --v="2"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643592    2571 flags.go:64] FLAG: --version="false"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643597    2571 flags.go:64] FLAG: --vmodule=""
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643601    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.643604    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643731    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643736    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.798988 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643739    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643742    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643744    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643747    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643750    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643753    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643757    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643760    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643763    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643766    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643769    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643772    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643775    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643778    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643780    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643783    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643786    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643789    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643792    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643795    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.799839 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643798    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643800    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643803    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643808    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643811    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643813    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643816    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643819    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643823    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643826    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643844    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643847    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643850    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643853    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643856    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643858    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643862    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643864    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643872    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.802043 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643875    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643878    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643881    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643885    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643887    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643891    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643894    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643896    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643899    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643902    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643906    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643908    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643911    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643914    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643918    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643920    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643924    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643927    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643930    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643933    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.802921 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643936    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643939    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643941    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643944    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643948    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643950    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643954    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643958    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643961    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643964    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643968    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643972    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643975    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643977    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643980    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643983    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643986    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643988    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643991    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643994    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.805098 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.643997    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644000    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644003    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644006    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644009    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644012    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644014    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644017    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644021    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644024    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644027    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644030    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644032    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644036    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644038    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644041    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644044    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.805980 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.644047    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.644917    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.651917    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.651932    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.651948    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.651954    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652015    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652022    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652026    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652030    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652033    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652037    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652040    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652043    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.808608 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652046    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652049    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652052    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652055    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652059    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652062    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652066    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652070    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652073    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652075    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652079    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652082    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652085    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652088    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652091    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652094    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652097    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652099    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652102    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.809484 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652110    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652115    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652118    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652121    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652124    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652127    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652131    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652134    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652137    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652139    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652142    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652145    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652148    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652151    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652153    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652156    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652159    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652161    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652165    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652168    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.812568 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652171    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652174    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652176    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652180    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652182    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652185    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652188    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652192    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652195    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652200    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652203    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652206    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652209    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652214    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652217    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652220    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652225    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652228    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652231    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652234    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.813464 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652237    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652240    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652243    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652246    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652248    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652251    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652254    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652257    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652259    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652262    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652265    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652268    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652271    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652274    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652277    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652280    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652282    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652285    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652288    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652291    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.816982 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652293    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652296    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652299    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652302    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652304    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652309    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652311    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652314    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652319    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652322    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652324    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652327    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.652332    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652450    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652455    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:27:38.817867 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652458    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652461    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652465    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652468    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652471    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652474    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652477    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652480    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652483    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652486    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652489    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652492    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652495    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652498    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652500    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652503    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652506    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652509    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652511    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:27:38.821405 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652515    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652519    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652523    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652527    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652530    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652533    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652535    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652540    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652542    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652545    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652548    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652551    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652554    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652556    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652559    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652562    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652565    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652567    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652570    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652573    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:27:38.822256 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652575    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652578    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652581    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652584    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652587    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652589    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652592    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652595    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652598    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652600    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652603    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652606    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652608    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652611    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652614    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652618    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652621    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652623    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652626    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:27:38.826611 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652630    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652633    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652636    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652639    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652641    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652644    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652647    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652649    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652652    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652655    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652658    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652661    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652664    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652666    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652669    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652672    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652675    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652678    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652680    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652683    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:27:38.827475 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652686    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652688    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652691    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652695    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652698    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652701    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652705    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652707    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652712    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652715    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652718    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652720    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652725    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652728    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652730    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652733    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652737    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652739    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:27:38.936535 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:38.652742    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.652747    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.652869    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.654963    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.656478    2571 server.go:1019] "Starting client certificate rotation"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.659083    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.660893    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.660918    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:27:38.937413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:38.660920    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.098428    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.102145    2571 log.go:25] "Validated CRI v1 image API"
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.103100    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.109774    2571 fs.go:135] Filesystem UUIDs: map[26ccfc89-05f4-4d1e-b97e-e53b18f6ef24:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dde4e550-b081-4daf-80dc-89364039e210:/dev/nvme0n1p3]
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.109794    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:27:39.199630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.114020    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:27:39.139119 ip-10-0-132-45 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.116981    2571 manager.go:216] Machine: {Timestamp:2026-07-20 19:27:39.113779293 +0000 UTC m=+1.216242636 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099211 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290e8eb4b140948b7e4076055a7ba3 SystemUUID:ec290e8e-b4b1-4094-8b7e-4076055a7ba3 BootID:a03d92b0-f900-40a0-b9b6-83b076efb4e7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:96:32:b2:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:96:32:b2:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:d1:b8:97:e3:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.117096    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.117227    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.118362    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.118391    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.120232    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.120244    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.120258    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.121076    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.122552    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127131    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127262    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127292    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127302    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127313    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127323    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127332    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:27:39.210157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127696    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.127714    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.130805    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132279    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132309    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132940    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132953    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132960    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132966    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132975    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.132981    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133130    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133135    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133142    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133147    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133162    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133171    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133894    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.133901    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.137805    2571 server.go:1268] "Started kubelet"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.137863    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.137880    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.137961    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.137803    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg5pv"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.139221    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.139233    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.139289    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.139422    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.140360    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.145811    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg5pv"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.145858    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.146324    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c4161b5db71931  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-20 19:27:39.137767729 +0000 UTC m=+1.240231087,LastTimestamp:2026-07-20 19:27:39.137767729 +0000 UTC m=+1.240231087,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.148078    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.148093    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.148165    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.148891    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.148901    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.148917    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.149034    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.149044    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:27:39.316996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.149082    2571 factory.go:55] Registering systemd factory
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.149099    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150145    2571 factory.go:153] Registering CRI-O factory
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150162    2571 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150221    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150247    2571 factory.go:103] Registering Raw factory
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150263    2571 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.150971    2571 manager.go:349] Starting recovery of all containers
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.162182    2571 manager.go:354] Recovery completed
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.167112    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171129    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171165    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171182    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171749    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171759    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171779    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.171808    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.172491    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.172519    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.172535    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.173788    2571 policy_none.go:49] "None policy: Start"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.173811    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.173826    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.176053    2571 policy_none.go:47] "Start"
Jul 20 19:27:39.319176 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.249174    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.349663 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.349634    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.378367 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.378343    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:39.382569 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.381951    2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.410528 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.410509    2571 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:27:39.410647 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.410554    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:27:39.410647 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.410565    2571 server.go:87] "Starting device plugin registration server"
Jul 20 19:27:39.410847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.410821    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:27:39.410847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.410834    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:27:39.410980 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.410965    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:27:39.411070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.411055    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:27:39.411070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.411068    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:27:39.411567 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.411538    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:27:39.411654 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.411600    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.511900 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.511833    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.513492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.512900    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.513492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.512936    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.513492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.512948    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.513492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.512983    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.520110 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.520095    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.520157 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.520120    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-45.ec2.internal\": node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.538120 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.538094    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.539954 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.539932    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:27:39.541248 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.541223    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:27:39.541334 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.541272    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:27:39.541334 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.541297    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:27:39.541457 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.541340    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:27:39.543870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.543846    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:39.638770 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.638736    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.642186 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.642162    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"]
Jul 20 19:27:39.642300 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.642241    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.643298 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.643279    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.643374 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.643315    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.643374 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.643328    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.645226 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.645213    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.645344 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.645327    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.645396 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.645362    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.645995 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.645979    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.645995 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.646003    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.646134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.646011    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.646134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.646045    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.646134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.646060    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.646134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.646014    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.647951 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.647936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.647999 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.647962    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:27:39.648677 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.648661    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:27:39.648729 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.648690    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:27:39.648729 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.648706    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:27:39.650520 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.650498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.650596 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.650531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.650596 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.650548    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fe68b5cb1b7fe1d6d7f652b5d9b720e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"6fe68b5cb1b7fe1d6d7f652b5d9b720e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.661786 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.661770    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:27:39.662172 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.661897    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:27:39.662172 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.661901    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:27:39.662172 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.661926    2571 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a91c32ceb6b1e44189a52fd1f6eeb01b-5096a304208d5b09.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-132-45.ec2.internal.18c4161b5fb4cfec\": read tcp 10.0.132.45:45860->34.236.82.228:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-132-45.ec2.internal.18c4161b5fb4cfec  default   6195 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-45.ec2.internal,UID:ip-10-0-132-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-45.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-45.ec2.internal,},FirstTimestamp:2026-07-20 19:27:39 +0000 UTC,LastTimestamp:2026-07-20 19:27:39.64332067 +0000 UTC m=+1.745784013,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-45.ec2.internal,}"
Jul 20 19:27:39.670447 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.670429    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.674193 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.674175    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-45.ec2.internal\" not found" node="ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.743588 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.743546    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.751485 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fe68b5cb1b7fe1d6d7f652b5d9b720e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"6fe68b5cb1b7fe1d6d7f652b5d9b720e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.751594 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.751594 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.751594 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6fe68b5cb1b7fe1d6d7f652b5d9b720e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-45.ec2.internal\" (UID: \"6fe68b5cb1b7fe1d6d7f652b5d9b720e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.751594 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.751744 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.751572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/624b6635e1b977b951af1431c25123e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal\" (UID: \"624b6635e1b977b951af1431c25123e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.851310 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.851230    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.952213 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:39.952175    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:39.972872 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.972833    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:39.978958 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:39.978940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:40.053283 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:40.053248    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:40.107366 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.107310    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:40.153137 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.153104    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:22:39 +0000 UTC" deadline="2028-01-02 00:03:40.7505528 +0000 UTC"
Jul 20 19:27:40.153137 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.153134    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12724h36m0.597421816s"
Jul 20 19:27:40.154203 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:40.154189    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:40.255213 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:40.255179    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:40.355832 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:40.355806    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:40.456949 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:40.456878    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-45.ec2.internal\" not found"
Jul 20 19:27:40.485020 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.484855    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:40.548847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.548816    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:40.560996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.560973    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:27:40.562133 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.562115    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal"
Jul 20 19:27:40.571339 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.571322    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:27:40.632880 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:40.632822    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624b6635e1b977b951af1431c25123e4.slice/crio-204297ec8670406b962e777ed142da68b54535d8c786d4757132599ed938c500 WatchSource:0}: Error finding container 204297ec8670406b962e777ed142da68b54535d8c786d4757132599ed938c500: Status 404 returned error can't find the container with id 204297ec8670406b962e777ed142da68b54535d8c786d4757132599ed938c500
Jul 20 19:27:40.637365 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.637348    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:27:40.642454 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:40.642429    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe68b5cb1b7fe1d6d7f652b5d9b720e.slice/crio-83b9606d979275b2dc59451d635f2ac2ed56a17495424c58a3bbf9489e709226 WatchSource:0}: Error finding container 83b9606d979275b2dc59451d635f2ac2ed56a17495424c58a3bbf9489e709226: Status 404 returned error can't find the container with id 83b9606d979275b2dc59451d635f2ac2ed56a17495424c58a3bbf9489e709226
Jul 20 19:27:40.705770 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.705739    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:40.921776 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:40.921676    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:27:41.128310 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.128271    2571 apiserver.go:52] "Watching apiserver"
Jul 20 19:27:41.136834 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.136803    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:27:41.137194 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.137172    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-mk4ml","openshift-ovn-kubernetes/ovnkube-node-cnxnl","kube-system/konnectivity-agent-9pwlw","kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qff45","openshift-dns/node-resolver-qr9f7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal","openshift-network-diagnostics/network-check-target-xqnhb","openshift-network-operator/iptables-alerter-99svg","kube-system/global-pull-secret-syncer-vqzt6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr","openshift-image-registry/node-ca-hpf7n","openshift-multus/multus-additional-cni-plugins-wwbkt","openshift-multus/multus-rzpdh"]
Jul 20 19:27:41.140369 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.140352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.143531 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143435    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:27:41.143531 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143449    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:27:41.143531 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143463    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:27:41.143824 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143575    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-brbnm\""
Jul 20 19:27:41.143824 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143575    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.143824 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.143609    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.144696 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.144674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.147026 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.147005    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:27:41.147234 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.147203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.147355 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.147342    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:27:41.147457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.147439    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:27:41.147708 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.147681    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.148786 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.148638    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:27:41.148888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.148817    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jqw89\""
Jul 20 19:27:41.148888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.148846    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:27:41.149065 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.148910    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.149544 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.149524    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:27:41.149775 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.149628    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.149775 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.149698    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:41.149937 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.149915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:27:41.150328 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.150305    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-94spn\""
Jul 20 19:27:41.152194 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.152176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.154498 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.154476    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.154861 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.154845    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kpbm7\""
Jul 20 19:27:41.154963 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.154899    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.155582 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.155556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.158194 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.158028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.158194 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.158068    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sqmkm\""
Jul 20 19:27:41.158628 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.158609    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.158694 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.158640    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.160496 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.160470    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:41.160496 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.160485    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c7nqd\""
Jul 20 19:27:41.160653 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.160546    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:41.160818 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.160751    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:27:41.161447 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.161544 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-script-lib\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161544 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-etc-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161654 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161654 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-systemd-units\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161767 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-netns\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161767 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161911 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-ovn\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161911 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-config\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.161911 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-cnibin\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.162070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-node-log\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.161973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-log-socket\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162034    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d0a62dd-250a-42f3-abea-659b243bc562-agent-certs\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.162221 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162221 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-bin\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162221 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-kubelet\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162225    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-slash\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7lq7\" (UniqueName: \"kubernetes.io/projected/17d82f97-d72b-496a-ae77-4652811d8321-kube-api-access-k7lq7\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4d2\" (UniqueName: \"kubernetes.io/projected/d56748cb-ef21-4ef2-b0c6-273b157391f0-kube-api-access-xz4d2\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.162383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovn-node-metrics-cert\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a62dd-250a-42f3-abea-659b243bc562-konnectivity-ca\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd742\" (UniqueName: \"kubernetes.io/projected/6b88c176-52b1-4141-80b8-43b7d09f00fe-kube-api-access-zd742\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-systemd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-var-lib-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-netd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-env-overrides\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.162681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-os-release\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.163179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.163179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.162958    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:27:41.164518 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.164173    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.166923    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.167015    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qt5x6\""
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.167018    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.167134    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.167409    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.167509 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.167471    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:41.170646 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.170606    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.173177 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.173127    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:27:41.173177 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.173160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.173705 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.173650    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.173836 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.173816    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j4c8d\""
Jul 20 19:27:41.173972 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.173918    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.179888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.177270    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:27:41.179888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.177834    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4h977\""
Jul 20 19:27:41.179888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.177851    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:27:41.179888 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.178328    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:27:41.184879 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.184859    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vvvpt"
Jul 20 19:27:41.192244 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.192174    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vvvpt"
Jul 20 19:27:41.250878 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.250832    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:27:41.263223 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-modprobe-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.263223 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-etc-tuned\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-dbus\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-bin\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-slash\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7lq7\" (UniqueName: \"kubernetes.io/projected/17d82f97-d72b-496a-ae77-4652811d8321-kube-api-access-k7lq7\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4d2\" (UniqueName: \"kubernetes.io/projected/d56748cb-ef21-4ef2-b0c6-273b157391f0-kube-api-access-xz4d2\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-slash\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-socket-dir-parent\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.263448 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-bin\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a62dd-250a-42f3-abea-659b243bc562-konnectivity-ca\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd742\" (UniqueName: \"kubernetes.io/projected/6b88c176-52b1-4141-80b8-43b7d09f00fe-kube-api-access-zd742\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-registration-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-k8s-cni-cncf-io\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.263589    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-netns\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-bin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.263655    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:27:41.763635776 +0000 UTC m=+3.866099110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263687    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-multus\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-kubelet-config\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysconfig\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790f871-1adb-4dd5-b33e-76eddb1a7e37-tmp-dir\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-var-lib-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60abd88d-d838-4a64-9c73-7a8fcb293ba9-serviceca\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-os-release\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-script-lib\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-var-lib-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-socket-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263900    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.263942    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-system-cni-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-kubernetes\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-os-release\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-conf\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-etc-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-systemd\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wf9k\" (UniqueName: \"kubernetes.io/projected/167a54fe-37a8-41af-b4e3-06315f276431-kube-api-access-5wf9k\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-etc-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d790f871-1adb-4dd5-b33e-76eddb1a7e37-hosts-file\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.264904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-conf-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42257\" (UniqueName: \"kubernetes.io/projected/b7998ffb-ee62-499a-be13-4f010bbf1bba-kube-api-access-42257\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-netns\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4n6\" (UniqueName: \"kubernetes.io/projected/60abd88d-d838-4a64-9c73-7a8fcb293ba9-kube-api-access-7z4n6\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264526    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-run-netns\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d0a62dd-250a-42f3-abea-659b243bc562-konnectivity-ca\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-openvswitch\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-config\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-cnibin\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-node-log\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-log-socket\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-kubelet\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264764    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-script-lib\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.265683 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17d82f97-d72b-496a-ae77-4652811d8321-cnibin\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-lib-modules\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4sgj\" (UniqueName: \"kubernetes.io/projected/d790f871-1adb-4dd5-b33e-76eddb1a7e37-kube-api-access-b4sgj\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-cnibin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264944    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-hostroot\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.264969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-etc-kubernetes\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovn-node-metrics-cert\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265027    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-sys-fs\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7998ffb-ee62-499a-be13-4f010bbf1bba-iptables-alerter-script\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovnkube-config\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-tmp\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-system-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.265999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-node-log\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-log-socket\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.266569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-os-release\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-daemon-config\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-systemd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-netd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-run\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-host\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266293    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-kubelet\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-multus-certs\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-env-overrides\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-device-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbds8\" (UniqueName: \"kubernetes.io/projected/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kube-api-access-sbds8\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-sys\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkzsn\" (UniqueName: \"kubernetes.io/projected/9a2f6672-aaa3-4564-a20a-da2001ff0957-kube-api-access-fkzsn\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7998ffb-ee62-499a-be13-4f010bbf1bba-host-slash\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.267466 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-systemd-units\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-ovn\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60abd88d-d838-4a64-9c73-7a8fcb293ba9-host\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-var-lib-kubelet\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-cni-binary-copy\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.266788    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d0a62dd-250a-42f3-abea-659b243bc562-agent-certs\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267236    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-cni-netd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267276    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-kubelet\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56748cb-ef21-4ef2-b0c6-273b157391f0-env-overrides\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.267980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-systemd\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.268023    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-run-ovn\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.268057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.268068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56748cb-ef21-4ef2-b0c6-273b157391f0-systemd-units\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.268309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.268310    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17d82f97-d72b-496a-ae77-4652811d8321-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.273083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.273059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56748cb-ef21-4ef2-b0c6-273b157391f0-ovn-node-metrics-cert\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.273245 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.273225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d0a62dd-250a-42f3-abea-659b243bc562-agent-certs\") pod \"konnectivity-agent-9pwlw\" (UID: \"0d0a62dd-250a-42f3-abea-659b243bc562\") " pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.288499 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.288472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7lq7\" (UniqueName: \"kubernetes.io/projected/17d82f97-d72b-496a-ae77-4652811d8321-kube-api-access-k7lq7\") pod \"multus-additional-cni-plugins-wwbkt\" (UID: \"17d82f97-d72b-496a-ae77-4652811d8321\") " pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.288642 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.288573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4d2\" (UniqueName: \"kubernetes.io/projected/d56748cb-ef21-4ef2-b0c6-273b157391f0-kube-api-access-xz4d2\") pod \"ovnkube-node-cnxnl\" (UID: \"d56748cb-ef21-4ef2-b0c6-273b157391f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.291608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.291547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd742\" (UniqueName: \"kubernetes.io/projected/6b88c176-52b1-4141-80b8-43b7d09f00fe-kube-api-access-zd742\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.367377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-systemd\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wf9k\" (UniqueName: \"kubernetes.io/projected/167a54fe-37a8-41af-b4e3-06315f276431-kube-api-access-5wf9k\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d790f871-1adb-4dd5-b33e-76eddb1a7e37-hosts-file\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367470    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-conf-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42257\" (UniqueName: \"kubernetes.io/projected/b7998ffb-ee62-499a-be13-4f010bbf1bba-kube-api-access-42257\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4n6\" (UniqueName: \"kubernetes.io/projected/60abd88d-d838-4a64-9c73-7a8fcb293ba9-kube-api-access-7z4n6\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.367586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-lib-modules\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4sgj\" (UniqueName: \"kubernetes.io/projected/d790f871-1adb-4dd5-b33e-76eddb1a7e37-kube-api-access-b4sgj\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-cnibin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-hostroot\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-etc-kubernetes\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-sys-fs\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7998ffb-ee62-499a-be13-4f010bbf1bba-iptables-alerter-script\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-tmp\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-system-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367890    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-os-release\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-daemon-config\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-run\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.367993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-host\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-kubelet\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-multus-certs\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-device-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbds8\" (UniqueName: \"kubernetes.io/projected/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kube-api-access-sbds8\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368125    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-sys\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368151    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkzsn\" (UniqueName: \"kubernetes.io/projected/9a2f6672-aaa3-4564-a20a-da2001ff0957-kube-api-access-fkzsn\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7998ffb-ee62-499a-be13-4f010bbf1bba-host-slash\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60abd88d-d838-4a64-9c73-7a8fcb293ba9-host\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-var-lib-kubelet\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-cni-binary-copy\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-modprobe-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-etc-tuned\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-dbus\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-socket-dir-parent\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-registration-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-k8s-cni-cncf-io\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-netns\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-bin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.368895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-multus\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-kubelet-config\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysconfig\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790f871-1adb-4dd5-b33e-76eddb1a7e37-tmp-dir\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60abd88d-d838-4a64-9c73-7a8fcb293ba9-serviceca\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-socket-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-kubernetes\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.368774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-conf\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369040    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-conf\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-systemd\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.369632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d790f871-1adb-4dd5-b33e-76eddb1a7e37-hosts-file\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369650    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-conf-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.369751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-sys\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7998ffb-ee62-499a-be13-4f010bbf1bba-host-slash\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60abd88d-d838-4a64-9c73-7a8fcb293ba9-host\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-var-lib-kubelet\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.370222 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.370583 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysctl-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.370583 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-lib-modules\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.370695 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370646    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-bin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.370803 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370756    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-modprobe-d\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.370803 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-cni-binary-copy\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.370928 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-cni-multus\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.370990 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-kubelet-config\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.371052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.370992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-sysconfig\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d790f871-1adb-4dd5-b33e-76eddb1a7e37-tmp-dir\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-registration-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-socket-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-system-cni-dir\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-cnibin\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e67862db-568f-45d2-befa-cf4a9c34d52d-dbus\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-hostroot\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-os-release\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371458    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-socket-dir-parent\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-etc-kubernetes\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371491    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-etc-kubernetes\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-k8s-cni-cncf-io\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371623    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-sys-fs\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-netns\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371782    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60abd88d-d838-4a64-9c73-7a8fcb293ba9-serviceca\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-host\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.372747 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.371939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-run-multus-certs\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.372004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2f6672-aaa3-4564-a20a-da2001ff0957-host-var-lib-kubelet\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.372003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a2f6672-aaa3-4564-a20a-da2001ff0957-multus-daemon-config\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.372067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/536e82a5-70cf-4c45-a871-79eaf0a63e7a-device-dir\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.372110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7998ffb-ee62-499a-be13-4f010bbf1bba-iptables-alerter-script\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.372193    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.372207    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/167a54fe-37a8-41af-b4e3-06315f276431-run\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.373761 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.372267    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:41.872243443 +0000 UTC m=+3.974706778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.376124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-etc-tuned\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.376285    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/167a54fe-37a8-41af-b4e3-06315f276431-tmp\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.377919    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.377952    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.377990    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:41.378776 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.378252    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:41.878222202 +0000 UTC m=+3.980685549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:41.384220 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.384191    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wf9k\" (UniqueName: \"kubernetes.io/projected/167a54fe-37a8-41af-b4e3-06315f276431-kube-api-access-5wf9k\") pod \"tuned-qff45\" (UID: \"167a54fe-37a8-41af-b4e3-06315f276431\") " pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.384577 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.384553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4n6\" (UniqueName: \"kubernetes.io/projected/60abd88d-d838-4a64-9c73-7a8fcb293ba9-kube-api-access-7z4n6\") pod \"node-ca-hpf7n\" (UID: \"60abd88d-d838-4a64-9c73-7a8fcb293ba9\") " pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.384671 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.384630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkzsn\" (UniqueName: \"kubernetes.io/projected/9a2f6672-aaa3-4564-a20a-da2001ff0957-kube-api-access-fkzsn\") pod \"multus-rzpdh\" (UID: \"9a2f6672-aaa3-4564-a20a-da2001ff0957\") " pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.385402 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.385355    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4sgj\" (UniqueName: \"kubernetes.io/projected/d790f871-1adb-4dd5-b33e-76eddb1a7e37-kube-api-access-b4sgj\") pod \"node-resolver-qr9f7\" (UID: \"d790f871-1adb-4dd5-b33e-76eddb1a7e37\") " pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.386131 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.386089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42257\" (UniqueName: \"kubernetes.io/projected/b7998ffb-ee62-499a-be13-4f010bbf1bba-kube-api-access-42257\") pod \"iptables-alerter-99svg\" (UID: \"b7998ffb-ee62-499a-be13-4f010bbf1bba\") " pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.386245 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.386224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbds8\" (UniqueName: \"kubernetes.io/projected/536e82a5-70cf-4c45-a871-79eaf0a63e7a-kube-api-access-sbds8\") pod \"aws-ebs-csi-driver-node-qhmlr\" (UID: \"536e82a5-70cf-4c45-a871-79eaf0a63e7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.453661 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.453563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwbkt"
Jul 20 19:27:41.462068 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.462041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:27:41.473037 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.473017    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:27:41.475445 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.475417    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56748cb_ef21_4ef2_b0c6_273b157391f0.slice/crio-6a2277be40c4827043c6f9ecea82816683422c14d3f52d5fd8802f84818db300 WatchSource:0}: Error finding container 6a2277be40c4827043c6f9ecea82816683422c14d3f52d5fd8802f84818db300: Status 404 returned error can't find the container with id 6a2277be40c4827043c6f9ecea82816683422c14d3f52d5fd8802f84818db300
Jul 20 19:27:41.483164 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.483141    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qff45"
Jul 20 19:27:41.489132 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.489101    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0a62dd_250a_42f3_abea_659b243bc562.slice/crio-55fff16bd30d5af772a9f3feedaeb2170c306890676e00d0f2da5de5affb39b0 WatchSource:0}: Error finding container 55fff16bd30d5af772a9f3feedaeb2170c306890676e00d0f2da5de5affb39b0: Status 404 returned error can't find the container with id 55fff16bd30d5af772a9f3feedaeb2170c306890676e00d0f2da5de5affb39b0
Jul 20 19:27:41.491481 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.490964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qr9f7"
Jul 20 19:27:41.498921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.498899    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzpdh"
Jul 20 19:27:41.502689 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.502658    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd790f871_1adb_4dd5_b33e_76eddb1a7e37.slice/crio-639f4ce6a45608f9c607c9b5ff00f24a0b09f853446ac8424500aacafc3f5763 WatchSource:0}: Error finding container 639f4ce6a45608f9c607c9b5ff00f24a0b09f853446ac8424500aacafc3f5763: Status 404 returned error can't find the container with id 639f4ce6a45608f9c607c9b5ff00f24a0b09f853446ac8424500aacafc3f5763
Jul 20 19:27:41.509253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.509230    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-99svg"
Jul 20 19:27:41.518381 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.518273    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2f6672_aaa3_4564_a20a_da2001ff0957.slice/crio-60143aa3fc8ac8477a16762236a30c5fa8cfdf77a65eebfab4362ba8b0cce86a WatchSource:0}: Error finding container 60143aa3fc8ac8477a16762236a30c5fa8cfdf77a65eebfab4362ba8b0cce86a: Status 404 returned error can't find the container with id 60143aa3fc8ac8477a16762236a30c5fa8cfdf77a65eebfab4362ba8b0cce86a
Jul 20 19:27:41.518480 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.518384    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr"
Jul 20 19:27:41.525336 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.523559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpf7n"
Jul 20 19:27:41.527901 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.527869    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7998ffb_ee62_499a_be13_4f010bbf1bba.slice/crio-963130754d1e8868692edb906cc0cd16861786aea1f53f87b9bf790ba9bd8d5c WatchSource:0}: Error finding container 963130754d1e8868692edb906cc0cd16861786aea1f53f87b9bf790ba9bd8d5c: Status 404 returned error can't find the container with id 963130754d1e8868692edb906cc0cd16861786aea1f53f87b9bf790ba9bd8d5c
Jul 20 19:27:41.535502 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.535474    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60abd88d_d838_4a64_9c73_7a8fcb293ba9.slice/crio-fa1e7cadaf688e49a70ee040466c2ddc1ff9f5db1e6cdc9783f43c3ce28050d6 WatchSource:0}: Error finding container fa1e7cadaf688e49a70ee040466c2ddc1ff9f5db1e6cdc9783f43c3ce28050d6: Status 404 returned error can't find the container with id fa1e7cadaf688e49a70ee040466c2ddc1ff9f5db1e6cdc9783f43c3ce28050d6
Jul 20 19:27:41.536047 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:27:41.536029    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536e82a5_70cf_4c45_a871_79eaf0a63e7a.slice/crio-5c259f641466330194182da3e73150f1626e97b894d590b00013357366d62183 WatchSource:0}: Error finding container 5c259f641466330194182da3e73150f1626e97b894d590b00013357366d62183: Status 404 returned error can't find the container with id 5c259f641466330194182da3e73150f1626e97b894d590b00013357366d62183
Jul 20 19:27:41.547625 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.547573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr" event={"ID":"536e82a5-70cf-4c45-a871-79eaf0a63e7a","Type":"ContainerStarted","Data":"5c259f641466330194182da3e73150f1626e97b894d590b00013357366d62183"}
Jul 20 19:27:41.548897 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.548824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpf7n" event={"ID":"60abd88d-d838-4a64-9c73-7a8fcb293ba9","Type":"ContainerStarted","Data":"fa1e7cadaf688e49a70ee040466c2ddc1ff9f5db1e6cdc9783f43c3ce28050d6"}
Jul 20 19:27:41.550317 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.550267    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qr9f7" event={"ID":"d790f871-1adb-4dd5-b33e-76eddb1a7e37","Type":"ContainerStarted","Data":"639f4ce6a45608f9c607c9b5ff00f24a0b09f853446ac8424500aacafc3f5763"}
Jul 20 19:27:41.551779 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.551748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qff45" event={"ID":"167a54fe-37a8-41af-b4e3-06315f276431","Type":"ContainerStarted","Data":"f0dcbb318922b7323860ee405a7f6fbc611da980da3d4d0b7b48256becd614d4"}
Jul 20 19:27:41.553129 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.553073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9pwlw" event={"ID":"0d0a62dd-250a-42f3-abea-659b243bc562","Type":"ContainerStarted","Data":"55fff16bd30d5af772a9f3feedaeb2170c306890676e00d0f2da5de5affb39b0"}
Jul 20 19:27:41.556265 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.556221    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"6a2277be40c4827043c6f9ecea82816683422c14d3f52d5fd8802f84818db300"}
Jul 20 19:27:41.557503 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.557475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"6fe68b5cb1b7fe1d6d7f652b5d9b720e","Type":"ContainerStarted","Data":"83b9606d979275b2dc59451d635f2ac2ed56a17495424c58a3bbf9489e709226"}
Jul 20 19:27:41.558941 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.558913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"624b6635e1b977b951af1431c25123e4","Type":"ContainerStarted","Data":"204297ec8670406b962e777ed142da68b54535d8c786d4757132599ed938c500"}
Jul 20 19:27:41.560631 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.560608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-99svg" event={"ID":"b7998ffb-ee62-499a-be13-4f010bbf1bba","Type":"ContainerStarted","Data":"963130754d1e8868692edb906cc0cd16861786aea1f53f87b9bf790ba9bd8d5c"}
Jul 20 19:27:41.562123 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.562097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzpdh" event={"ID":"9a2f6672-aaa3-4564-a20a-da2001ff0957","Type":"ContainerStarted","Data":"60143aa3fc8ac8477a16762236a30c5fa8cfdf77a65eebfab4362ba8b0cce86a"}
Jul 20 19:27:41.563505 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.563477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerStarted","Data":"f3368f74d2f57b2797f3c508ff03d2aea536ad5c012740d667309b5b5c43aac3"}
Jul 20 19:27:41.771658 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.771575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:41.772226 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.771745    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:41.772226 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.771824    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:27:42.771806472 +0000 UTC m=+4.874269814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:41.872452 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.872415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:41.872630 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.872554    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:41.872630 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.872617    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:42.872599741 +0000 UTC m=+4.975063069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:41.973114 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:41.973074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:41.973311 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.973287    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:41.973376 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.973320    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:41.973376 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.973335    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:41.973490 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:41.973406    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:42.973389374 +0000 UTC m=+5.075852724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:42.196279 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.196189    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:22:41 +0000 UTC" deadline="2028-01-12 17:29:05.928182372 +0000 UTC"
Jul 20 19:27:42.196279 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.196221    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12982h1m23.731965875s"
Jul 20 19:27:42.542031 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.541995    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:42.542031 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.542018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:42.542266 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.542172    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:42.542326 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.542273    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:42.780798 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.780701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:42.781525 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.780914    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:42.781525 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.780985    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:27:44.78096419 +0000 UTC m=+6.883427534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:42.881506 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.881465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:42.881699 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.881682    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:42.881790 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.881765    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:44.881733892 +0000 UTC m=+6.984197224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:42.983339 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:42.983260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:42.983548 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.983475    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:42.983548 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.983516    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:42.983548 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.983535    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:42.983704 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:42.983614    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:44.983590226 +0000 UTC m=+7.086053556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:43.196531 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:43.196371    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:22:41 +0000 UTC" deadline="2027-12-23 08:55:06.338766818 +0000 UTC"
Jul 20 19:27:43.196531 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:43.196415    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12493h27m23.14235839s"
Jul 20 19:27:43.543479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:43.543400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:43.543648 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:43.543546    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:43.579307 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:43.578222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" event={"ID":"6fe68b5cb1b7fe1d6d7f652b5d9b720e","Type":"ContainerStarted","Data":"1a6b4518f738d32573ed6998e5f7a63d8d172885a5555300ab9cab2e378ac228"}
Jul 20 19:27:44.542095 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.541822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:44.542754 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.542213    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:44.542754 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.542050    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:44.542754 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.542334    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:44.594915 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.594875    2571 generic.go:356] "Generic (PLEG): container finished" podID="624b6635e1b977b951af1431c25123e4" containerID="fcf427cec4789684c1f944d304dbe3950fb59f23fd7acfd22bbe87679985569e" exitCode=0
Jul 20 19:27:44.595149 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.595113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"624b6635e1b977b951af1431c25123e4","Type":"ContainerDied","Data":"fcf427cec4789684c1f944d304dbe3950fb59f23fd7acfd22bbe87679985569e"}
Jul 20 19:27:44.618855 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.618329    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-45.ec2.internal" podStartSLOduration=3.618305693 podStartE2EDuration="3.618305693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:43.595055511 +0000 UTC m=+5.697518855" watchObservedRunningTime="2026-07-20 19:27:44.618305693 +0000 UTC m=+6.720769048"
Jul 20 19:27:44.803972 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.803225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:44.803972 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.803450    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:44.803972 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.803531    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:27:48.803511041 +0000 UTC m=+10.905974375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:44.905067 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:44.904376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:44.905067 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.904582    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:44.905067 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:44.904656    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:48.904635449 +0000 UTC m=+11.007098781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:45.006045 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:45.005286    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:45.006045 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:45.005550    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:45.006045 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:45.005572    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:45.006045 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:45.005587    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:45.006045 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:45.005650    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:49.005630775 +0000 UTC m=+11.108094110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:45.545010 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:45.544448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:45.545010 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:45.544593    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:45.602950 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:45.602825    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" event={"ID":"624b6635e1b977b951af1431c25123e4","Type":"ContainerStarted","Data":"b0baa1435c38f1c308f562073fb7f57b4ee3e50fd7e09970c76a76c5cf8333dc"}
Jul 20 19:27:45.621481 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:45.621280    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-45.ec2.internal" podStartSLOduration=4.621258693 podStartE2EDuration="4.621258693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:45.620736697 +0000 UTC m=+7.723200051" watchObservedRunningTime="2026-07-20 19:27:45.621258693 +0000 UTC m=+7.723722046"
Jul 20 19:27:46.542395 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:46.542286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:46.542395 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:46.542308    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:46.542615 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:46.542423    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:46.542843 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:46.542784    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:47.542131 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:47.542085    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:47.542605 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:47.542269    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:48.542556 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:48.542513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:48.543056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:48.542560    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:48.543056 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.542681    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:48.543056 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.542838    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:48.843515 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:48.843431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:48.843718 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.843610    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:48.843718 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.843696    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:27:56.843673736 +0000 UTC m=+18.946137075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:48.944492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:48.944455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:48.944676 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.944594    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:48.944676 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:48.944660    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:27:56.944642166 +0000 UTC m=+19.047105511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:49.045337 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:49.045292    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:49.045501 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:49.045471    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:49.045501 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:49.045492    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:49.045501 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:49.045503    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:49.045660 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:49.045557    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:27:57.045539702 +0000 UTC m=+19.148003046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:49.546400 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:49.546338    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:49.546875 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:49.546481    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:50.541965 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:50.541928    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:50.542158 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:50.542070    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:50.542158 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:50.542128    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:50.542289 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:50.542263    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:51.546111 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:51.545646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:51.546111 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:51.545788    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:52.541670 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:52.541633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:52.541836 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:52.541681    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:52.541836 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:52.541780    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:52.541908 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:52.541876    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:53.542029 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:53.541995    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:53.542475 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:53.542130    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:54.542180 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:54.542146    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:54.542180 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:54.542164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:54.542660 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:54.542268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:54.542660 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:54.542411    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:55.544688 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:55.544661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:55.545073 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:55.544776    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:56.542170 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:56.542131    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:56.542433 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:56.542254    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:56.542433 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:56.542313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:56.542433 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:56.542406    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:56.907178 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:56.907092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:56.907547 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:56.907244    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:56.907547 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:56.907325    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:28:12.907303508 +0000 UTC m=+35.009766836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:27:57.008155 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:57.008118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:57.008297 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.008272    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:57.008347 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.008342    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:28:13.008326038 +0000 UTC m=+35.110789370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:27:57.108663 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:57.108633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:57.108836 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.108816    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:27:57.108889 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.108842    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:27:57.108889 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.108852    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:57.108960 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.108905    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:28:13.108886943 +0000 UTC m=+35.211350290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:27:57.542296 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:57.542251    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:57.542463 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:57.542398    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:27:58.542244 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:58.542212    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:27:58.542700 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:58.542223    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:27:58.542700 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:58.542338    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:27:58.542700 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:58.542436    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:27:59.542882 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:27:59.542851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:27:59.543343 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:27:59.542970    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:00.542174 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:00.542138    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:00.542377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:00.542187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:00.542377 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:00.542284    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:00.542475 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:00.542379    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:01.541817 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:01.541791    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:01.542167 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:01.541912    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:01.636641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:01.636604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qff45" event={"ID":"167a54fe-37a8-41af-b4e3-06315f276431","Type":"ContainerStarted","Data":"452f45fcd05fbec2885f48133682dbf1c1859fe30f61161b30ec1ffbaae84183"}
Jul 20 19:28:01.655474 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:01.655399    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qff45" podStartSLOduration=1.645385825 podStartE2EDuration="21.655378124s" totalImagesPullingTime="20.009992299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:01.654865471 +0000 UTC m=+23.757328824" watchObservedRunningTime="2026-07-20 19:28:01.655378124 +0000 UTC m=+23.757841474"
Jul 20 19:28:02.542529 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.542156    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:02.543329 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.542156    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:02.543329 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:02.542616    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:02.543329 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:02.542640    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:02.641049 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.641011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9pwlw" event={"ID":"0d0a62dd-250a-42f3-abea-659b243bc562","Type":"ContainerStarted","Data":"c45f930f1be5df8b57105ed2040e009e899a915864e93d879e4bb2ff37b712d9"}
Jul 20 19:28:02.643920 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.643898    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:28:02.644239 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644221    2571 generic.go:356] "Generic (PLEG): container finished" podID="d56748cb-ef21-4ef2-b0c6-273b157391f0" containerID="f6c1894c7590fdc399bdac3e7cc56b310f49ad1d85221d8e57bb7570081acff4" exitCode=1
Jul 20 19:28:02.644327 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644279    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"40982ebba7f45a66e48cea5cad8d833ef2bb5be9e6b36b429f1a5175c3a38034"}
Jul 20 19:28:02.644377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"53309bc5a5f240c346874323325febf782a271f7554539e4c8fadfb6563e16cc"}
Jul 20 19:28:02.644432 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644417    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"018a11eb8e07ae0b173a9d4ecc13c66bd983ebdf7dcda20556d23847cd9abd47"}
Jul 20 19:28:02.644483 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"cb64acf69fd98fe37fee48d3265c93a9e2cb24a4c80581d22e8f36ea65d3c0f8"}
Jul 20 19:28:02.644529 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644521    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerDied","Data":"f6c1894c7590fdc399bdac3e7cc56b310f49ad1d85221d8e57bb7570081acff4"}
Jul 20 19:28:02.644578 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.644554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"98d5566e0c470dc9ed3774953bcc4d04ef92f6e3cb6c352cb8e78034ad475d86"}
Jul 20 19:28:02.645927 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.645907    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzpdh" event={"ID":"9a2f6672-aaa3-4564-a20a-da2001ff0957","Type":"ContainerStarted","Data":"aca71ebe0e0863a60efaeb277889395c390036419a3fb67b615702bcdd680c40"}
Jul 20 19:28:02.647491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.647468    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="b6e7484898ac00b9779a0362f89891bf7e6d45e031111388fc3e03bc1d8e3b9d" exitCode=0
Jul 20 19:28:02.647578 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.647538    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"b6e7484898ac00b9779a0362f89891bf7e6d45e031111388fc3e03bc1d8e3b9d"}
Jul 20 19:28:02.649183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.649075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr" event={"ID":"536e82a5-70cf-4c45-a871-79eaf0a63e7a","Type":"ContainerStarted","Data":"1b6c7629bc45cb2ca933ecfe3773a197f7bc3231b21dd7ca9a1787b7a3d23002"}
Jul 20 19:28:02.650627 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.650603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpf7n" event={"ID":"60abd88d-d838-4a64-9c73-7a8fcb293ba9","Type":"ContainerStarted","Data":"107fe9ed625295eda0d1f34e2f77873bb5c1e4512bebfcd2deed137ae985e4df"}
Jul 20 19:28:02.652048 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.652028    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qr9f7" event={"ID":"d790f871-1adb-4dd5-b33e-76eddb1a7e37","Type":"ContainerStarted","Data":"5d045d994b6f4e8e21e14f5cae9f3596367fdb832680e329a1a3f3a0964bc9f8"}
Jul 20 19:28:02.660442 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.660406    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9pwlw" podStartSLOduration=2.641980858 podStartE2EDuration="22.660393847s" totalImagesPullingTime="20.018412989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:02.659973057 +0000 UTC m=+24.762436407" watchObservedRunningTime="2026-07-20 19:28:02.660393847 +0000 UTC m=+24.762857231"
Jul 20 19:28:02.730880 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.730824    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qr9f7" podStartSLOduration=2.7274798970000003 podStartE2EDuration="22.730807874s" totalImagesPullingTime="20.003327977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:02.710389449 +0000 UTC m=+24.812852799" watchObservedRunningTime="2026-07-20 19:28:02.730807874 +0000 UTC m=+24.833271255"
Jul 20 19:28:02.731250 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.731222    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rzpdh" podStartSLOduration=2.730214904 podStartE2EDuration="22.731213133s" totalImagesPullingTime="20.000998229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:02.730549909 +0000 UTC m=+24.833013259" watchObservedRunningTime="2026-07-20 19:28:02.731213133 +0000 UTC m=+24.833676481"
Jul 20 19:28:02.746804 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.746747    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hpf7n" podStartSLOduration=2.775062015 podStartE2EDuration="22.746737767s" totalImagesPullingTime="19.971675752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:02.74602545 +0000 UTC m=+24.848488798" watchObservedRunningTime="2026-07-20 19:28:02.746737767 +0000 UTC m=+24.849201116"
Jul 20 19:28:02.890227 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.890181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:02.975240 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:02.975204    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.210335 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.210301    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:28:03.275393 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.275356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.376547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.376460    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.424597 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.424512    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:28:03.210318184Z","UUID":"3a6c002e-9706-4b98-8118-b6b7f48c2a8e","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:28:03.426030 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.426016    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:28:03.426121 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.426049    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:28:03.477162 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.477127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.541658 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.541625    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:03.541832 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:03.541796    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:03.655954 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.655870    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-99svg" event={"ID":"b7998ffb-ee62-499a-be13-4f010bbf1bba","Type":"ContainerStarted","Data":"01a1e6d874273c619149357c0e0ddc015445e296ddd3bebd232b544766d80c31"}
Jul 20 19:28:03.657666 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.657640    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr" event={"ID":"536e82a5-70cf-4c45-a871-79eaf0a63e7a","Type":"ContainerStarted","Data":"b617ae619869ec5dbc7361c61f4559ace1ad832477a86a445828d068bb28f235"}
Jul 20 19:28:03.672402 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.672357    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-99svg" podStartSLOduration=3.687316068 podStartE2EDuration="23.672342847s" totalImagesPullingTime="19.985026779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:03.67203656 +0000 UTC m=+25.774499908" watchObservedRunningTime="2026-07-20 19:28:03.672342847 +0000 UTC m=+25.774806196"
Jul 20 19:28:03.716725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.716696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.799444 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.799408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:03.911164 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:03.911089    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:04.460445 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.460414    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:04.510725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.510695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:04.542118 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.542091    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:04.542230 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:04.542206    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:04.542298 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.542253    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:04.542351 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:04.542337    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:04.665214 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.665113    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:28:04.665895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.665870    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"4f20b7b1da62ba7d29f9cd41ea875fdf6d24440fb547608b5fc86f8a72905478"}
Jul 20 19:28:04.867118 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.867011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:04.934175 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:04.934144    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:05.362493 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.362373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:05.415371 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.415331    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:05.541600 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.541570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:05.541792 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:05.541699    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:05.670604 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.670522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr" event={"ID":"536e82a5-70cf-4c45-a871-79eaf0a63e7a","Type":"ContainerStarted","Data":"92af9f13da017a8847c1d9e119ec87e8c1a4eac57ec53672fc73bdc96ba2d487"}
Jul 20 19:28:05.687628 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.687551    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qhmlr" podStartSLOduration=3.113914134 podStartE2EDuration="25.687530155s" totalImagesPullingTime="22.573616021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:05.686980628 +0000 UTC m=+27.789443977" watchObservedRunningTime="2026-07-20 19:28:05.687530155 +0000 UTC m=+27.789993504"
Jul 20 19:28:05.859220 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.859158    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:05.959416 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:05.959319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:06.059335 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:06.059299    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:06.161207 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:06.161148    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:06.542451 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:06.542222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:06.542633 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:06.542260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:06.542633 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:06.542566    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:06.542633 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:06.542619    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:07.258324 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.258293    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:07.268004 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.267978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:28:07.268480 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.268460    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:28:07.542049 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.541969    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:07.542204 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:07.542072    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:07.675587 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.675555    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:28:07.676139 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.676121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9pwlw"
Jul 20 19:28:07.732356 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:07.732317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:08.541932 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.541871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:08.541932 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.541885    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:08.542645 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:08.541972    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:08.542645 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:08.542078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:08.680751 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.680725    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:28:08.681155 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.681120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"7ce2fa3630b6e4cea333fb470aa621e34f8e2be699a97b7811e9c0f16410f523"}
Jul 20 19:28:08.681392 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.681337    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:08.681464 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.681424    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:08.681599 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.681579    2571 scope.go:117] "RemoveContainer" containerID="f6c1894c7590fdc399bdac3e7cc56b310f49ad1d85221d8e57bb7570081acff4"
Jul 20 19:28:08.683043 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.683015    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="4b756e8054d3269b3f9e1b6e31b2b7fa491ad4729585efd857daff297971da81" exitCode=0
Jul 20 19:28:08.683142 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.683094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"4b756e8054d3269b3f9e1b6e31b2b7fa491ad4729585efd857daff297971da81"}
Jul 20 19:28:08.697827 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:08.697804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:09.543546 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.543316    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:09.544084 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:09.543644    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:09.689134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.689110    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:28:09.689577 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.689548    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" event={"ID":"d56748cb-ef21-4ef2-b0c6-273b157391f0","Type":"ContainerStarted","Data":"990a4e63463be144b22d2f4d3ca37acba2d1bd7de571f2e307e5af6c97b4e938"}
Jul 20 19:28:09.689808 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.689783    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:09.704789 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.704750    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:09.719609 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:09.719567    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl" podStartSLOduration=9.471234889 podStartE2EDuration="29.719552197s" totalImagesPullingTime="20.248317308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:09.719208135 +0000 UTC m=+31.821671484" watchObservedRunningTime="2026-07-20 19:28:09.719552197 +0000 UTC m=+31.822015545"
Jul 20 19:28:10.019043 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqzt6"]
Jul 20 19:28:10.019198 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mk4ml"]
Jul 20 19:28:10.019198 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xqnhb"]
Jul 20 19:28:10.019334 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:10.020047 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:10.019421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:10.020047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019442    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:10.020047 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:10.019600    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:10.020047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.019683    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:10.021196 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:10.021152    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:10.694171 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.694139    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="79f2cc57e9a81cde71561cb7867fa6841e3d070778e73c8e5f9d91506ff033e1" exitCode=0
Jul 20 19:28:10.694618 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:10.694244    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"79f2cc57e9a81cde71561cb7867fa6841e3d070778e73c8e5f9d91506ff033e1"}
Jul 20 19:28:11.541713 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:11.541646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:11.541894 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:11.541646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:11.541894 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:11.541770    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:11.541894 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:11.541652    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:11.541894 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:11.541845    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:11.541894 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:11.541888    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:12.701049 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:12.700868    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="36a1eaaf873509123cbee1d72d99788c98fdd4a44e5698c24d0b841a68492ade" exitCode=0
Jul 20 19:28:12.701049 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:12.700946    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"36a1eaaf873509123cbee1d72d99788c98fdd4a44e5698c24d0b841a68492ade"}
Jul 20 19:28:12.921926 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:12.921894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:12.922084 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:12.922025    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:28:12.922084 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:12.922078    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:28:44.922063282 +0000 UTC m=+67.024526609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:28:13.022651 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:13.022573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:13.022807 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.022706    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:28:13.022807 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.022774    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret podName:e67862db-568f-45d2-befa-cf4a9c34d52d nodeName:}" failed. No retries permitted until 2026-07-20 19:28:45.022746615 +0000 UTC m=+67.125209941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret") pod "global-pull-secret-syncer-vqzt6" (UID: "e67862db-568f-45d2-befa-cf4a9c34d52d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:28:13.122994 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:13.122960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:13.123156 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.123105    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:28:13.123156 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.123122    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:28:13.123156 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.123131    2571 projected.go:196] Error preparing data for projected volume kube-api-access-dbj7v for pod openshift-network-diagnostics/network-check-target-xqnhb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:28:13.123527 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.123182    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v podName:9e7ca8e1-484f-4aef-ae86-a7bacb11137f nodeName:}" failed. No retries permitted until 2026-07-20 19:28:45.123167844 +0000 UTC m=+67.225631171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dbj7v" (UniqueName: "kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v") pod "network-check-target-xqnhb" (UID: "9e7ca8e1-484f-4aef-ae86-a7bacb11137f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:28:13.542536 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:13.542507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:13.542667 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:13.542507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:13.542667 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.542625    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:28:13.542745 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:13.542507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:13.542745 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.542692    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xqnhb" podUID="9e7ca8e1-484f-4aef-ae86-a7bacb11137f"
Jul 20 19:28:13.542832 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:13.542777    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqzt6" podUID="e67862db-568f-45d2-befa-cf4a9c34d52d"
Jul 20 19:28:14.918230 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:14.918196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:15.017766 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.017715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:15.257693 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.257663    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-45.ec2.internal" event="NodeReady"
Jul 20 19:28:15.257867 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.257812    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:28:15.300720 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.300686    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4hb8q"]
Jul 20 19:28:15.304551 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.304528    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84znv"]
Jul 20 19:28:15.304707 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.304656    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.307798 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.307746    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:28:15.307917 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.307854    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27sg8\""
Jul 20 19:28:15.307993 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.307982    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:28:15.308370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.308352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.311278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.311254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:28:15.311377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.311303    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:28:15.311377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.311325    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:28:15.311570 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.311544    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94xxz\""
Jul 20 19:28:15.313552 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.313513    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4hb8q"]
Jul 20 19:28:15.316801 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.316748    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84znv"]
Jul 20 19:28:15.420526 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.420494    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:15.441512 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b21d7e38-fef6-485c-b588-7c8df2c1d367-config-volume\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.441671 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.441671 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kst4z\" (UniqueName: \"kubernetes.io/projected/58a81467-5bc1-4dca-8288-8fa508be8b12-kube-api-access-kst4z\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.441671 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441572    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a81467-5bc1-4dca-8288-8fa508be8b12-cert\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.441858 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21d7e38-fef6-485c-b588-7c8df2c1d367-tmp-dir\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.441858 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.441727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mvl\" (UniqueName: \"kubernetes.io/projected/b21d7e38-fef6-485c-b588-7c8df2c1d367-kube-api-access-p7mvl\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21d7e38-fef6-485c-b588-7c8df2c1d367-tmp-dir\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mvl\" (UniqueName: \"kubernetes.io/projected/b21d7e38-fef6-485c-b588-7c8df2c1d367-kube-api-access-p7mvl\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b21d7e38-fef6-485c-b588-7c8df2c1d367-config-volume\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kst4z\" (UniqueName: \"kubernetes.io/projected/58a81467-5bc1-4dca-8288-8fa508be8b12-kube-api-access-kst4z\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.542547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a81467-5bc1-4dca-8288-8fa508be8b12-cert\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.543017 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542360    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:15.543017 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542727    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:15.543017 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.542727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b21d7e38-fef6-485c-b588-7c8df2c1d367-tmp-dir\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.543694 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:15.543667    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:15.543828 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:15.543744    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:16.043724335 +0000 UTC m=+38.146187675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:15.543828 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.543663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b21d7e38-fef6-485c-b588-7c8df2c1d367-config-volume\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.546064 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.545333    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:28:15.546064 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.545663    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:28:15.547384 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.547364    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jqcxh\""
Jul 20 19:28:15.547488 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.547391    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:28:15.547488 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.547475    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:28:15.547716 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.547696    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pw7wf\""
Jul 20 19:28:15.551016 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.550967    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58a81467-5bc1-4dca-8288-8fa508be8b12-cert\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.553153 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.553131    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kst4z\" (UniqueName: \"kubernetes.io/projected/58a81467-5bc1-4dca-8288-8fa508be8b12-kube-api-access-kst4z\") pod \"ingress-canary-84znv\" (UID: \"58a81467-5bc1-4dca-8288-8fa508be8b12\") " pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.553255 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.553139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mvl\" (UniqueName: \"kubernetes.io/projected/b21d7e38-fef6-485c-b588-7c8df2c1d367-kube-api-access-p7mvl\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:15.624495 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.624460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84znv"
Jul 20 19:28:15.767468 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:15.767434    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84znv"]
Jul 20 19:28:16.047419 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:16.047383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:16.048181 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:16.047520    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:16.048181 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:16.047601    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:17.047576401 +0000 UTC m=+39.150039727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:17.056721 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:17.056676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:17.057118 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:17.056868    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:17.057118 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:17.056951    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:19.056928274 +0000 UTC m=+41.159391615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:17.157709 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:28:17.157673    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a81467_5bc1_4dca_8288_8fa508be8b12.slice/crio-9ffcba5fa2f3ab7da2c2c87914c2efe5e5c4a2e48adefb3c2a5b6086e8bb82a7 WatchSource:0}: Error finding container 9ffcba5fa2f3ab7da2c2c87914c2efe5e5c4a2e48adefb3c2a5b6086e8bb82a7: Status 404 returned error can't find the container with id 9ffcba5fa2f3ab7da2c2c87914c2efe5e5c4a2e48adefb3c2a5b6086e8bb82a7
Jul 20 19:28:17.716710 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:17.716402    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="63ed6d94f561819edf016fcde43a93de61765f1ecba2753697dfabcbfb3a9dc1" exitCode=0
Jul 20 19:28:17.716883 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:17.716486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"63ed6d94f561819edf016fcde43a93de61765f1ecba2753697dfabcbfb3a9dc1"}
Jul 20 19:28:17.718121 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:17.718089    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84znv" event={"ID":"58a81467-5bc1-4dca-8288-8fa508be8b12","Type":"ContainerStarted","Data":"9ffcba5fa2f3ab7da2c2c87914c2efe5e5c4a2e48adefb3c2a5b6086e8bb82a7"}
Jul 20 19:28:18.724072 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:18.724035    2571 generic.go:356] "Generic (PLEG): container finished" podID="17d82f97-d72b-496a-ae77-4652811d8321" containerID="aa30fce060da23856de559380b61ea8348a4e0edee3438a9a2b5101955e919bd" exitCode=0
Jul 20 19:28:18.724521 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:18.724089    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerDied","Data":"aa30fce060da23856de559380b61ea8348a4e0edee3438a9a2b5101955e919bd"}
Jul 20 19:28:18.949296 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:18.949253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:19.030365 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.030262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:19.074157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.074119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:19.074330 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:19.074291    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:19.074392 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:19.074354    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:23.074337674 +0000 UTC m=+45.176801001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:19.730968 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.730933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" event={"ID":"17d82f97-d72b-496a-ae77-4652811d8321","Type":"ContainerStarted","Data":"b3e85949a6011c51046ec02e1719585dd05f61e4cf20a76f2051483ab9aea3e2"}
Jul 20 19:28:19.756062 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.755998    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wwbkt" podStartSLOduration=7.4265047 podStartE2EDuration="39.75598182s" totalImagesPullingTime="32.32947712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:19.754003854 +0000 UTC m=+41.856467204" watchObservedRunningTime="2026-07-20 19:28:19.75598182 +0000 UTC m=+41.858445168"
Jul 20 19:28:19.878686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.878627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:19.979506 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:19.979443    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:20.661421 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:20.661377    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:20.735303 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:20.735264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84znv" event={"ID":"58a81467-5bc1-4dca-8288-8fa508be8b12","Type":"ContainerStarted","Data":"dca8cda4deb5b89e543ebdd231b4db2ce41815f3778c4484f3710e920706c9ae"}
Jul 20 19:28:20.750634 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:20.750583    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84znv" podStartSLOduration=3.247415772 podStartE2EDuration="5.750565258s" totalImagesPullingTime="2.503149486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:20.750553882 +0000 UTC m=+42.853017230" watchObservedRunningTime="2026-07-20 19:28:20.750565258 +0000 UTC m=+42.853028610"
Jul 20 19:28:21.398161 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:21.398119    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:21.462318 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:21.462286    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:23.106498 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:23.106457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:23.106901 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:23.106589    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:23.106901 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:23.106648    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:31.106631144 +0000 UTC m=+53.209094491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:25.850287 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:25.850246    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:25.955247 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:25.955214    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:31.163470 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:31.163413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:31.163898 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:31.163601    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:31.163898 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:31.163684    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:28:47.163665618 +0000 UTC m=+69.266128945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:41.389799 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.389742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.446051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.446013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.707191 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.707119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnxnl"
Jul 20 19:28:41.824341 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.824305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.886589 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.886553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:41.945669 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:41.945632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:28:44.957081 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:44.957035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:28:44.959944 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:44.959923    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:28:44.968165 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:44.968137    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 19:28:44.968249 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:44.968205    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:29:48.968188707 +0000 UTC m=+131.070652035 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : secret "metrics-daemon-secret" not found
Jul 20 19:28:45.058230 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.058188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:45.061877 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.061851    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:28:45.071682 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.071658    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e67862db-568f-45d2-befa-cf4a9c34d52d-original-pull-secret\") pod \"global-pull-secret-syncer-vqzt6\" (UID: \"e67862db-568f-45d2-befa-cf4a9c34d52d\") " pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:45.158811 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.158751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:45.161984 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.161965    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:28:45.171823 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.171802    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:28:45.182256 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.182230    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbj7v\" (UniqueName: \"kubernetes.io/projected/9e7ca8e1-484f-4aef-ae86-a7bacb11137f-kube-api-access-dbj7v\") pod \"network-check-target-xqnhb\" (UID: \"9e7ca8e1-484f-4aef-ae86-a7bacb11137f\") " pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:45.266471 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.266441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqzt6"
Jul 20 19:28:45.283183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.283159    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jqcxh\""
Jul 20 19:28:45.290751 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.290731    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:45.393920 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.393869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqzt6"]
Jul 20 19:28:45.397269 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:28:45.397237    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67862db_568f_45d2_befa_cf4a9c34d52d.slice/crio-bd91f6e67227385043776e9514c9b068aaa1ea32c00b81213fe4b98de5f38521 WatchSource:0}: Error finding container bd91f6e67227385043776e9514c9b068aaa1ea32c00b81213fe4b98de5f38521: Status 404 returned error can't find the container with id bd91f6e67227385043776e9514c9b068aaa1ea32c00b81213fe4b98de5f38521
Jul 20 19:28:45.416994 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.416971    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xqnhb"]
Jul 20 19:28:45.419998 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:28:45.419956    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7ca8e1_484f_4aef_ae86_a7bacb11137f.slice/crio-dd6b38b867bc06fec630b0e0ccbbac384727469ccab870c90124966de24d95c7 WatchSource:0}: Error finding container dd6b38b867bc06fec630b0e0ccbbac384727469ccab870c90124966de24d95c7: Status 404 returned error can't find the container with id dd6b38b867bc06fec630b0e0ccbbac384727469ccab870c90124966de24d95c7
Jul 20 19:28:45.791501 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.791465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xqnhb" event={"ID":"9e7ca8e1-484f-4aef-ae86-a7bacb11137f","Type":"ContainerStarted","Data":"dd6b38b867bc06fec630b0e0ccbbac384727469ccab870c90124966de24d95c7"}
Jul 20 19:28:45.792504 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:45.792481    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqzt6" event={"ID":"e67862db-568f-45d2-befa-cf4a9c34d52d","Type":"ContainerStarted","Data":"bd91f6e67227385043776e9514c9b068aaa1ea32c00b81213fe4b98de5f38521"}
Jul 20 19:28:47.172294 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:47.172252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:28:47.172750 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:47.172388    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:28:47.172750 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:28:47.172459    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:29:19.172438616 +0000 UTC m=+101.274901960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:28:50.808724 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:50.808685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xqnhb" event={"ID":"9e7ca8e1-484f-4aef-ae86-a7bacb11137f","Type":"ContainerStarted","Data":"523fa72a55f2c27e8d85ef0b16bfc20cc9cbae36c24e4edbf30a91bde715c69b"}
Jul 20 19:28:50.809191 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:50.808820    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:28:50.810196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:50.810168    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqzt6" event={"ID":"e67862db-568f-45d2-befa-cf4a9c34d52d","Type":"ContainerStarted","Data":"ab4c0187d3b2740d4379752c18f36fa347cafdc027230034c90e4d91fa29dd25"}
Jul 20 19:28:50.824629 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:28:50.824589    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xqnhb" podStartSLOduration=66.358066813 podStartE2EDuration="1m10.824576722s" totalImagesPullingTime="4.466509909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:50.823404745 +0000 UTC m=+72.925868096" watchObservedRunningTime="2026-07-20 19:28:50.824576722 +0000 UTC m=+72.927040086"
Jul 20 19:29:05.151311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.151105    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vqzt6" podStartSLOduration=80.658090838 podStartE2EDuration="1m25.151068696s" totalImagesPullingTime="4.492977858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:50.837179176 +0000 UTC m=+72.939642538" watchObservedRunningTime="2026-07-20 19:29:05.151068696 +0000 UTC m=+87.253532045"
Jul 20 19:29:05.152185 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.152163    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"]
Jul 20 19:29:05.156097 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.156076    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.159630 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.159608    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 19:29:05.159711 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.159663    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 19:29:05.160993 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.160968    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 19:29:05.161114 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.161012    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 19:29:05.170963 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.170939    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"]
Jul 20 19:29:05.173956 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.173936    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"]
Jul 20 19:29:05.174058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.174039    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.176781 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.176746    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 19:29:05.177045 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.177029    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 19:29:05.177323 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.177302    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 19:29:05.177394 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.177342    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 19:29:05.186797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.186775    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"]
Jul 20 19:29:05.189270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1625fb-0676-40e6-b1fa-212defde96c8-tmp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.189381 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.189381 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.189494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hckp\" (UniqueName: \"kubernetes.io/projected/6b1625fb-0676-40e6-b1fa-212defde96c8-kube-api-access-5hckp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.189494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a32204e-aedb-4150-aacf-00df31727435-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.189494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.189494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8zn\" (UniqueName: \"kubernetes.io/projected/8a32204e-aedb-4150-aacf-00df31727435-kube-api-access-qq8zn\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.189494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b1625fb-0676-40e6-b1fa-212defde96c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.189706 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.189552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290101 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290101 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290117    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hckp\" (UniqueName: \"kubernetes.io/projected/6b1625fb-0676-40e6-b1fa-212defde96c8-kube-api-access-5hckp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.290313 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a32204e-aedb-4150-aacf-00df31727435-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290313 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290209    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290313 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8zn\" (UniqueName: \"kubernetes.io/projected/8a32204e-aedb-4150-aacf-00df31727435-kube-api-access-qq8zn\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290313 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b1625fb-0676-40e6-b1fa-212defde96c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.290479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1625fb-0676-40e6-b1fa-212defde96c8-tmp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.290479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.290908 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.290875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1625fb-0676-40e6-b1fa-212defde96c8-tmp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.291129 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.291106    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a32204e-aedb-4150-aacf-00df31727435-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.293037 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.293010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.293150 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.293020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-ca\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.293150 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.293124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6b1625fb-0676-40e6-b1fa-212defde96c8-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.293454 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.293431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.293511 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.293464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a32204e-aedb-4150-aacf-00df31727435-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.328228 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.328195    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hckp\" (UniqueName: \"kubernetes.io/projected/6b1625fb-0676-40e6-b1fa-212defde96c8-kube-api-access-5hckp\") pod \"klusterlet-addon-workmgr-7d79578fd9-g2t9f\" (UID: \"6b1625fb-0676-40e6-b1fa-212defde96c8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.328656 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.328637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8zn\" (UniqueName: \"kubernetes.io/projected/8a32204e-aedb-4150-aacf-00df31727435-kube-api-access-qq8zn\") pod \"cluster-proxy-proxy-agent-58769fdb8d-vj62w\" (UID: \"8a32204e-aedb-4150-aacf-00df31727435\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.465263 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.465163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:05.494459 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.494421    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:29:05.598037 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.596455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"]
Jul 20 19:29:05.601511 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:29:05.601485    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1625fb_0676_40e6_b1fa_212defde96c8.slice/crio-03eec556ef26feb6ab2621ba12cd679e7a104c461b573fde50efa2e3457b1aa6 WatchSource:0}: Error finding container 03eec556ef26feb6ab2621ba12cd679e7a104c461b573fde50efa2e3457b1aa6: Status 404 returned error can't find the container with id 03eec556ef26feb6ab2621ba12cd679e7a104c461b573fde50efa2e3457b1aa6
Jul 20 19:29:05.624871 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.624842    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"]
Jul 20 19:29:05.627960 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:29:05.627932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a32204e_aedb_4150_aacf_00df31727435.slice/crio-1958a9429a4069ad32e6f16b9757aeb68f291d8d98b02a11e4f3e2e4473e6f54 WatchSource:0}: Error finding container 1958a9429a4069ad32e6f16b9757aeb68f291d8d98b02a11e4f3e2e4473e6f54: Status 404 returned error can't find the container with id 1958a9429a4069ad32e6f16b9757aeb68f291d8d98b02a11e4f3e2e4473e6f54
Jul 20 19:29:05.845197 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.845156    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f" event={"ID":"6b1625fb-0676-40e6-b1fa-212defde96c8","Type":"ContainerStarted","Data":"03eec556ef26feb6ab2621ba12cd679e7a104c461b573fde50efa2e3457b1aa6"}
Jul 20 19:29:05.846298 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:05.846275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerStarted","Data":"1958a9429a4069ad32e6f16b9757aeb68f291d8d98b02a11e4f3e2e4473e6f54"}
Jul 20 19:29:11.868555 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.868518    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f" event={"ID":"6b1625fb-0676-40e6-b1fa-212defde96c8","Type":"ContainerStarted","Data":"b0ff46124d87bb54832d988814ebf703897ec790daf8dd083f254eadd1eeae34"}
Jul 20 19:29:11.869086 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.868632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:11.870566 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.870532    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:29:11.870900 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.870872    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerStarted","Data":"037ca6333c32015b0ff9ec081658edb86053874b6396ccacf98d8d27d06ce9bc"}
Jul 20 19:29:11.870966 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.870911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerStarted","Data":"383a270e0ebafb339005796e9fa400a386feb99f562c2936bf500c7e3f5a59db"}
Jul 20 19:29:11.870966 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.870932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerStarted","Data":"cd08cde17cc87bd78f4bb4f3dca56d69ef915a9ff5fa53a40b1ea3ec54a3943f"}
Jul 20 19:29:11.884298 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.884257    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f" podStartSLOduration=1.6748555330000001 podStartE2EDuration="6.884244017s" totalImagesPullingTime="5.209388484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:11.883354486 +0000 UTC m=+93.985817835" watchObservedRunningTime="2026-07-20 19:29:11.884244017 +0000 UTC m=+93.986707417"
Jul 20 19:29:11.916973 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:11.916927    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" podStartSLOduration=1.732445637 podStartE2EDuration="6.916910613s" totalImagesPullingTime="5.184464976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:11.916243764 +0000 UTC m=+94.018707114" watchObservedRunningTime="2026-07-20 19:29:11.916910613 +0000 UTC m=+94.019373962"
Jul 20 19:29:19.187771 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:19.187713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:29:19.188169 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:29:19.187857    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:29:19.188169 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:29:19.187918    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:30:23.187901354 +0000 UTC m=+165.290364681 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:29:21.814404 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:21.814372    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xqnhb"
Jul 20 19:29:49.000813 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:29:49.000773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:29:49.001294 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:29:49.000942    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 19:29:49.001294 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:29:49.001020    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:31:51.001002833 +0000 UTC m=+253.103466164 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : secret "metrics-daemon-secret" not found
Jul 20 19:30:18.317557 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:30:18.317516    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4hb8q" podUID="b21d7e38-fef6-485c-b588-7c8df2c1d367"
Jul 20 19:30:18.573018 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:30:18.572919    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:30:19.060938 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:30:19.060910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:30:23.245732 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:30:23.245673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:30:23.246185 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:30:23.245841    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:30:23.246185 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:30:23.245906    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls podName:b21d7e38-fef6-485c-b588-7c8df2c1d367 nodeName:}" failed. No retries permitted until 2026-07-20 19:32:25.245889686 +0000 UTC m=+287.348353013 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls") pod "dns-default-4hb8q" (UID: "b21d7e38-fef6-485c-b588-7c8df2c1d367") : secret "dns-default-metrics-tls" not found
Jul 20 19:30:32.542566 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:30:32.542475    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:31:11.209189 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:11.209102    2571 generic.go:356] "Generic (PLEG): container finished" podID="6b1625fb-0676-40e6-b1fa-212defde96c8" containerID="b0ff46124d87bb54832d988814ebf703897ec790daf8dd083f254eadd1eeae34" exitCode=1
Jul 20 19:31:11.209189 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:11.209159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f" event={"ID":"6b1625fb-0676-40e6-b1fa-212defde96c8","Type":"ContainerDied","Data":"b0ff46124d87bb54832d988814ebf703897ec790daf8dd083f254eadd1eeae34"}
Jul 20 19:31:11.209595 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:11.209450    2571 scope.go:117] "RemoveContainer" containerID="b0ff46124d87bb54832d988814ebf703897ec790daf8dd083f254eadd1eeae34"
Jul 20 19:31:11.869368 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:11.869333    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:31:12.213857 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:12.213774    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f" event={"ID":"6b1625fb-0676-40e6-b1fa-212defde96c8","Type":"ContainerStarted","Data":"0e1ac3488198bbf95a4f756009e152f0a04150c60635be10ac25d398bce7be66"}
Jul 20 19:31:12.214279 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:12.213960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:31:12.214575 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:12.214552    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d79578fd9-g2t9f"
Jul 20 19:31:13.474223 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:13.474196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:39.325108 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:39.325058    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:39.387207 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:39.387176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.338908 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.338872    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.419170 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.419138    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bmtzs"]
Jul 20 19:31:43.421178 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.421159    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.424308 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.424285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:31:43.424308 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.424296    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:31:43.424457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.424324    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:31:43.425544 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.425530    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:31:43.425593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.425560    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lkqn\""
Jul 20 19:31:43.427831 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.427454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.440567 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.440530    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmtzs"]
Jul 20 19:31:43.469723 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.469698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f818aad9-946f-43dc-89de-fd1f524c511a-crio-socket\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.469854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.469732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.469854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.469779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxkqz\" (UniqueName: \"kubernetes.io/projected/f818aad9-946f-43dc-89de-fd1f524c511a-kube-api-access-pxkqz\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.469854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.469803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f818aad9-946f-43dc-89de-fd1f524c511a-data-volume\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.469854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.469820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.565166 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.565133    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.570062 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570127 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxkqz\" (UniqueName: \"kubernetes.io/projected/f818aad9-946f-43dc-89de-fd1f524c511a-kube-api-access-pxkqz\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570127 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f818aad9-946f-43dc-89de-fd1f524c511a-data-volume\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570127 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570238 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:43.570184    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:43.570238 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f818aad9-946f-43dc-89de-fd1f524c511a-crio-socket\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570309 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:43.570251    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:44.07023272 +0000 UTC m=+246.172696049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:43.570309 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:43.570273    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:31:43.570309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570276    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f818aad9-946f-43dc-89de-fd1f524c511a-crio-socket\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.570419 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:43.570319    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:44.070307647 +0000 UTC m=+246.172770993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : configmap "kube-rbac-proxy" not found
Jul 20 19:31:43.570462 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.570415    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f818aad9-946f-43dc-89de-fd1f524c511a-data-volume\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.580416 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.580386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxkqz\" (UniqueName: \"kubernetes.io/projected/f818aad9-946f-43dc-89de-fd1f524c511a-kube-api-access-pxkqz\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:43.676624 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.676499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.753723 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.753673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:43.814314 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:43.814287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.074486 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.074453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:44.074678 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.074523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:44.074678 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:44.074602    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:44.074678 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:44.074640    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:31:44.074827 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:44.074695    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:45.074675966 +0000 UTC m=+247.177139313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:44.074827 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:44.074709    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:45.07470299 +0000 UTC m=+247.177166316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : configmap "kube-rbac-proxy" not found
Jul 20 19:31:44.142718 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.142685    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.245512 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.245474    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.577216 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.577181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.633331 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.633302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.850314 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.850229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:44.950794 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:44.950749    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:45.081122 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:45.081082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:45.081272 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:45.081127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:45.081272 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:45.081215    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:31:45.081272 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:45.081224    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:45.081373 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:45.081286    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:47.081271652 +0000 UTC m=+249.183734978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : configmap "kube-rbac-proxy" not found
Jul 20 19:31:45.081373 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:45.081301    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:47.081294941 +0000 UTC m=+249.183758267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:45.394986 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:45.394960    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qr9f7_d790f871-1adb-4dd5-b33e-76eddb1a7e37/dns-node-resolver/0.log"
Jul 20 19:31:46.194840 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.194812    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpf7n_60abd88d-d838-4a64-9c73-7a8fcb293ba9/node-ca/0.log"
Jul 20 19:31:46.334987 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.334955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:46.388071 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.388043    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:46.488998 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.488969    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:46.595455 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.595425    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:46.996011 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:46.995987    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84znv_58a81467-5bc1-4dca-8288-8fa508be8b12/serve-healthcheck-canary/0.log"
Jul 20 19:31:47.096487 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:47.096448    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:47.096487 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:47.096501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:47.096669 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:47.096583    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:31:47.096669 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:47.096622    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:47.096669 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:47.096634    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:51.096619883 +0000 UTC m=+253.199083210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : configmap "kube-rbac-proxy" not found
Jul 20 19:31:47.096796 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:47.096691    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:51.096673836 +0000 UTC m=+253.199137167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:47.450898 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:47.450786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:49.895164 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:49.895112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.146659 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.146553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.207170 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.207139    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.269998 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.269954    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.368208 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.368179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.470777 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.470677    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:50.655919 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:50.655888    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:51.010649 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:51.010616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:51.028543 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:51.028514    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:31:51.028703 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.028684    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 19:31:51.028795 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.028782    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs podName:6b88c176-52b1-4141-80b8-43b7d09f00fe nodeName:}" failed. No retries permitted until 2026-07-20 19:33:53.028742106 +0000 UTC m=+375.131205436 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs") pod "network-metrics-daemon-mk4ml" (UID: "6b88c176-52b1-4141-80b8-43b7d09f00fe") : secret "metrics-daemon-secret" not found
Jul 20 19:31:51.129591 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:51.129541    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:51.129591 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:51.129599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:51.129868 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.129686    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:51.129868 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.129748    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:59.12972931 +0000 UTC m=+261.232192652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:51.129868 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.129686    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:31:51.129868 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:51.129829    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:31:59.129813271 +0000 UTC m=+261.232276598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : configmap "kube-rbac-proxy" not found
Jul 20 19:31:51.790099 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:51.790065    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:52.003689 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:52.003651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:52.186285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:52.186201    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:52.386239 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:52.386208    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:52.584060 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:52.584017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:53.591370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:53.591334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:53.707587 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:53.707562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:53.808092 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:53.808058    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:53.864215 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:53.864135    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:53.991308 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:53.991276    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:54.183500 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:54.183418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.182246 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:55.182213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.589690 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:55.589656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.785357 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:55.785322    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:55.981281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:55.981253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:56.375819 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:56.375726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:56.433240 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:56.433209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:56.609070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:56.609035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:57.181057 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:57.181025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:57.379085 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:57.379028    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:57.785122 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:57.785089    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:57.982024 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:57.981999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:58.385999 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:58.385968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:58.907947 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:58.907916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:59.009038 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.009009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:59.185033 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.184942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:59.185033 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.184986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:59.185216 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:59.185109    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:59.185216 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:31:59.185180    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls podName:f818aad9-946f-43dc-89de-fd1f524c511a nodeName:}" failed. No retries permitted until 2026-07-20 19:32:15.185162845 +0000 UTC m=+277.287626192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmtzs" (UID: "f818aad9-946f-43dc-89de-fd1f524c511a") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:31:59.185475 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.185459    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f818aad9-946f-43dc-89de-fd1f524c511a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:31:59.395474 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.395443    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:59.780624 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:31:59.780504    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:00.034839 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:00.034742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:00.392356 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:00.392268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:00.583106 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:00.583072    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:05.382351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:05.382320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:05.446653 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:05.446625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:07.974850 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:07.974813    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:08.264195 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:08.264112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:11.483338 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:11.483299    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:11.580738 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:11.580707    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:13.540273 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:13.540234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:13.639491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:13.639459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:13.735479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:13.735449    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:14.146280 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:14.146246    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:15.199868 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:15.199838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:32:15.202244 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:15.202213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f818aad9-946f-43dc-89de-fd1f524c511a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmtzs\" (UID: \"f818aad9-946f-43dc-89de-fd1f524c511a\") " pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:32:15.229982 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:15.229950    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmtzs"
Jul 20 19:32:15.349673 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:15.349643    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmtzs"]
Jul 20 19:32:15.353281 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:32:15.353256    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf818aad9_946f_43dc_89de_fd1f524c511a.slice/crio-36eaf3deffc86efa572309a05bdd0305f369ca07c7c8490cdbe18ab38858299c WatchSource:0}: Error finding container 36eaf3deffc86efa572309a05bdd0305f369ca07c7c8490cdbe18ab38858299c: Status 404 returned error can't find the container with id 36eaf3deffc86efa572309a05bdd0305f369ca07c7c8490cdbe18ab38858299c
Jul 20 19:32:15.384228 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:15.384201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmtzs" event={"ID":"f818aad9-946f-43dc-89de-fd1f524c511a","Type":"ContainerStarted","Data":"36eaf3deffc86efa572309a05bdd0305f369ca07c7c8490cdbe18ab38858299c"}
Jul 20 19:32:16.822596 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:16.822559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:16.882574 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:16.882537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:17.407047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:17.407013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:20.403101 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:20.403071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmtzs" event={"ID":"f818aad9-946f-43dc-89de-fd1f524c511a","Type":"ContainerStarted","Data":"a0a09a399f159174aec27656a85b01eda6bf467ca71c91b9bdd3123ffeb0579e"}
Jul 20 19:32:21.127877 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:21.127838    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:22.061457 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:32:22.061419    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4hb8q" podUID="b21d7e38-fef6-485c-b588-7c8df2c1d367"
Jul 20 19:32:22.409492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:22.409415    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:22.907521 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:22.907483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.135486 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.135455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.191085 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.191007    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nc827"]
Jul 20 19:32:23.210703 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.209131    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nc827"]
Jul 20 19:32:23.210703 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.209307    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.212832 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.212664    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 19:32:23.212832 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.212678    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 19:32:23.212832 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.212813    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:32:23.214183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.214159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 19:32:23.214969 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.214947    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:32:23.215074 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.214947    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kwd22\""
Jul 20 19:32:23.215074 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.215014    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:32:23.215668 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.215649    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jdpbs"]
Jul 20 19:32:23.217691 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.217674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.220288 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.220262    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:32:23.220514 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.220488    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r5lrj\""
Jul 20 19:32:23.220613 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.220557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:32:23.220613 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.220598    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:32:23.245656 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.245631    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.343438 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.343406    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.361741 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.361922 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-sys\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.361922 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.361922 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-accelerators-collector-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.361922 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-root\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.361922 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-metrics-client-ca\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fhhg\" (UniqueName: \"kubernetes.io/projected/da05813e-3bbf-4ae0-be66-6d243de98d22-kube-api-access-2fhhg\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.361991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-wtmp\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-tls\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3a16e57-41b2-4a0b-8a2d-d56491328557-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.362183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.362473 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362218    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-textfile\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.362473 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.362473 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.362274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7kh\" (UniqueName: \"kubernetes.io/projected/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-api-access-pt7kh\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.445303 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.445227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.463341 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-textfile\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7kh\" (UniqueName: \"kubernetes.io/projected/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-api-access-pt7kh\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-sys\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463519 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-accelerators-collector-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-root\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-sys\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-metrics-client-ca\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fhhg\" (UniqueName: \"kubernetes.io/projected/da05813e-3bbf-4ae0-be66-6d243de98d22-kube-api-access-2fhhg\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463635    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-wtmp\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-tls\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-textfile\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.463953 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.463885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-wtmp\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.464408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da05813e-3bbf-4ae0-be66-6d243de98d22-root\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.464408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.464408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3a16e57-41b2-4a0b-8a2d-d56491328557-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.464408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.464607 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3a16e57-41b2-4a0b-8a2d-d56491328557-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.464819 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.464751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-accelerators-collector-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.465093 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.465035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da05813e-3bbf-4ae0-be66-6d243de98d22-metrics-client-ca\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.466725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.466600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.466725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.466663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-tls\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.467036 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.467017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da05813e-3bbf-4ae0-be66-6d243de98d22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.467189 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.467169    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.475342 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.475317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7kh\" (UniqueName: \"kubernetes.io/projected/d3a16e57-41b2-4a0b-8a2d-d56491328557-kube-api-access-pt7kh\") pod \"kube-state-metrics-56c5594674-nc827\" (UID: \"d3a16e57-41b2-4a0b-8a2d-d56491328557\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.475752 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.475727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fhhg\" (UniqueName: \"kubernetes.io/projected/da05813e-3bbf-4ae0-be66-6d243de98d22-kube-api-access-2fhhg\") pod \"node-exporter-jdpbs\" (UID: \"da05813e-3bbf-4ae0-be66-6d243de98d22\") " pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.521510 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.521478    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827"
Jul 20 19:32:23.530004 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.529981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jdpbs"
Jul 20 19:32:23.544982 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.544956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.827366 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:23.827333    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:23.948584 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:32:23.948550    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda05813e_3bbf_4ae0_be66_6d243de98d22.slice/crio-6ccfb0d899cc64e5e79fc97386bfdb56e588d61aacb2c4d5f903ea32b2454d04 WatchSource:0}: Error finding container 6ccfb0d899cc64e5e79fc97386bfdb56e588d61aacb2c4d5f903ea32b2454d04: Status 404 returned error can't find the container with id 6ccfb0d899cc64e5e79fc97386bfdb56e588d61aacb2c4d5f903ea32b2454d04
Jul 20 19:32:24.071899 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.071870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nc827"]
Jul 20 19:32:24.074910 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:32:24.074885    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a16e57_41b2_4a0b_8a2d_d56491328557.slice/crio-97782d72d1c9b50609de7adbac8bb584909c90abfc4b79791eb158c205b6e0c4 WatchSource:0}: Error finding container 97782d72d1c9b50609de7adbac8bb584909c90abfc4b79791eb158c205b6e0c4: Status 404 returned error can't find the container with id 97782d72d1c9b50609de7adbac8bb584909c90abfc4b79791eb158c205b6e0c4
Jul 20 19:32:24.170598 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.170562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.246488 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.246438    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:24.418837 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.418739    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmtzs" event={"ID":"f818aad9-946f-43dc-89de-fd1f524c511a","Type":"ContainerStarted","Data":"b0ef34fa6632dc15ab144fe1c28e300326e05ea55c16326d141277e99c7937f3"}
Jul 20 19:32:24.419993 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.419965    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jdpbs" event={"ID":"da05813e-3bbf-4ae0-be66-6d243de98d22","Type":"ContainerStarted","Data":"6ccfb0d899cc64e5e79fc97386bfdb56e588d61aacb2c4d5f903ea32b2454d04"}
Jul 20 19:32:24.421087 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.421065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827" event={"ID":"d3a16e57-41b2-4a0b-8a2d-d56491328557","Type":"ContainerStarted","Data":"97782d72d1c9b50609de7adbac8bb584909c90abfc4b79791eb158c205b6e0c4"}
Jul 20 19:32:24.674530 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:24.674361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.277118 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.277044    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.278114 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.278088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:25.281196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.281168    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21d7e38-fef6-485c-b588-7c8df2c1d367-metrics-tls\") pod \"dns-default-4hb8q\" (UID: \"b21d7e38-fef6-485c-b588-7c8df2c1d367\") " pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:25.376632 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.376598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.412715 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.412681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27sg8\""
Jul 20 19:32:25.421071 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.421029    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:25.453209 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.453143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.562947 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.562867    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.865341 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.865275    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4hb8q"]
Jul 20 19:32:25.871487 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:32:25.871436    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21d7e38_fef6_485c_b588_7c8df2c1d367.slice/crio-91631b41b33eea3e04f1ea67bcb8822d8ed436f655b6e6fff26484ee338110f2 WatchSource:0}: Error finding container 91631b41b33eea3e04f1ea67bcb8822d8ed436f655b6e6fff26484ee338110f2: Status 404 returned error can't find the container with id 91631b41b33eea3e04f1ea67bcb8822d8ed436f655b6e6fff26484ee338110f2
Jul 20 19:32:25.939174 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.939091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:25.997452 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:25.997397    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:26.112976 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.112849    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:26.430480 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.430392    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827" event={"ID":"d3a16e57-41b2-4a0b-8a2d-d56491328557","Type":"ContainerStarted","Data":"2e0645974bdad54d667d718c8408fb66eb993a5052a22a60b47cdce79006d6b6"}
Jul 20 19:32:26.430480 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.430463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827" event={"ID":"d3a16e57-41b2-4a0b-8a2d-d56491328557","Type":"ContainerStarted","Data":"f5a943fca5fadb576b91c68edb27158bd45ca997f43f33f091bcaadfe5e90612"}
Jul 20 19:32:26.431008 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.430497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827" event={"ID":"d3a16e57-41b2-4a0b-8a2d-d56491328557","Type":"ContainerStarted","Data":"24d2f074f817a6491e472559524b2cf5a7db8cbbaa002694eacbeadfcfaf044f"}
Jul 20 19:32:26.436574 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.432710    2571 generic.go:356] "Generic (PLEG): container finished" podID="da05813e-3bbf-4ae0-be66-6d243de98d22" containerID="712a56fc64d55763911bd5b5255a1c0292558236d175179c0fa075543825178d" exitCode=0
Jul 20 19:32:26.436574 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.432867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jdpbs" event={"ID":"da05813e-3bbf-4ae0-be66-6d243de98d22","Type":"ContainerDied","Data":"712a56fc64d55763911bd5b5255a1c0292558236d175179c0fa075543825178d"}
Jul 20 19:32:26.437401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.437373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hb8q" event={"ID":"b21d7e38-fef6-485c-b588-7c8df2c1d367","Type":"ContainerStarted","Data":"91631b41b33eea3e04f1ea67bcb8822d8ed436f655b6e6fff26484ee338110f2"}
Jul 20 19:32:26.450686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:26.450642    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-nc827" podStartSLOduration=1.805162013 podStartE2EDuration="3.450596076s" totalImagesPullingTime="1.645434063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:26.448888809 +0000 UTC m=+288.551352162" watchObservedRunningTime="2026-07-20 19:32:26.450596076 +0000 UTC m=+288.553059426"
Jul 20 19:32:27.508067 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:27.508028    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:27.775013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:27.774925    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:28.155457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.155365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:28.214214 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.214178    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:28.446409 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.446322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmtzs" event={"ID":"f818aad9-946f-43dc-89de-fd1f524c511a","Type":"ContainerStarted","Data":"517d3c9206a5319ef494ecc7e2a053146ebdb85244a8c4a19b8b17f6cae4c924"}
Jul 20 19:32:28.448858 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.448822    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jdpbs" event={"ID":"da05813e-3bbf-4ae0-be66-6d243de98d22","Type":"ContainerStarted","Data":"eb67d23ac668b6c913d60e7d1158ec25939e10790c57d92846b31486507574b8"}
Jul 20 19:32:28.449003 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.448882    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jdpbs" event={"ID":"da05813e-3bbf-4ae0-be66-6d243de98d22","Type":"ContainerStarted","Data":"01b2d65886c799c3c681db2a73ea1edd44768a3e7e7770d0b29a84f585870ad8"}
Jul 20 19:32:28.464666 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.464614    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bmtzs" podStartSLOduration=33.074087935 podStartE2EDuration="45.464598624s" totalImagesPullingTime="12.390510689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:31:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:28.462144104 +0000 UTC m=+290.564607456" watchObservedRunningTime="2026-07-20 19:32:28.464598624 +0000 UTC m=+290.567061972"
Jul 20 19:32:28.480617 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.480561    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jdpbs" podStartSLOduration=3.635504922 podStartE2EDuration="5.480544164s" totalImagesPullingTime="1.756609106s" totalInitContainerRuntime="88.430136ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:28.479153031 +0000 UTC m=+290.581616387" watchObservedRunningTime="2026-07-20 19:32:28.480544164 +0000 UTC m=+290.583007512"
Jul 20 19:32:28.569460 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:28.569422    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:29.388309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.388281    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:32:29.391812 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.391797    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.395440 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.395412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:29.396887 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.396864    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 19:32:29.397007 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.396983    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k7r6c\""
Jul 20 19:32:29.397073 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397011    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 19:32:29.397593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397366    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:32:29.397593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397399    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 19:32:29.397593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397432    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 19:32:29.397593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397432    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 19:32:29.397593 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.397437    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 19:32:29.398521 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.398489    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 19:32:29.398636 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.398547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3cr8qcg5jlet1\""
Jul 20 19:32:29.398848 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.398834    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 19:32:29.399372 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.399316    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 19:32:29.399372 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.399343    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 19:32:29.400391 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.400176    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 19:32:29.403869 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.400669    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 19:32:29.403869 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.403773    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 19:32:29.405704 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.405682    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 19:32:29.410173 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410145    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410242    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410474 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410474 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410474 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410615 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410615 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410615 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410615 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410615 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410617    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64ll\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.410870 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.410846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.411182 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.411022    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:32:29.453616 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.453578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hb8q" event={"ID":"b21d7e38-fef6-485c-b588-7c8df2c1d367","Type":"ContainerStarted","Data":"650554ad2b09139614278fbd0dfeda7d6b7d54c98b89d172b528b1ea01a945a9"}
Jul 20 19:32:29.453794 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.453664    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:29.453794 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.453706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hb8q" event={"ID":"b21d7e38-fef6-485c-b588-7c8df2c1d367","Type":"ContainerStarted","Data":"81c8cf1fba040f22a4c50b1a6b1975bf9402177468064a8249cb01b63f94b48d"}
Jul 20 19:32:29.473101 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.473048    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4hb8q" podStartSLOduration=251.405729286 podStartE2EDuration="4m14.473030411s" totalImagesPullingTime="3.067301125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:29.472575703 +0000 UTC m=+291.575039053" watchObservedRunningTime="2026-07-20 19:32:29.473030411 +0000 UTC m=+291.575493766"
Jul 20 19:32:29.511825 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512002 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.511953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512315 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512315 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512315 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512692 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512692 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512692 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512692 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64ll\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.512925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.512687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.513452 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.513429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.513940 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.513906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.514955 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.514936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.515684 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.515350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.515916 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.515897    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.516281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.516116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.516281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.516198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.516980 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.516957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.517171 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.517121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.517171 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.517147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.517443 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.517402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.517962 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.517940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.518105 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.518061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.518351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.518288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.518549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.518527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.518846 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.518826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.519099 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.519080    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.519446 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.519426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.519513 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.519462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.521252 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.521229    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64ll\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll\") pod \"prometheus-k8s-0\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.703096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.703018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:29.840895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:29.840869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:32:29.843300 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:32:29.843268    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0005952f_9470_45a1_9711_867e508578a1.slice/crio-ede2f0e4ee81e656cccfa4000cbac611bf94232b6a47d7dc50d660a5c30a28bb WatchSource:0}: Error finding container ede2f0e4ee81e656cccfa4000cbac611bf94232b6a47d7dc50d660a5c30a28bb: Status 404 returned error can't find the container with id ede2f0e4ee81e656cccfa4000cbac611bf94232b6a47d7dc50d660a5c30a28bb
Jul 20 19:32:30.027256 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:30.027218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:30.125777 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:30.125737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:30.226095 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:30.226062    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:30.458777 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:30.458646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"ede2f0e4ee81e656cccfa4000cbac611bf94232b6a47d7dc50d660a5c30a28bb"}
Jul 20 19:32:31.463584 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:31.463546    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e" exitCode=0
Jul 20 19:32:31.463977 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:31.463629    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"}
Jul 20 19:32:31.496056 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:31.496026    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:31.594385 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:31.594355    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:35.484231 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:35.484187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"}
Jul 20 19:32:35.484609 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:35.484310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"}
Jul 20 19:32:35.543500 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:32:35.543459    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mk4ml" podUID="6b88c176-52b1-4141-80b8-43b7d09f00fe"
Jul 20 19:32:37.494724 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:37.494690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"}
Jul 20 19:32:37.495107 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:37.494773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"}
Jul 20 19:32:37.495107 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:37.494807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"}
Jul 20 19:32:37.495107 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:37.494834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerStarted","Data":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"}
Jul 20 19:32:37.528800 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:37.528721    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.247997109 podStartE2EDuration="8.528703982s" totalImagesPullingTime="6.262764097s" totalInitContainerRuntime="17.942776ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:37.526639534 +0000 UTC m=+299.629102897" watchObservedRunningTime="2026-07-20 19:32:37.528703982 +0000 UTC m=+299.631167330"
Jul 20 19:32:38.773645 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:38.773607    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:38.871925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:38.871888    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:39.172315 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:39.172232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:32:39.173033 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:39.173005    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:32:39.181886 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:39.181866    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 19:32:39.460804 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:39.460710    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4hb8q"
Jul 20 19:32:39.703556 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:39.703428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:32:40.424104 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:40.424068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:40.522347 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:40.522318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:41.257135 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:41.257099    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:41.310081 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:41.310048    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:42.100380 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:42.100339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:42.153912 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:42.153878    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:43.579051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:43.579019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:43.682657 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:43.682623    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:45.397676 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:45.397638    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:45.501454 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:45.501412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:48.061132 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:48.061093    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:48.123437 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:48.123407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:49.505942 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:49.505907    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:49.582884 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:49.582850    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:50.366804 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:50.366771    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:50.442846 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:50.442814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:50.542181 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:50.542153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:32:51.181052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:51.181022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:51.282199 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:51.282167    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:51.341817 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:51.341783    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:55.495817 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:55.495747    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" podUID="8a32204e-aedb-4150-aacf-00df31727435" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 19:32:57.116786 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:57.116739    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:32:57.185313 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:32:57.185283    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:04.925265 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:04.925211    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:05.009591 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:05.009561    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:05.495952 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:05.495914    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" podUID="8a32204e-aedb-4150-aacf-00df31727435" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 19:33:15.496406 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.496367    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" podUID="8a32204e-aedb-4150-aacf-00df31727435" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 20 19:33:15.496815 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.496447    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w"
Jul 20 19:33:15.497034 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.497002    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"037ca6333c32015b0ff9ec081658edb86053874b6396ccacf98d8d27d06ce9bc"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 20 19:33:15.497075 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.497058    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" podUID="8a32204e-aedb-4150-aacf-00df31727435" containerName="service-proxy" containerID="cri-o://037ca6333c32015b0ff9ec081658edb86053874b6396ccacf98d8d27d06ce9bc" gracePeriod=30
Jul 20 19:33:15.626561 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.626528    2571 generic.go:356] "Generic (PLEG): container finished" podID="8a32204e-aedb-4150-aacf-00df31727435" containerID="037ca6333c32015b0ff9ec081658edb86053874b6396ccacf98d8d27d06ce9bc" exitCode=2
Jul 20 19:33:15.626677 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:15.626593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerDied","Data":"037ca6333c32015b0ff9ec081658edb86053874b6396ccacf98d8d27d06ce9bc"}
Jul 20 19:33:16.632174 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:16.632138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58769fdb8d-vj62w" event={"ID":"8a32204e-aedb-4150-aacf-00df31727435","Type":"ContainerStarted","Data":"ad4cf3488f8c6a5373c813fa555f08e14419b6038f79d8eae5b4b3bef7329f82"}
Jul 20 19:33:29.703281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:29.703201    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:29.721497 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:29.721468    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:30.695237 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:30.695205    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:39.041436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:39.041393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:39.263487 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:39.263455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:39.322585 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:39.322511    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:40.016507 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:40.016469    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:40.092035 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:40.092000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:43.298588 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:43.298553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:43.370052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:43.370020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:43.431150 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:43.431121    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:43.531399 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:43.531370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:44.028455 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:44.028423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:44.089076 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:44.089041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:47.789853 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.789818    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790118    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="prometheus" containerID="cri-o://1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52" gracePeriod=600
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790127    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="thanos-sidecar" containerID="cri-o://e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567" gracePeriod=600
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790151    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="config-reloader" containerID="cri-o://de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195" gracePeriod=600
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790144    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da" gracePeriod=600
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790125    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy" containerID="cri-o://45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9" gracePeriod=600
Jul 20 19:33:47.790285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:47.790165    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-web" containerID="cri-o://cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f" gracePeriod=600
Jul 20 19:33:48.033908 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.033877    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.147778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147658    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.147778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.147778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147731    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s64ll\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.147778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147777    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147806    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147832    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147858    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147882    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147910    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147935    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147957    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.147995    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148040    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148079    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148129    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148178    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148221    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148340    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148361    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets\") pod \"0005952f-9470-45a1-9711-867e508578a1\" (UID: \"0005952f-9470-45a1-9711-867e508578a1\") "
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148353    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148565    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148566    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.148662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148583    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.149257 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148867    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.149257 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.148928    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.150083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.149836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.150695 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.150659    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out" (OuterVolumeSpecName: "config-out") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:33:48.150814 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.150665    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.150814 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.150690    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.150814 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.150718    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll" (OuterVolumeSpecName: "kube-api-access-s64ll") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "kube-api-access-s64ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:33:48.151584 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.151352    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config" (OuterVolumeSpecName: "config") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.151584 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.151452    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:33:48.151738 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.151602    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.151886 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.151846    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:33:48.151997 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.151936    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:48.152353 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.152334    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.152970 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.152953    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.153042 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.152988    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.153430 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.153414    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.161576 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.161556    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config" (OuterVolumeSpecName: "web-config") pod "0005952f-9470-45a1-9711-867e508578a1" (UID: "0005952f-9470-45a1-9711-867e508578a1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:33:48.249058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249014    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249057    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s64ll\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-kube-api-access-s64ll\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249068    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-config-out\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249077    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249087    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249098    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249107    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-grpc-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249115    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249122    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249133    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249141    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249149    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0005952f-9470-45a1-9711-867e508578a1-prometheus-k8s-db\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249157    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-kube-rbac-proxy\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249166    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0005952f-9470-45a1-9711-867e508578a1-configmap-metrics-client-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249174    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249183    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-web-config\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249190    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0005952f-9470-45a1-9711-867e508578a1-secret-metrics-client-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.249267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.249198    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0005952f-9470-45a1-9711-867e508578a1-tls-assets\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:33:48.744463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744428    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da" exitCode=0
Jul 20 19:33:48.744463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744453    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9" exitCode=0
Jul 20 19:33:48.744463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744461    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f" exitCode=0
Jul 20 19:33:48.744463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744469    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567" exitCode=0
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744476    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195" exitCode=0
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744483    2571 generic.go:356] "Generic (PLEG): container finished" podID="0005952f-9470-45a1-9711-867e508578a1" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52" exitCode=0
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744500    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744632    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744648    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744658    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744683    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"}
Jul 20 19:33:48.744712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.744706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0005952f-9470-45a1-9711-867e508578a1","Type":"ContainerDied","Data":"ede2f0e4ee81e656cccfa4000cbac611bf94232b6a47d7dc50d660a5c30a28bb"}
Jul 20 19:33:48.752561 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.752543    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.759561 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.759535    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.765522 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.765506    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.771739 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.771297    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:48.772058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.772024    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.776252 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.776230    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:48.778627 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.778611    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.785182 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.785168    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.791309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791142    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.791516 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.791358    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.791516 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791380    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.791516 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791397    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.791638 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.791597    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.791638 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791621    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.791705 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791639    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.791869 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.791854    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.791930 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791871    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.791930 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.791886    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.792106 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.792087    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.792166 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792114    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.792166 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792135    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.792364 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.792350    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.792398 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792367    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.792398 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792385    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.792585 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.792569    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.792645 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792592    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.792645 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792610    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.792833 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:33:48.792818    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.792882 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792837    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.792882 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792851    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.793013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.792996    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.793054 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793014    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.793230 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793215    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.793281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793229    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.793450 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793431    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.793500 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793451    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.793636 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793616    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.793675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793640    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.793843 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793823    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.793897 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.793843    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.794055 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794035    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.794094 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794060    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.794282 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794264    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.794323 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794282    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.794479 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794463    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.794522 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794479    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.794652 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794637    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.794691 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794652    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.794830 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794814    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.794901 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.794829    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.795028 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795010    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.795071 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795031    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.795220 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795202    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.795259 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795221    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.795408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795385    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.795408 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795400    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.795578 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795558    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.795645 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795579    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.795776 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795748    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.795826 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795776    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.795943 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795926    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.795984 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.795943    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.796119 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796102    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.796166 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796120    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.796332 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796313    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.796370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796332    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.796529 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796509    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.796597 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796530    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.796774 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796746    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.796844 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796777    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.796996 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796979    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.797051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.796997    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.797179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797162    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.797247 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797180    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.797393 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797378    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.797455 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797394    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.797633 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797612    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.797709 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797635    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.797921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797900    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.797921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.797920    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.798172 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798130    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.798172 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798153    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.798442 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798425    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.798442 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798441    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.798787 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798750    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.798787 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.798787    2571 scope.go:117] "RemoveContainer" containerID="850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"
Jul 20 19:33:48.799060 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799031    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da"} err="failed to get container status \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": rpc error: code = NotFound desc = could not find container \"850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da\": container with ID starting with 850b6378574035e18bac45e22b14f4f33e951c38ee191bd0e3275037190cf5da not found: ID does not exist"
Jul 20 19:33:48.799060 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799055    2571 scope.go:117] "RemoveContainer" containerID="45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"
Jul 20 19:33:48.799281 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799266    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9"} err="failed to get container status \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": rpc error: code = NotFound desc = could not find container \"45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9\": container with ID starting with 45f8499919cfd4fe9cec25c81ed5058fad2f99ccb211f34ea4a96706e33f25c9 not found: ID does not exist"
Jul 20 19:33:48.799321 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799281    2571 scope.go:117] "RemoveContainer" containerID="cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"
Jul 20 19:33:48.799477 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799461    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f"} err="failed to get container status \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": rpc error: code = NotFound desc = could not find container \"cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f\": container with ID starting with cfa071b4cada66c2d7d3eb884967bb4760aff6792090952a75f939f961a4529f not found: ID does not exist"
Jul 20 19:33:48.799477 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799477    2571 scope.go:117] "RemoveContainer" containerID="e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"
Jul 20 19:33:48.799675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799659    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567"} err="failed to get container status \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": rpc error: code = NotFound desc = could not find container \"e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567\": container with ID starting with e039f1de6a2bdf64797ca0bf4cb771c998ae4bc5d1bd606281a6fcaed5c20567 not found: ID does not exist"
Jul 20 19:33:48.799715 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799675    2571 scope.go:117] "RemoveContainer" containerID="de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"
Jul 20 19:33:48.799925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799907    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195"} err="failed to get container status \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": rpc error: code = NotFound desc = could not find container \"de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195\": container with ID starting with de5f6dd00afd823b47df23c31347a16727a634a1e7642c2f8773855fb108f195 not found: ID does not exist"
Jul 20 19:33:48.799925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.799924    2571 scope.go:117] "RemoveContainer" containerID="1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"
Jul 20 19:33:48.800159 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.800143    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52"} err="failed to get container status \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": rpc error: code = NotFound desc = could not find container \"1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52\": container with ID starting with 1f1b99e4cfbbb571a0546951a588abf88f230ae98e5cad474e66be855b795e52 not found: ID does not exist"
Jul 20 19:33:48.800201 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.800160    2571 scope.go:117] "RemoveContainer" containerID="ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"
Jul 20 19:33:48.800383 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.800363    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e"} err="failed to get container status \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": rpc error: code = NotFound desc = could not find container \"ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e\": container with ID starting with ce92203cf3b49a3d6c9b9459fa3e2dde9e71d567b6c4ab3044551e48569c795e not found: ID does not exist"
Jul 20 19:33:48.811595 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811572    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:48.811847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811833    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy"
Jul 20 19:33:48.811847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811848    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811856    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="init-config-reloader"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811862    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="init-config-reloader"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811871    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="thanos-sidecar"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811877    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="thanos-sidecar"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811885    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-web"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811889    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-web"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811896    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-thanos"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811901    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-thanos"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811910    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="prometheus"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811916    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="prometheus"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811926    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="config-reloader"
Jul 20 19:33:48.811948 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811934    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="config-reloader"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811972    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-web"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811979    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="config-reloader"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811985    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.811992    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="thanos-sidecar"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.812003    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="prometheus"
Jul 20 19:33:48.812358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.812011    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0005952f-9470-45a1-9711-867e508578a1" containerName="kube-rbac-proxy-thanos"
Jul 20 19:33:48.814158 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.814144    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.817209 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.817192    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 19:33:48.817395 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.817380    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 19:33:48.817463 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.817380    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 19:33:48.817891 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.817875    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 19:33:48.818259 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.818240    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 19:33:48.818259 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.818254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 19:33:48.818424 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.818402    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 19:33:48.818500 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.818454    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 19:33:48.818662 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.818647    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k7r6c\""
Jul 20 19:33:48.819058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.819042    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 19:33:48.819136 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.819065    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 19:33:48.819136 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.819086    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3cr8qcg5jlet1\""
Jul 20 19:33:48.819938 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.819911    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 19:33:48.820046 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.819957    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 19:33:48.820115 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.820059    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:33:48.821422 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.821392    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 19:33:48.826504 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.826485    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 19:33:48.834357 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.834334    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:48.953527 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953527 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953527 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953728    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhj6r\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-kube-api-access-zhj6r\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.953889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.953984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.954021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.954046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:48.954407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:48.954064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054511 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054511 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054511 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.054797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.054684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055483 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhj6r\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-kube-api-access-zhj6r\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055603 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055603 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055603 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055603 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.055841 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.056188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.056188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058032 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.057665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058032 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.057716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058032 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.057752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058032 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.057920    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058284 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.058051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058443 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.058421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058728 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.058701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058840 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.055403    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058840 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.058777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.058943 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.058886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.059369 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.059311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.059610 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.059586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.059921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.059898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.060198 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.060171    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.060266 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.060201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-config\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.060582 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.060562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.061041 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.061020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.061701 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.061683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.064548 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.064526    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhj6r\" (UniqueName: \"kubernetes.io/projected/ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd-kube-api-access-zhj6r\") pod \"prometheus-k8s-0\" (UID: \"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.124325 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.124272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:49.260027 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.259997    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 19:33:49.263376 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:33:49.263353    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8d917e_015a_4ea9_8ccf_ec4312ae6dbd.slice/crio-e52e3d915021406b841f1f6c3b09622e8b486d6aa887a58807f963ea61046951 WatchSource:0}: Error finding container e52e3d915021406b841f1f6c3b09622e8b486d6aa887a58807f963ea61046951: Status 404 returned error can't find the container with id e52e3d915021406b841f1f6c3b09622e8b486d6aa887a58807f963ea61046951
Jul 20 19:33:49.546456 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.546419    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0005952f-9470-45a1-9711-867e508578a1" path="/var/lib/kubelet/pods/0005952f-9470-45a1-9711-867e508578a1/volumes"
Jul 20 19:33:49.750508 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.750469    2571 generic.go:356] "Generic (PLEG): container finished" podID="ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd" containerID="0e4ce4e7bc10689afbef0f5bd64d28cee214fe01659d0b100e1115c86fd49123" exitCode=0
Jul 20 19:33:49.750644 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.750518    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerDied","Data":"0e4ce4e7bc10689afbef0f5bd64d28cee214fe01659d0b100e1115c86fd49123"}
Jul 20 19:33:49.750644 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:49.750586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"e52e3d915021406b841f1f6c3b09622e8b486d6aa887a58807f963ea61046951"}
Jul 20 19:33:50.761573 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761536    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"66de5b1c6c1d2722bedf3540eadc4e74680204173c45a2353131dcc323310637"}
Jul 20 19:33:50.762053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"5bf351e655c8da6cf9c8ccf8b662f8c9267af65b0669e96ef6d50eb09ecee80f"}
Jul 20 19:33:50.762053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"b78fcb19eaf45f49c222f79dba0bcc8821d5df3353c20a5689ffa67ba4edb2f6"}
Jul 20 19:33:50.762053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761671    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"a3d1e248ecf1083bb8feb0193394528188d6a773802c0336557b7ce4f72837ef"}
Jul 20 19:33:50.762053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761695    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"f31a5e5cb500263fd2cc59828b8fe8826695a53eb9c07cf380d76919c7e9febd"}
Jul 20 19:33:50.762053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.761717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd","Type":"ContainerStarted","Data":"94dc32a330cd14aa58f039d82b7c78309ce111e82a3b6a9b08c4a89ebe891b19"}
Jul 20 19:33:50.797821 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:50.797746    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.777993591 podStartE2EDuration="2.797730822s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.737231ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:50.79594083 +0000 UTC m=+372.898404180" watchObservedRunningTime="2026-07-20 19:33:50.797730822 +0000 UTC m=+372.900194169"
Jul 20 19:33:51.211086 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:51.210998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:51.264188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:51.264149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:53.091950 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.091908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:33:53.094247 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.094220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b88c176-52b1-4141-80b8-43b7d09f00fe-metrics-certs\") pod \"network-metrics-daemon-mk4ml\" (UID: \"6b88c176-52b1-4141-80b8-43b7d09f00fe\") " pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:33:53.246228 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.246201    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pw7wf\""
Jul 20 19:33:53.254371 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.254352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mk4ml"
Jul 20 19:33:53.372485 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.372407    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mk4ml"]
Jul 20 19:33:53.375572 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:33:53.375549    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b88c176_52b1_4141_80b8_43b7d09f00fe.slice/crio-c162358763f7d5cafddcfed30b8bf7fd3c502dc94a7121487edd6e24b3882d5b WatchSource:0}: Error finding container c162358763f7d5cafddcfed30b8bf7fd3c502dc94a7121487edd6e24b3882d5b: Status 404 returned error can't find the container with id c162358763f7d5cafddcfed30b8bf7fd3c502dc94a7121487edd6e24b3882d5b
Jul 20 19:33:53.377914 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.377896    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:33:53.773940 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:53.773905    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk4ml" event={"ID":"6b88c176-52b1-4141-80b8-43b7d09f00fe","Type":"ContainerStarted","Data":"c162358763f7d5cafddcfed30b8bf7fd3c502dc94a7121487edd6e24b3882d5b"}
Jul 20 19:33:54.124920 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.124827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:33:54.362044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.362019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:54.464186 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.464154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:54.561535 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.561502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:54.615331 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.615302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:54.780067 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.780037    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk4ml" event={"ID":"6b88c176-52b1-4141-80b8-43b7d09f00fe","Type":"ContainerStarted","Data":"79d1496ffb0010a5a1a608c4e4faaf3109aab3812c559c3cf863d70a424a6678"}
Jul 20 19:33:54.780241 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.780091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mk4ml" event={"ID":"6b88c176-52b1-4141-80b8-43b7d09f00fe","Type":"ContainerStarted","Data":"7c89b2831afee2d5befaaff671a25491dbf4cc3b6b0d68dada545bc3d06a6cfb"}
Jul 20 19:33:54.797089 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.797041    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mk4ml" podStartSLOduration=373.815881651 podStartE2EDuration="6m14.797021697s" totalImagesPullingTime="981.140046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:33:54.796503026 +0000 UTC m=+376.898966379" watchObservedRunningTime="2026-07-20 19:33:54.797021697 +0000 UTC m=+376.899485046"
Jul 20 19:33:54.885797 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.885765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:33:54.955915 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:33:54.955884    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:01.954896 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:01.954861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:05.390582 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:05.390538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:05.492240 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:05.492202    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:20.167091 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:20.167053    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:49.125040 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:49.125001    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:34:49.140249 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:49.140221    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:34:49.982681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:49.982657    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 19:34:53.109020 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:53.108972    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:34:53.198243 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:34:53.198207    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:14.830268 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:14.830231    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:15.817194 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:15.817158    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:18.475501 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:18.475466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:18.578431 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:18.578399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:19.958852 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:19.958819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:20.104973 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:20.104940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:20.760987 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:20.760955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:20.863381 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:20.863345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:22.770902 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:22.770870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:23.154406 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:23.154332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:25.508855 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:25.508822    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:25.663660 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:25.663624    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:29.054379 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:29.054344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:29.150501 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:29.150470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:29.346910 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:29.346828    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:29.451014 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:29.450978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:31.355217 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:31.355180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:32.292579 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:32.292548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:32.364206 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:32.364176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:35.377959 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:35.377931    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:35.477917 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:35.477885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:37.366814 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:37.366780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:49.456999 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:49.456956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:49.576652 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:49.576617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.084102 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.084054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.325339 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.325299    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.496864 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.496840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.518475 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.518449    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"]
Jul 20 19:35:50.521569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.521553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.524725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.524702    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 19:35:50.525059 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.525044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 19:35:50.525113 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.525081    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 19:35:50.525424 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.525405    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pg8q9\""
Jul 20 19:35:50.525498 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.525423    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 19:35:50.554327 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.554300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"]
Jul 20 19:35:50.557232 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.557207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-tmp\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.557370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.557248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.557370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.557326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-webhook-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.557484 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.557414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-manifests\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.557484 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.557447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jt5\" (UniqueName: \"kubernetes.io/projected/d8ccf39a-d936-4adc-84f8-d74f69396799-kube-api-access-f4jt5\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.641342 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.641307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.658096 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-manifests\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.658183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jt5\" (UniqueName: \"kubernetes.io/projected/d8ccf39a-d936-4adc-84f8-d74f69396799-kube-api-access-f4jt5\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.658183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-tmp\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.658183 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.658328 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-webhook-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.658517 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.658494    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-manifests\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.660394 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.660364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8ccf39a-d936-4adc-84f8-d74f69396799-tmp\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.660648 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.660630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-webhook-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.660712 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.660629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8ccf39a-d936-4adc-84f8-d74f69396799-apiservice-cert\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.667077 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.667052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jt5\" (UniqueName: \"kubernetes.io/projected/d8ccf39a-d936-4adc-84f8-d74f69396799-kube-api-access-f4jt5\") pod \"opendatahub-operator-controller-manager-859c78d9fd-vrrng\" (UID: \"d8ccf39a-d936-4adc-84f8-d74f69396799\") " pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.741937 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.741908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.831446 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.831352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:50.843319 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.843292    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.950548 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.950517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:50.965925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:50.965896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"]
Jul 20 19:35:50.969316 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:35:50.969284    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ccf39a_d936_4adc_84f8_d74f69396799.slice/crio-c420001307d5abe1f8510a3413cf950b2630c4bb45d14ed650ccdb5c7571ac2f WatchSource:0}: Error finding container c420001307d5abe1f8510a3413cf950b2630c4bb45d14ed650ccdb5c7571ac2f: Status 404 returned error can't find the container with id c420001307d5abe1f8510a3413cf950b2630c4bb45d14ed650ccdb5c7571ac2f
Jul 20 19:35:51.060530 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:51.060481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:51.165625 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:51.165541    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:51.180178 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:51.180152    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng" event={"ID":"d8ccf39a-d936-4adc-84f8-d74f69396799","Type":"ContainerStarted","Data":"c420001307d5abe1f8510a3413cf950b2630c4bb45d14ed650ccdb5c7571ac2f"}
Jul 20 19:35:54.193278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:54.193241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng" event={"ID":"d8ccf39a-d936-4adc-84f8-d74f69396799","Type":"ContainerStarted","Data":"89e952bce4ddb4027a30f8c88b73695ef993378f61d20273b5d07dc519603fee"}
Jul 20 19:35:55.198153 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:55.198117    2571 generic.go:356] "Generic (PLEG): container finished" podID="d8ccf39a-d936-4adc-84f8-d74f69396799" containerID="89e952bce4ddb4027a30f8c88b73695ef993378f61d20273b5d07dc519603fee" exitCode=0
Jul 20 19:35:55.198600 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:55.198211    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng" event={"ID":"d8ccf39a-d936-4adc-84f8-d74f69396799","Type":"ContainerDied","Data":"89e952bce4ddb4027a30f8c88b73695ef993378f61d20273b5d07dc519603fee"}
Jul 20 19:35:55.762436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:55.762344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:55.865133 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:55.865084    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:56.204377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:56.204288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng" event={"ID":"d8ccf39a-d936-4adc-84f8-d74f69396799","Type":"ContainerStarted","Data":"f7b5ee5d469573f184d0fb0d462fb7c6139110218bae207ed91646b7b4922803"}
Jul 20 19:35:56.204827 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:56.204411    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:35:56.229819 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:35:56.229751    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng" podStartSLOduration=1.816675517 podStartE2EDuration="6.229733052s" totalImagesPullingTime="3.401741583s" totalInitContainerRuntime="1.011315952s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:56.229254649 +0000 UTC m=+498.331717999" watchObservedRunningTime="2026-07-20 19:35:56.229733052 +0000 UTC m=+498.332196401"
Jul 20 19:36:07.209876 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:07.209846    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-859c78d9fd-vrrng"
Jul 20 19:36:09.288886 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:09.288853    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:09.452164 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:09.452126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:10.025546 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:10.025512    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:10.123779 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:10.123723    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:10.220134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:10.220103    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:10.619477 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:10.619446    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:10.725811 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:10.725775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:15.420087 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.420054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:15.672606 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.672523    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"]
Jul 20 19:36:15.679021 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.678999    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.683459 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.683437    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:36:15.683550 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.683445    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 19:36:15.684959 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.684915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-msvgk\""
Jul 20 19:36:15.685068 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.685001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:36:15.685496 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.685163    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 19:36:15.693468 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.693439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"]
Jul 20 19:36:15.722623 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.722587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:15.760013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.759981    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37703954-df9c-42b0-a5a4-862228ccfb47-tls-certs\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.760157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.760025    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k55l\" (UniqueName: \"kubernetes.io/projected/37703954-df9c-42b0-a5a4-862228ccfb47-kube-api-access-2k55l\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.760157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.760099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37703954-df9c-42b0-a5a4-862228ccfb47-tmp\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.861393 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.861360    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37703954-df9c-42b0-a5a4-862228ccfb47-tls-certs\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.861552 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.861407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k55l\" (UniqueName: \"kubernetes.io/projected/37703954-df9c-42b0-a5a4-862228ccfb47-kube-api-access-2k55l\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.861552 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.861446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37703954-df9c-42b0-a5a4-862228ccfb47-tmp\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.863786 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.863743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37703954-df9c-42b0-a5a4-862228ccfb47-tmp\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.864003 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.863984    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37703954-df9c-42b0-a5a4-862228ccfb47-tls-certs\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.870114 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.870090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k55l\" (UniqueName: \"kubernetes.io/projected/37703954-df9c-42b0-a5a4-862228ccfb47-kube-api-access-2k55l\") pod \"kube-auth-proxy-86d68bcf69-hmpsn\" (UID: \"37703954-df9c-42b0-a5a4-862228ccfb47\") " pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:15.988703 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:15.988670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"
Jul 20 19:36:16.131132 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.131101    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn"]
Jul 20 19:36:16.134727 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:36:16.134698    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37703954_df9c_42b0_a5a4_862228ccfb47.slice/crio-4fb39304cd0e919313595198d510204d376af94c9ea8c62982c4512cfe219f16 WatchSource:0}: Error finding container 4fb39304cd0e919313595198d510204d376af94c9ea8c62982c4512cfe219f16: Status 404 returned error can't find the container with id 4fb39304cd0e919313595198d510204d376af94c9ea8c62982c4512cfe219f16
Jul 20 19:36:16.278879 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.278786    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn" event={"ID":"37703954-df9c-42b0-a5a4-862228ccfb47","Type":"ContainerStarted","Data":"4fb39304cd0e919313595198d510204d376af94c9ea8c62982c4512cfe219f16"}
Jul 20 19:36:16.898104 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.898067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:16.964130 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.964092    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"]
Jul 20 19:36:16.966608 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.966581    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:16.970581 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xtkz7\""
Jul 20 19:36:16.970581 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:36:16.970771 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970636    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 19:36:16.970854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970838    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 19:36:16.970912 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970842    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 19:36:16.970912 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.970878    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 19:36:16.988283 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.988223    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"]
Jul 20 19:36:16.998026 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:16.997984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:17.071647 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.071616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-metrics-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.071845 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.071679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-manager-config\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.071845 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.071801    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpbw\" (UniqueName: \"kubernetes.io/projected/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-kube-api-access-4fpbw\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.072063 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.071844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.173351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.173245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-manager-config\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.173351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.173297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpbw\" (UniqueName: \"kubernetes.io/projected/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-kube-api-access-4fpbw\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.173351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.173324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.173699 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.173402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-metrics-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.174266 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.174224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-manager-config\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.176465 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.176419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.176652 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.176607    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-metrics-cert\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.189124 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.189104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpbw\" (UniqueName: \"kubernetes.io/projected/820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c-kube-api-access-4fpbw\") pod \"lws-controller-manager-65bc99bbc8-m8mbc\" (UID: \"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c\") " pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.279752 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.279713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:17.421745 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:17.421710    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"]
Jul 20 19:36:17.424664 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:36:17.424606    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820b4e3a_de7b_4d1c_b14d_a9eb11d8ba6c.slice/crio-d63acb423510e6e1856769b8af86f169affd3a44210a5efb41b40472c0cf954e WatchSource:0}: Error finding container d63acb423510e6e1856769b8af86f169affd3a44210a5efb41b40472c0cf954e: Status 404 returned error can't find the container with id d63acb423510e6e1856769b8af86f169affd3a44210a5efb41b40472c0cf954e
Jul 20 19:36:18.288740 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:18.288698    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc" event={"ID":"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c","Type":"ContainerStarted","Data":"d63acb423510e6e1856769b8af86f169affd3a44210a5efb41b40472c0cf954e"}
Jul 20 19:36:18.301854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:18.301797    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:19.294259 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:19.294219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn" event={"ID":"37703954-df9c-42b0-a5a4-862228ccfb47","Type":"ContainerStarted","Data":"55a5d1432ba27a8ff901352f85ddd113e39963df03a0871701cc0371cad7ae4a"}
Jul 20 19:36:19.346397 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:19.346341    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86d68bcf69-hmpsn" podStartSLOduration=1.791745927 podStartE2EDuration="4.346321769s" totalImagesPullingTime="2.554575842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:19.345469077 +0000 UTC m=+521.447932426" watchObservedRunningTime="2026-07-20 19:36:19.346321769 +0000 UTC m=+521.448785120"
Jul 20 19:36:19.966801 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:19.966688    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:20.118727 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:20.118628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:20.225058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:20.225029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:20.361224 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:20.361191    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:21.069654 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.069621    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:21.205058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.205021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:21.304567 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.304505    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc" event={"ID":"820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c","Type":"ContainerStarted","Data":"99475a5f3c678822df7a539d33b013788dcc529ac4c33853a65998394ca987c6"}
Jul 20 19:36:21.304745 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.304642    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:21.328240 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.328144    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc" podStartSLOduration=2.168658872 podStartE2EDuration="5.328128437s" totalImagesPullingTime="3.159469565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:21.326888193 +0000 UTC m=+523.429351545" watchObservedRunningTime="2026-07-20 19:36:21.328128437 +0000 UTC m=+523.430591786"
Jul 20 19:36:21.391168 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.391132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:21.491993 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.491955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:21.741751 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:21.741714    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:22.148955 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:22.148875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:22.456986 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:22.456906    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:22.554810 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:22.554774    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:32.310663 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:32.310581    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65bc99bbc8-m8mbc"
Jul 20 19:36:35.059503 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:35.059466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:36.901434 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:36.901399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:36.987790 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:36:36.987736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:10.736497 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:10.736449    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:10.838090 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:10.838057    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:10.979033 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:10.978998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:11.976555 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:11.976515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:12.052746 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:12.052706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:38.717684 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:38.717653    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:39.200341 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:39.200315    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:37:39.201485 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:39.201461    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:37:40.097900 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:40.097863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:43.399032 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:43.398998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:43.500692 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:43.500653    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:48.016129 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:48.016100    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:48.441196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:48.441103    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:49.846426 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:49.846394    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:51.415604 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:51.415567    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:52.257591 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:52.257557    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:52.599265 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:52.599169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:54.255921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:54.255889    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:55.722900 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:55.722861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:55.891961 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:55.891927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.314566 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:57.314534    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.675398 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:57.675307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:59.206912 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:59.206877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:59.306488 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:37:59.306454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:07.707027 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:07.706934    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:07.804270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:07.804226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:10.132729 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:10.132692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:10.231131 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:10.231094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:14.373895 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:14.373857    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:14.474209 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:14.474176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:16.613769 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:16.613720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:16.680907 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:16.680875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:25.277097 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:25.277059    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:25.381029 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:25.380997    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:25.477206 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:25.477176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:25.578575 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:25.578489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:27.843896 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:27.843852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:27.945031 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:27.945003    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:32.225423 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:32.225385    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:32.325382 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:32.325347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:35.213582 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:35.213543    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:35.295879 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:35.295843    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:45.003333 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:45.003299    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:45.067392 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:45.067365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:45.596541 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:45.596502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:45.655890 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:45.655829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:49.409774 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:49.409730    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:49.475553 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:49.475519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:52.622312 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:52.622278    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:53.182271 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:53.182236    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.520635 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.520599    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.531468 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.531439    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:38:55.534515 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.534497    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.537220 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.537192    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:38:55.537351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.537203    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 19:38:55.537351 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.537267    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5vdsb\""
Jul 20 19:38:55.538322 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.538304    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:38:55.548983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.548958    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:38:55.625749 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.625714    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:38:55.634592 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.634563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.673954 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.673921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.674131 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.673999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b8c\" (UniqueName: \"kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.691040 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.691008    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:55.775425 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.775345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.775425 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.775407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b8c\" (UniqueName: \"kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.776059 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.776033    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.782960 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.782931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b8c\" (UniqueName: \"kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c\") pod \"limitador-limitador-64c94fd64f-sqpmm\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.846167 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.846136    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:55.973343 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.973221    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:38:55.975488 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:38:55.975462    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bdfeee_9151_4792_98a3_e51af51a6ca2.slice/crio-08a749aa9b990dc3a6922ca4745a8a5808514cef2a60e1dccf0319ad0879d28b WatchSource:0}: Error finding container 08a749aa9b990dc3a6922ca4745a8a5808514cef2a60e1dccf0319ad0879d28b: Status 404 returned error can't find the container with id 08a749aa9b990dc3a6922ca4745a8a5808514cef2a60e1dccf0319ad0879d28b
Jul 20 19:38:55.977379 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:55.977363    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:38:56.368536 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.368501    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:56.469175 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.469142    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:56.547920 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.547888    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:38:56.552113 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.552096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:38:56.554553 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.554530    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c2qtj\""
Jul 20 19:38:56.557532 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.557511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:38:56.682246 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.682171    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zqd5\" (UniqueName: \"kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5\") pod \"authorino-75d556bd77-lrkjj\" (UID: \"7f03e130-f0e0-4cd7-adf0-6f92693fd925\") " pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:38:56.783800 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.783631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zqd5\" (UniqueName: \"kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5\") pod \"authorino-75d556bd77-lrkjj\" (UID: \"7f03e130-f0e0-4cd7-adf0-6f92693fd925\") " pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:38:56.792202 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.792087    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zqd5\" (UniqueName: \"kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5\") pod \"authorino-75d556bd77-lrkjj\" (UID: \"7f03e130-f0e0-4cd7-adf0-6f92693fd925\") " pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:38:56.856085 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.856042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" event={"ID":"36bdfeee-9151-4792-98a3-e51af51a6ca2","Type":"ContainerStarted","Data":"08a749aa9b990dc3a6922ca4745a8a5808514cef2a60e1dccf0319ad0879d28b"}
Jul 20 19:38:56.862256 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:56.862234    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:38:57.034202 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:57.034168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:38:57.040432 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:38:57.040375    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f03e130_f0e0_4cd7_adf0_6f92693fd925.slice/crio-088a8b3975c52d69baff6201bbeb6d8073638fd8c66afc52117521ae2f92c7c3 WatchSource:0}: Error finding container 088a8b3975c52d69baff6201bbeb6d8073638fd8c66afc52117521ae2f92c7c3: Status 404 returned error can't find the container with id 088a8b3975c52d69baff6201bbeb6d8073638fd8c66afc52117521ae2f92c7c3
Jul 20 19:38:57.862440 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:57.862396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lrkjj" event={"ID":"7f03e130-f0e0-4cd7-adf0-6f92693fd925","Type":"ContainerStarted","Data":"088a8b3975c52d69baff6201bbeb6d8073638fd8c66afc52117521ae2f92c7c3"}
Jul 20 19:38:59.872083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:59.872053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" event={"ID":"36bdfeee-9151-4792-98a3-e51af51a6ca2","Type":"ContainerStarted","Data":"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"}
Jul 20 19:38:59.872492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:59.872129    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:38:59.890016 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:38:59.889963    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" podStartSLOduration=2.007856686 podStartE2EDuration="4.889946359s" totalImagesPullingTime="2.882089673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:59.888923103 +0000 UTC m=+681.991386453" watchObservedRunningTime="2026-07-20 19:38:59.889946359 +0000 UTC m=+681.992409721"
Jul 20 19:39:00.877704 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:00.877659    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lrkjj" event={"ID":"7f03e130-f0e0-4cd7-adf0-6f92693fd925","Type":"ContainerStarted","Data":"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"}
Jul 20 19:39:00.894879 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:00.894831    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lrkjj" podStartSLOduration=1.216773421 podStartE2EDuration="4.894813866s" totalImagesPullingTime="3.678040445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:00.893182788 +0000 UTC m=+682.995646136" watchObservedRunningTime="2026-07-20 19:39:00.894813866 +0000 UTC m=+682.997277215"
Jul 20 19:39:10.797826 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:10.797784    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:39:10.798282 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:10.798074    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" podUID="36bdfeee-9151-4792-98a3-e51af51a6ca2" containerName="limitador" containerID="cri-o://ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9" gracePeriod=30
Jul 20 19:39:10.798792 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:10.798677    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:39:11.344300 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.344271    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:39:11.504378 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.504338    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file\") pod \"36bdfeee-9151-4792-98a3-e51af51a6ca2\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") "
Jul 20 19:39:11.504528 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.504412    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7b8c\" (UniqueName: \"kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c\") pod \"36bdfeee-9151-4792-98a3-e51af51a6ca2\" (UID: \"36bdfeee-9151-4792-98a3-e51af51a6ca2\") "
Jul 20 19:39:11.504749 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.504725    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file" (OuterVolumeSpecName: "config-file") pod "36bdfeee-9151-4792-98a3-e51af51a6ca2" (UID: "36bdfeee-9151-4792-98a3-e51af51a6ca2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:39:11.506572 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.506551    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c" (OuterVolumeSpecName: "kube-api-access-f7b8c") pod "36bdfeee-9151-4792-98a3-e51af51a6ca2" (UID: "36bdfeee-9151-4792-98a3-e51af51a6ca2"). InnerVolumeSpecName "kube-api-access-f7b8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:11.604947 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.604915    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/36bdfeee-9151-4792-98a3-e51af51a6ca2-config-file\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:39:11.604947 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.604946    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7b8c\" (UniqueName: \"kubernetes.io/projected/36bdfeee-9151-4792-98a3-e51af51a6ca2-kube-api-access-f7b8c\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:39:11.917549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.917463    2571 generic.go:356] "Generic (PLEG): container finished" podID="36bdfeee-9151-4792-98a3-e51af51a6ca2" containerID="ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9" exitCode=0
Jul 20 19:39:11.917549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.917510    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" event={"ID":"36bdfeee-9151-4792-98a3-e51af51a6ca2","Type":"ContainerDied","Data":"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"}
Jul 20 19:39:11.917549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.917521    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"
Jul 20 19:39:11.918083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.917574    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sqpmm" event={"ID":"36bdfeee-9151-4792-98a3-e51af51a6ca2","Type":"ContainerDied","Data":"08a749aa9b990dc3a6922ca4745a8a5808514cef2a60e1dccf0319ad0879d28b"}
Jul 20 19:39:11.918083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.917599    2571 scope.go:117] "RemoveContainer" containerID="ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"
Jul 20 19:39:11.925432 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.925415    2571 scope.go:117] "RemoveContainer" containerID="ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"
Jul 20 19:39:11.925686 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:39:11.925665    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9\": container with ID starting with ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9 not found: ID does not exist" containerID="ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"
Jul 20 19:39:11.925730 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.925694    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9"} err="failed to get container status \"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9\": rpc error: code = NotFound desc = could not find container \"ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9\": container with ID starting with ba26a5a6156ba5159212b636bcdb5b5d205c9dac47d93a0166b096b32dff68b9 not found: ID does not exist"
Jul 20 19:39:11.934051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.934030    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:39:11.942254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:11.942234    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sqpmm"]
Jul 20 19:39:13.546569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:13.546534    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bdfeee-9151-4792-98a3-e51af51a6ca2" path="/var/lib/kubelet/pods/36bdfeee-9151-4792-98a3-e51af51a6ca2/volumes"
Jul 20 19:39:16.039027 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.038989    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:16.137075 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.137042    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:16.493552 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.493521    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"]
Jul 20 19:39:16.493889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.493873    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bdfeee-9151-4792-98a3-e51af51a6ca2" containerName="limitador"
Jul 20 19:39:16.493979 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.493891    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bdfeee-9151-4792-98a3-e51af51a6ca2" containerName="limitador"
Jul 20 19:39:16.493979 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.493967    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bdfeee-9151-4792-98a3-e51af51a6ca2" containerName="limitador"
Jul 20 19:39:16.498227 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.498208    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.500905 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.500876    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:39:16.501014 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.500990    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 19:39:16.501072 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.500989    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:39:16.502342 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.502325    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6b6w9\""
Jul 20 19:39:16.504575 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.504557    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"]
Jul 20 19:39:16.524105 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.524082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:16.647263 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.647230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9m7z\" (UniqueName: \"kubernetes.io/projected/8fed3257-1586-4eb5-b65f-b67a19866894-kube-api-access-b9m7z\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.647415 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.647295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fed3257-1586-4eb5-b65f-b67a19866894-data\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.748609 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.748533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9m7z\" (UniqueName: \"kubernetes.io/projected/8fed3257-1586-4eb5-b65f-b67a19866894-kube-api-access-b9m7z\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.748609 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.748598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fed3257-1586-4eb5-b65f-b67a19866894-data\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.748984 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.748968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fed3257-1586-4eb5-b65f-b67a19866894-data\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.757126 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.757105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9m7z\" (UniqueName: \"kubernetes.io/projected/8fed3257-1586-4eb5-b65f-b67a19866894-kube-api-access-b9m7z\") pod \"postgres-69fb4594cf-h56d4\" (UID: \"8fed3257-1586-4eb5-b65f-b67a19866894\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.808901 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.808876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:16.938319 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:16.938291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"]
Jul 20 19:39:16.941567 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:39:16.941538    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fed3257_1586_4eb5_b65f_b67a19866894.slice/crio-c83db24dd5810977f96737509d4a6199bcd1d96f7c4dbebe4d9da37184ef8f76 WatchSource:0}: Error finding container c83db24dd5810977f96737509d4a6199bcd1d96f7c4dbebe4d9da37184ef8f76: Status 404 returned error can't find the container with id c83db24dd5810977f96737509d4a6199bcd1d96f7c4dbebe4d9da37184ef8f76
Jul 20 19:39:17.943321 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:17.943284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4" event={"ID":"8fed3257-1586-4eb5-b65f-b67a19866894","Type":"ContainerStarted","Data":"c83db24dd5810977f96737509d4a6199bcd1d96f7c4dbebe4d9da37184ef8f76"}
Jul 20 19:39:21.960050 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:21.960018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4" event={"ID":"8fed3257-1586-4eb5-b65f-b67a19866894","Type":"ContainerStarted","Data":"94122a3a19d25bc4042e3c0b6048d9c0e3eeeed4bf01029cc250af37ffc64b83"}
Jul 20 19:39:21.960415 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:21.960142    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:21.976908 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:21.976874    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:21.977285 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:21.977242    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4" podStartSLOduration=1.087568304 podStartE2EDuration="5.977227734s" totalImagesPullingTime="4.88965943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:21.975601741 +0000 UTC m=+704.078065091" watchObservedRunningTime="2026-07-20 19:39:21.977227734 +0000 UTC m=+704.079691083"
Jul 20 19:39:22.075525 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:22.075489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:27.993863 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:27.993832    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h56d4"
Jul 20 19:39:28.308650 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.308560    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:28.505837 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.505803    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:28.526083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.526049    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:28.532086 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.532068    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:28.534443 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.534423    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:28.637381 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.637263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hks55\" (UniqueName: \"kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55\") pod \"authorino-5d4b67c446-wpsw6\" (UID: \"e40fae00-52d4-4df8-9858-47b7247bbede\") " pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:28.738178 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.738141    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hks55\" (UniqueName: \"kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55\") pod \"authorino-5d4b67c446-wpsw6\" (UID: \"e40fae00-52d4-4df8-9858-47b7247bbede\") " pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:28.752034 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.752004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hks55\" (UniqueName: \"kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55\") pod \"authorino-5d4b67c446-wpsw6\" (UID: \"e40fae00-52d4-4df8-9858-47b7247bbede\") " pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:28.763094 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.763064    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:28.763309 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.763298    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:28.790699 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.790671    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-577d775566-h97wz"]
Jul 20 19:39:28.794506 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.794488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:28.801365 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.801334    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577d775566-h97wz"]
Jul 20 19:39:28.839407 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.839364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvc8\" (UniqueName: \"kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8\") pod \"authorino-577d775566-h97wz\" (UID: \"3865f029-88a8-4b5b-8bc1-a24adc18ad57\") " pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:28.848833 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.848805    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577d775566-h97wz"]
Jul 20 19:39:28.849065 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:39:28.849044    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cfvc8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-577d775566-h97wz" podUID="3865f029-88a8-4b5b-8bc1-a24adc18ad57"
Jul 20 19:39:28.874491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.874456    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:39:28.878548 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.878526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:28.881402 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.881382    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 19:39:28.886374 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.886179    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:39:28.901436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.901364    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:28.904647 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:39:28.904622    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode40fae00_52d4_4df8_9858_47b7247bbede.slice/crio-917e70a0b7e9cd121cb9398f204e906b7718a4d5cc443967c2e689868e2b8f9c WatchSource:0}: Error finding container 917e70a0b7e9cd121cb9398f204e906b7718a4d5cc443967c2e689868e2b8f9c: Status 404 returned error can't find the container with id 917e70a0b7e9cd121cb9398f204e906b7718a4d5cc443967c2e689868e2b8f9c
Jul 20 19:39:28.940303 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.940274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvc8\" (UniqueName: \"kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8\") pod \"authorino-577d775566-h97wz\" (UID: \"3865f029-88a8-4b5b-8bc1-a24adc18ad57\") " pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:28.940444 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.940308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:28.940444 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.940376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fd69\" (UniqueName: \"kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:28.948881 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.948856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvc8\" (UniqueName: \"kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8\") pod \"authorino-577d775566-h97wz\" (UID: \"3865f029-88a8-4b5b-8bc1-a24adc18ad57\") " pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:28.988004 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.987975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:28.988004 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.987994    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" event={"ID":"e40fae00-52d4-4df8-9858-47b7247bbede","Type":"ContainerStarted","Data":"917e70a0b7e9cd121cb9398f204e906b7718a4d5cc443967c2e689868e2b8f9c"}
Jul 20 19:39:28.995381 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:28.995356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:29.040929 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.040895    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfvc8\" (UniqueName: \"kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8\") pod \"3865f029-88a8-4b5b-8bc1-a24adc18ad57\" (UID: \"3865f029-88a8-4b5b-8bc1-a24adc18ad57\") "
Jul 20 19:39:29.041068 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.041033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:29.041140 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.041083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fd69\" (UniqueName: \"kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:29.042957 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.042931    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8" (OuterVolumeSpecName: "kube-api-access-cfvc8") pod "3865f029-88a8-4b5b-8bc1-a24adc18ad57" (UID: "3865f029-88a8-4b5b-8bc1-a24adc18ad57"). InnerVolumeSpecName "kube-api-access-cfvc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:29.043392 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.043371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:29.048941 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.048919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fd69\" (UniqueName: \"kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69\") pod \"authorino-79bf655dcd-bzj6m\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") " pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:29.141770 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.141734    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfvc8\" (UniqueName: \"kubernetes.io/projected/3865f029-88a8-4b5b-8bc1-a24adc18ad57-kube-api-access-cfvc8\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:39:29.188932 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.188862    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:39:29.319379 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.319254    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:39:29.322404 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:39:29.322365    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74756d91_637a_4606_a30c_bdc94b4aed03.slice/crio-f5b1674c14817b355f31cddbd64035b792e8ebf0c587ee631d2d8189d7dc8377 WatchSource:0}: Error finding container f5b1674c14817b355f31cddbd64035b792e8ebf0c587ee631d2d8189d7dc8377: Status 404 returned error can't find the container with id f5b1674c14817b355f31cddbd64035b792e8ebf0c587ee631d2d8189d7dc8377
Jul 20 19:39:29.993533 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.993497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" event={"ID":"74756d91-637a-4606-a30c-bdc94b4aed03","Type":"ContainerStarted","Data":"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"}
Jul 20 19:39:29.993533 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.993537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" event={"ID":"74756d91-637a-4606-a30c-bdc94b4aed03","Type":"ContainerStarted","Data":"f5b1674c14817b355f31cddbd64035b792e8ebf0c587ee631d2d8189d7dc8377"}
Jul 20 19:39:29.995009 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.994987    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577d775566-h97wz"
Jul 20 19:39:29.995009 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.994993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" event={"ID":"e40fae00-52d4-4df8-9858-47b7247bbede","Type":"ContainerStarted","Data":"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"}
Jul 20 19:39:29.995206 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:29.995189    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" podUID="e40fae00-52d4-4df8-9858-47b7247bbede" containerName="authorino" containerID="cri-o://0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15" gracePeriod=30
Jul 20 19:39:30.009410 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.009369    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" podStartSLOduration=1.687182091 podStartE2EDuration="2.009355583s" totalImagesPullingTime="322.173492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:30.009046449 +0000 UTC m=+712.111509797" watchObservedRunningTime="2026-07-20 19:39:30.009355583 +0000 UTC m=+712.111818933"
Jul 20 19:39:30.024117 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.024072    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" podStartSLOduration=1.707971645 podStartE2EDuration="2.024057081s" totalImagesPullingTime="316.085436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:30.022119177 +0000 UTC m=+712.124582528" watchObservedRunningTime="2026-07-20 19:39:30.024057081 +0000 UTC m=+712.126520430"
Jul 20 19:39:30.038733 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.038705    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:39:30.038920 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.038899    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lrkjj" podUID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" containerName="authorino" containerID="cri-o://2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc" gracePeriod=30
Jul 20 19:39:30.054917 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.054885    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577d775566-h97wz"]
Jul 20 19:39:30.057511 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.057488    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-577d775566-h97wz"]
Jul 20 19:39:30.270968 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.270946    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:30.295085 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.295054    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:39:30.352556 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.352523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zqd5\" (UniqueName: \"kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5\") pod \"7f03e130-f0e0-4cd7-adf0-6f92693fd925\" (UID: \"7f03e130-f0e0-4cd7-adf0-6f92693fd925\") "
Jul 20 19:39:30.352556 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.352557    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hks55\" (UniqueName: \"kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55\") pod \"e40fae00-52d4-4df8-9858-47b7247bbede\" (UID: \"e40fae00-52d4-4df8-9858-47b7247bbede\") "
Jul 20 19:39:30.354581 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.354555    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55" (OuterVolumeSpecName: "kube-api-access-hks55") pod "e40fae00-52d4-4df8-9858-47b7247bbede" (UID: "e40fae00-52d4-4df8-9858-47b7247bbede"). InnerVolumeSpecName "kube-api-access-hks55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:30.354667 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.354580    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5" (OuterVolumeSpecName: "kube-api-access-7zqd5") pod "7f03e130-f0e0-4cd7-adf0-6f92693fd925" (UID: "7f03e130-f0e0-4cd7-adf0-6f92693fd925"). InnerVolumeSpecName "kube-api-access-7zqd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:30.453265 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.453224    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zqd5\" (UniqueName: \"kubernetes.io/projected/7f03e130-f0e0-4cd7-adf0-6f92693fd925-kube-api-access-7zqd5\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:39:30.453265 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:30.453263    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hks55\" (UniqueName: \"kubernetes.io/projected/e40fae00-52d4-4df8-9858-47b7247bbede-kube-api-access-hks55\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:39:31.000451 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.000419    2571 generic.go:356] "Generic (PLEG): container finished" podID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" containerID="2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc" exitCode=0
Jul 20 19:39:31.000655 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.000459    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lrkjj"
Jul 20 19:39:31.000655 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.000497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lrkjj" event={"ID":"7f03e130-f0e0-4cd7-adf0-6f92693fd925","Type":"ContainerDied","Data":"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"}
Jul 20 19:39:31.000655 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.000535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lrkjj" event={"ID":"7f03e130-f0e0-4cd7-adf0-6f92693fd925","Type":"ContainerDied","Data":"088a8b3975c52d69baff6201bbeb6d8073638fd8c66afc52117521ae2f92c7c3"}
Jul 20 19:39:31.000655 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.000554    2571 scope.go:117] "RemoveContainer" containerID="2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"
Jul 20 19:39:31.001892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.001774    2571 generic.go:356] "Generic (PLEG): container finished" podID="e40fae00-52d4-4df8-9858-47b7247bbede" containerID="0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15" exitCode=0
Jul 20 19:39:31.001892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.001802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" event={"ID":"e40fae00-52d4-4df8-9858-47b7247bbede","Type":"ContainerDied","Data":"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"}
Jul 20 19:39:31.001892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.001818    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wpsw6"
Jul 20 19:39:31.001892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.001844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-wpsw6" event={"ID":"e40fae00-52d4-4df8-9858-47b7247bbede","Type":"ContainerDied","Data":"917e70a0b7e9cd121cb9398f204e906b7718a4d5cc443967c2e689868e2b8f9c"}
Jul 20 19:39:31.009897 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.009880    2571 scope.go:117] "RemoveContainer" containerID="2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"
Jul 20 19:39:31.010206 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:39:31.010186    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc\": container with ID starting with 2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc not found: ID does not exist" containerID="2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"
Jul 20 19:39:31.010249 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.010221    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc"} err="failed to get container status \"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc\": rpc error: code = NotFound desc = could not find container \"2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc\": container with ID starting with 2d3a2e901cb9cc5cfd93ee57ec33bde87f551346bec811e9268de8f044dc78dc not found: ID does not exist"
Jul 20 19:39:31.010286 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.010245    2571 scope.go:117] "RemoveContainer" containerID="0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"
Jul 20 19:39:31.017985 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.017968    2571 scope.go:117] "RemoveContainer" containerID="0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"
Jul 20 19:39:31.018248 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:39:31.018231    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15\": container with ID starting with 0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15 not found: ID does not exist" containerID="0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"
Jul 20 19:39:31.018311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.018260    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15"} err="failed to get container status \"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15\": rpc error: code = NotFound desc = could not find container \"0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15\": container with ID starting with 0a60a2fd3dad99bff18b60e18a8c5bce795b650be4263de14085aae584a01e15 not found: ID does not exist"
Jul 20 19:39:31.025983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.025958    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:39:31.030320 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.030298    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lrkjj"]
Jul 20 19:39:31.041543 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.041517    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:31.045284 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.045259    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wpsw6"]
Jul 20 19:39:31.546835 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.546790    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3865f029-88a8-4b5b-8bc1-a24adc18ad57" path="/var/lib/kubelet/pods/3865f029-88a8-4b5b-8bc1-a24adc18ad57/volumes"
Jul 20 19:39:31.547223 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.547202    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" path="/var/lib/kubelet/pods/7f03e130-f0e0-4cd7-adf0-6f92693fd925/volumes"
Jul 20 19:39:31.547997 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:31.547983    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40fae00-52d4-4df8-9858-47b7247bbede" path="/var/lib/kubelet/pods/e40fae00-52d4-4df8-9858-47b7247bbede/volumes"
Jul 20 19:39:34.874016 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:34.873968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:34.973896 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:34.973865    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.060793 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.060743    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:39:35.061109 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061092    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40fae00-52d4-4df8-9858-47b7247bbede" containerName="authorino"
Jul 20 19:39:35.061188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061112    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40fae00-52d4-4df8-9858-47b7247bbede" containerName="authorino"
Jul 20 19:39:35.061188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061126    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" containerName="authorino"
Jul 20 19:39:35.061188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061134    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" containerName="authorino"
Jul 20 19:39:35.061332 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061212    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40fae00-52d4-4df8-9858-47b7247bbede" containerName="authorino"
Jul 20 19:39:35.061332 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.061224    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f03e130-f0e0-4cd7-adf0-6f92693fd925" containerName="authorino"
Jul 20 19:39:35.065079 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.065056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.127054 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.126973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:35.214013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.213980    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:39:35.214177 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.214096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.218114 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.218089    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7grfb\""
Jul 20 19:39:35.218253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.218094    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:39:35.218253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.218147    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:39:35.291921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.291893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.292070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.291960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7nb\" (UniqueName: \"kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.392914 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.392832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7nb\" (UniqueName: \"kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.392914 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.392885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.395539 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.395517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.401188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.401156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7nb\" (UniqueName: \"kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb\") pod \"maas-controller-6bb4b6b8f9-47xsw\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") " pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.523802 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.523745    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:35.685354 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:35.685274    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:39:35.688315 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:39:35.688285    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a73073_b948_476e_8274_97547b9d6a04.slice/crio-c72b3b08ac936250a24cfcfd8ac7af606a1aa596c1d563248a81b69ab3468780 WatchSource:0}: Error finding container c72b3b08ac936250a24cfcfd8ac7af606a1aa596c1d563248a81b69ab3468780: Status 404 returned error can't find the container with id c72b3b08ac936250a24cfcfd8ac7af606a1aa596c1d563248a81b69ab3468780
Jul 20 19:39:36.027250 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:36.027217    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" event={"ID":"35a73073-b948-476e-8274-97547b9d6a04","Type":"ContainerStarted","Data":"c72b3b08ac936250a24cfcfd8ac7af606a1aa596c1d563248a81b69ab3468780"}
Jul 20 19:39:37.664848 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:37.664796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:37.763373 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:37.763334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:39:39.041631 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:39.041590    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" event={"ID":"35a73073-b948-476e-8274-97547b9d6a04","Type":"ContainerStarted","Data":"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"}
Jul 20 19:39:39.042028 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:39.041739    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:39:39.061166 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:39.061110    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" podStartSLOduration=1.7419803759999999 podStartE2EDuration="4.061094412s" totalImagesPullingTime="2.319114036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:39.061054646 +0000 UTC m=+721.163517998" watchObservedRunningTime="2026-07-20 19:39:39.061094412 +0000 UTC m=+721.163557761"
Jul 20 19:39:50.048197 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:39:50.048159    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:40:12.879204 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:12.879146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:12.974145 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:12.974100    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:13.503288 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.503254    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:13.583010 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.582975    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"]
Jul 20 19:40:13.587550 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.587527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.591409 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.591389    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k9jm8\""
Jul 20 19:40:13.591542 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.591389    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 19:40:13.605951 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.605925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"]
Jul 20 19:40:13.617270 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.617239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:13.724399 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.724361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/027c0abd-5945-49b6-9d86-8df8059aeb9b-maas-api-tls\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.724590 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.724429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5c9n\" (UniqueName: \"kubernetes.io/projected/027c0abd-5945-49b6-9d86-8df8059aeb9b-kube-api-access-h5c9n\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.724590 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.724495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/027c0abd-5945-49b6-9d86-8df8059aeb9b-openshift-service-ca\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.825672 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.825592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/027c0abd-5945-49b6-9d86-8df8059aeb9b-maas-api-tls\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.825672 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.825644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5c9n\" (UniqueName: \"kubernetes.io/projected/027c0abd-5945-49b6-9d86-8df8059aeb9b-kube-api-access-h5c9n\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.825672 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.825674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/027c0abd-5945-49b6-9d86-8df8059aeb9b-openshift-service-ca\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.826413 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.826380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/027c0abd-5945-49b6-9d86-8df8059aeb9b-openshift-service-ca\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.828133 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.828114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/027c0abd-5945-49b6-9d86-8df8059aeb9b-maas-api-tls\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.836749 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.836725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5c9n\" (UniqueName: \"kubernetes.io/projected/027c0abd-5945-49b6-9d86-8df8059aeb9b-kube-api-access-h5c9n\") pod \"maas-api-6b6fc7cbf7-rz4wb\" (UID: \"027c0abd-5945-49b6-9d86-8df8059aeb9b\") " pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:13.897471 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:13.897435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:14.045674 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.045649    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"]
Jul 20 19:40:14.048218 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:40:14.048183    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027c0abd_5945_49b6_9d86_8df8059aeb9b.slice/crio-3ede9e09d2f7f5a4f3ab1cfed2464cc716b6474ff7f1e059725b976fd6e60da1 WatchSource:0}: Error finding container 3ede9e09d2f7f5a4f3ab1cfed2464cc716b6474ff7f1e059725b976fd6e60da1: Status 404 returned error can't find the container with id 3ede9e09d2f7f5a4f3ab1cfed2464cc716b6474ff7f1e059725b976fd6e60da1
Jul 20 19:40:14.110788 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.110675    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:14.175334 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.175298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb" event={"ID":"027c0abd-5945-49b6-9d86-8df8059aeb9b","Type":"ContainerStarted","Data":"3ede9e09d2f7f5a4f3ab1cfed2464cc716b6474ff7f1e059725b976fd6e60da1"}
Jul 20 19:40:14.197269 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.197240    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:14.208376 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.208346    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gg799"]
Jul 20 19:40:14.211401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.211382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.213906 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.213873    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 19:40:14.220433 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.220396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gg799"]
Jul 20 19:40:14.330495 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.330449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttlch\" (UniqueName: \"kubernetes.io/projected/078ecba6-afcb-4c42-85ec-df8fe862d064-kube-api-access-ttlch\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.330681 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.330508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/078ecba6-afcb-4c42-85ec-df8fe862d064-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.431617 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.431530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttlch\" (UniqueName: \"kubernetes.io/projected/078ecba6-afcb-4c42-85ec-df8fe862d064-kube-api-access-ttlch\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.431617 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.431578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/078ecba6-afcb-4c42-85ec-df8fe862d064-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.432377 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.432352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/078ecba6-afcb-4c42-85ec-df8fe862d064-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.439847 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.439824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttlch\" (UniqueName: \"kubernetes.io/projected/078ecba6-afcb-4c42-85ec-df8fe862d064-kube-api-access-ttlch\") pod \"payload-pre-processing-7677b774bb-gg799\" (UID: \"078ecba6-afcb-4c42-85ec-df8fe862d064\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.523682 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.523643    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:14.653457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:14.653426    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-gg799"]
Jul 20 19:40:14.656335 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:40:14.656308    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078ecba6_afcb_4c42_85ec_df8fe862d064.slice/crio-e48784ad7944d777e1f447aef89d83f708ffb7b77952af719e9a963d45a95bc0 WatchSource:0}: Error finding container e48784ad7944d777e1f447aef89d83f708ffb7b77952af719e9a963d45a95bc0: Status 404 returned error can't find the container with id e48784ad7944d777e1f447aef89d83f708ffb7b77952af719e9a963d45a95bc0
Jul 20 19:40:15.181360 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:15.181308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799" event={"ID":"078ecba6-afcb-4c42-85ec-df8fe862d064","Type":"ContainerStarted","Data":"e48784ad7944d777e1f447aef89d83f708ffb7b77952af719e9a963d45a95bc0"}
Jul 20 19:40:16.187661 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:16.187621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb" event={"ID":"027c0abd-5945-49b6-9d86-8df8059aeb9b","Type":"ContainerStarted","Data":"8dd4b346e1ef6a20a10d9758778b7001a056d2559594f571642d6fc1d6bac0ab"}
Jul 20 19:40:16.188110 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:16.187787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:16.206219 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:16.206170    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb" podStartSLOduration=1.5814459859999999 podStartE2EDuration="3.206153675s" totalImagesPullingTime="1.624707689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:40:16.204473181 +0000 UTC m=+758.306936533" watchObservedRunningTime="2026-07-20 19:40:16.206153675 +0000 UTC m=+758.308617023"
Jul 20 19:40:17.193849 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:17.193741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799" event={"ID":"078ecba6-afcb-4c42-85ec-df8fe862d064","Type":"ContainerStarted","Data":"c72427d1e1ad93dd791970ed289fdfe896923ef04fb6fbff3bb87114d052ecf3"}
Jul 20 19:40:17.193849 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:17.193846    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:17.212569 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:17.212518    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799" podStartSLOduration=0.927445577 podStartE2EDuration="3.212500943s" totalImagesPullingTime="2.285055366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:40:17.211306403 +0000 UTC m=+759.313769751" watchObservedRunningTime="2026-07-20 19:40:17.212500943 +0000 UTC m=+759.314964292"
Jul 20 19:40:22.199201 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:22.199173    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b6fc7cbf7-rz4wb"
Jul 20 19:40:23.176460 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:23.176418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:23.252661 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:23.252630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:28.200863 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:28.200828    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-gg799"
Jul 20 19:40:29.060472 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:29.060430    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:30.893707 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.893675    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"]
Jul 20 19:40:30.896376 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.896353    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.899327 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.899306    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 19:40:30.900526 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.900506    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bjz7v\""
Jul 20 19:40:30.900636 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.900555    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 19:40:30.900636 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.900568    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 19:40:30.906806 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.906786    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"]
Jul 20 19:40:30.927042 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.927013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:30.950585 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.950714 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.950714 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.950714 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csm4s\" (UniqueName: \"kubernetes.io/projected/4ede7652-e95b-4d06-a9bd-bec7cf73501c-kube-api-access-csm4s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.950892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:30.950892 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:30.950787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051534 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051534 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051608    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.051778 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csm4s\" (UniqueName: \"kubernetes.io/projected/4ede7652-e95b-4d06-a9bd-bec7cf73501c-kube-api-access-csm4s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.052000 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.051976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.052047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.052017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.052047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.052032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.054035 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.054008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ede7652-e95b-4d06-a9bd-bec7cf73501c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.054286 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.054270    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ede7652-e95b-4d06-a9bd-bec7cf73501c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.060724 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.060702    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csm4s\" (UniqueName: \"kubernetes.io/projected/4ede7652-e95b-4d06-a9bd-bec7cf73501c-kube-api-access-csm4s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8\" (UID: \"4ede7652-e95b-4d06-a9bd-bec7cf73501c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.206236 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.206153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:31.336126 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:31.336024    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"]
Jul 20 19:40:31.338936 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:40:31.338906    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ede7652_e95b_4d06_a9bd_bec7cf73501c.slice/crio-982f8967920060f3949ce9fe3fd169f3b89c84c552d796f0ee32be06ebb378ac WatchSource:0}: Error finding container 982f8967920060f3949ce9fe3fd169f3b89c84c552d796f0ee32be06ebb378ac: Status 404 returned error can't find the container with id 982f8967920060f3949ce9fe3fd169f3b89c84c552d796f0ee32be06ebb378ac
Jul 20 19:40:32.265694 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:32.265656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8" event={"ID":"4ede7652-e95b-4d06-a9bd-bec7cf73501c","Type":"ContainerStarted","Data":"982f8967920060f3949ce9fe3fd169f3b89c84c552d796f0ee32be06ebb378ac"}
Jul 20 19:40:33.271132 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:33.271090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8" event={"ID":"4ede7652-e95b-4d06-a9bd-bec7cf73501c","Type":"ContainerStarted","Data":"67e6c2c667ed48ddcb2844996ea4dee759e062f60d4f2be40250f92825e3e194"}
Jul 20 19:40:33.290399 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:33.290352    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8" podStartSLOduration=2.124258158 podStartE2EDuration="3.290335264s" totalImagesPullingTime="1.166077106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:40:33.288718317 +0000 UTC m=+775.391181665" watchObservedRunningTime="2026-07-20 19:40:33.290335264 +0000 UTC m=+775.392798613"
Jul 20 19:40:41.206960 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:41.206922    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:41.207410 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:41.206999    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:41.219212 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:41.219189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:41.314523 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:41.314488    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8"
Jul 20 19:40:42.016932 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:42.016902    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:45.991411 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:45.991378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:51.991052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:51.991016    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:52.056186 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:52.056152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:40:59.504070 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:40:59.504035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:41:07.620120 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:07.620083    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:41:21.379808 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:21.379773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:41:48.585090 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.585057    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"]
Jul 20 19:41:48.587401 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.587373    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.590206 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.590182    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 19:41:48.597188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.597167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"]
Jul 20 19:41:48.616085 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.616057    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:41:48.714327 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c1363e-167b-4232-822c-cf051fc0b2d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.714491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.714491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714418    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.714491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.714491 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.714618 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.714503    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkgd\" (UniqueName: \"kubernetes.io/projected/15c1363e-167b-4232-822c-cf051fc0b2d6-kube-api-access-krkgd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krkgd\" (UniqueName: \"kubernetes.io/projected/15c1363e-167b-4232-822c-cf051fc0b2d6-kube-api-access-krkgd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c1363e-167b-4232-822c-cf051fc0b2d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815470    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815547 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815936 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.815936 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.816069 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.815963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.817742 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.817714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c1363e-167b-4232-822c-cf051fc0b2d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.818052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.818031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c1363e-167b-4232-822c-cf051fc0b2d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.823414 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.823389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkgd\" (UniqueName: \"kubernetes.io/projected/15c1363e-167b-4232-822c-cf051fc0b2d6-kube-api-access-krkgd\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd\" (UID: \"15c1363e-167b-4232-822c-cf051fc0b2d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:48.897453 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:48.897364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:49.028921 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:49.028891    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"]
Jul 20 19:41:49.031667 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:41:49.031634    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15c1363e_167b_4232_822c_cf051fc0b2d6.slice/crio-161f1782dcfcb4cbf3cbfa49bf7d3a3cd115dceeb2d8874cdd376a2bc39fa431 WatchSource:0}: Error finding container 161f1782dcfcb4cbf3cbfa49bf7d3a3cd115dceeb2d8874cdd376a2bc39fa431: Status 404 returned error can't find the container with id 161f1782dcfcb4cbf3cbfa49bf7d3a3cd115dceeb2d8874cdd376a2bc39fa431
Jul 20 19:41:49.578549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:49.578515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd" event={"ID":"15c1363e-167b-4232-822c-cf051fc0b2d6","Type":"ContainerStarted","Data":"03fe87d5cf999e6c885b7f3c734c2684dcd707d0a7221cad77e78a18613ab793"}
Jul 20 19:41:49.578549 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:49.578557    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd" event={"ID":"15c1363e-167b-4232-822c-cf051fc0b2d6","Type":"ContainerStarted","Data":"161f1782dcfcb4cbf3cbfa49bf7d3a3cd115dceeb2d8874cdd376a2bc39fa431"}
Jul 20 19:41:49.595846 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:49.595792    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd" podStartSLOduration=1.4207559650000001 podStartE2EDuration="1.59577658s" totalImagesPullingTime="175.020615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:41:49.595268213 +0000 UTC m=+851.697731562" watchObservedRunningTime="2026-07-20 19:41:49.59577658 +0000 UTC m=+851.698239919"
Jul 20 19:41:58.897752 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:58.897709    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:58.898248 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:58.897787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:58.910641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:58.910608    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:41:59.629179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:41:59.629151    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd"
Jul 20 19:42:29.135854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:42:29.135813    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:39.228244 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:42:39.228206    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:42:39.229443 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:42:39.229419    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:43:07.654279 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.654237    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:43:07.656643 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.654461    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" podUID="74756d91-637a-4606-a30c-bdc94b4aed03" containerName="authorino" containerID="cri-o://a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820" gracePeriod=30
Jul 20 19:43:07.897826 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.897800    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:43:07.900084 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.900050    2571 generic.go:356] "Generic (PLEG): container finished" podID="74756d91-637a-4606-a30c-bdc94b4aed03" containerID="a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820" exitCode=0
Jul 20 19:43:07.900196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.900088    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79bf655dcd-bzj6m"
Jul 20 19:43:07.900196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.900088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" event={"ID":"74756d91-637a-4606-a30c-bdc94b4aed03","Type":"ContainerDied","Data":"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"}
Jul 20 19:43:07.900196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.900137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79bf655dcd-bzj6m" event={"ID":"74756d91-637a-4606-a30c-bdc94b4aed03","Type":"ContainerDied","Data":"f5b1674c14817b355f31cddbd64035b792e8ebf0c587ee631d2d8189d7dc8377"}
Jul 20 19:43:07.900196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.900157    2571 scope.go:117] "RemoveContainer" containerID="a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"
Jul 20 19:43:07.909822 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.909802    2571 scope.go:117] "RemoveContainer" containerID="a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"
Jul 20 19:43:07.910208 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:43:07.910189    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820\": container with ID starting with a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820 not found: ID does not exist" containerID="a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"
Jul 20 19:43:07.910279 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.910217    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820"} err="failed to get container status \"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820\": rpc error: code = NotFound desc = could not find container \"a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820\": container with ID starting with a5cc5dc5e0b91faed64bbfe51814364441602383c034d8f920b8b3c79f73a820 not found: ID does not exist"
Jul 20 19:43:07.979423 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.979391    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert\") pod \"74756d91-637a-4606-a30c-bdc94b4aed03\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") "
Jul 20 19:43:07.979570 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.979443    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fd69\" (UniqueName: \"kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69\") pod \"74756d91-637a-4606-a30c-bdc94b4aed03\" (UID: \"74756d91-637a-4606-a30c-bdc94b4aed03\") "
Jul 20 19:43:07.981467 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.981431    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69" (OuterVolumeSpecName: "kube-api-access-2fd69") pod "74756d91-637a-4606-a30c-bdc94b4aed03" (UID: "74756d91-637a-4606-a30c-bdc94b4aed03"). InnerVolumeSpecName "kube-api-access-2fd69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:43:07.989370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:07.989342    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "74756d91-637a-4606-a30c-bdc94b4aed03" (UID: "74756d91-637a-4606-a30c-bdc94b4aed03"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:43:08.080414 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:08.080380    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74756d91-637a-4606-a30c-bdc94b4aed03-tls-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:43:08.080414 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:08.080409    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fd69\" (UniqueName: \"kubernetes.io/projected/74756d91-637a-4606-a30c-bdc94b4aed03-kube-api-access-2fd69\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:43:08.183012 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:08.182926    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:08.222136 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:08.222108    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:43:08.229453 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:08.229424    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79bf655dcd-bzj6m"]
Jul 20 19:43:09.260526 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:09.260494    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:09.365661 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:09.365628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:09.461983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:09.461949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:09.547200 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:09.547126    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74756d91-637a-4606-a30c-bdc94b4aed03" path="/var/lib/kubelet/pods/74756d91-637a-4606-a30c-bdc94b4aed03/volumes"
Jul 20 19:43:27.983452 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:27.983420    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:56.113956 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.113916    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:43:56.114358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.114132    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" podUID="35a73073-b948-476e-8274-97547b9d6a04" containerName="manager" containerID="cri-o://532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb" gracePeriod=30
Jul 20 19:43:56.350648 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.350623    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:43:56.397470 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.397384    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r7nb\" (UniqueName: \"kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb\") pod \"35a73073-b948-476e-8274-97547b9d6a04\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") "
Jul 20 19:43:56.397470 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.397430    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert\") pod \"35a73073-b948-476e-8274-97547b9d6a04\" (UID: \"35a73073-b948-476e-8274-97547b9d6a04\") "
Jul 20 19:43:56.399596 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.399569    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "35a73073-b948-476e-8274-97547b9d6a04" (UID: "35a73073-b948-476e-8274-97547b9d6a04"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:43:56.399718 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.399638    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb" (OuterVolumeSpecName: "kube-api-access-2r7nb") pod "35a73073-b948-476e-8274-97547b9d6a04" (UID: "35a73073-b948-476e-8274-97547b9d6a04"). InnerVolumeSpecName "kube-api-access-2r7nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:43:56.498987 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.498946    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r7nb\" (UniqueName: \"kubernetes.io/projected/35a73073-b948-476e-8274-97547b9d6a04-kube-api-access-2r7nb\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:43:56.498987 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:56.498975    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35a73073-b948-476e-8274-97547b9d6a04-webhook-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:43:57.111651 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.111615    2571 generic.go:356] "Generic (PLEG): container finished" podID="35a73073-b948-476e-8274-97547b9d6a04" containerID="532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb" exitCode=0
Jul 20 19:43:57.111872 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.111664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw"
Jul 20 19:43:57.111872 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.111682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" event={"ID":"35a73073-b948-476e-8274-97547b9d6a04","Type":"ContainerDied","Data":"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"}
Jul 20 19:43:57.111872 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.111734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-47xsw" event={"ID":"35a73073-b948-476e-8274-97547b9d6a04","Type":"ContainerDied","Data":"c72b3b08ac936250a24cfcfd8ac7af606a1aa596c1d563248a81b69ab3468780"}
Jul 20 19:43:57.111872 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.111780    2571 scope.go:117] "RemoveContainer" containerID="532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"
Jul 20 19:43:57.121093 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.120915    2571 scope.go:117] "RemoveContainer" containerID="532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"
Jul 20 19:43:57.121300 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:43:57.121183    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb\": container with ID starting with 532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb not found: ID does not exist" containerID="532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"
Jul 20 19:43:57.121300 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.121209    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb"} err="failed to get container status \"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb\": rpc error: code = NotFound desc = could not find container \"532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb\": container with ID starting with 532b2c09e61368942e4286c9cb36757cabf0601e85bbdd1beeda50febf1dabeb not found: ID does not exist"
Jul 20 19:43:57.140077 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.140051    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:43:57.148856 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.148826    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-47xsw"]
Jul 20 19:43:57.547465 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:43:57.547432    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35a73073-b948-476e-8274-97547b9d6a04" path="/var/lib/kubelet/pods/35a73073-b948-476e-8274-97547b9d6a04/volumes"
Jul 20 19:44:58.054271 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054235    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054547    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74756d91-637a-4606-a30c-bdc94b4aed03" containerName="authorino"
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054558    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="74756d91-637a-4606-a30c-bdc94b4aed03" containerName="authorino"
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054571    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35a73073-b948-476e-8274-97547b9d6a04" containerName="manager"
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054576    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="35a73073-b948-476e-8274-97547b9d6a04" containerName="manager"
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054635    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="35a73073-b948-476e-8274-97547b9d6a04" containerName="manager"
Jul 20 19:44:58.054737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.054646    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="74756d91-637a-4606-a30c-bdc94b4aed03" containerName="authorino"
Jul 20 19:44:58.058679 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.058661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.062021 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.061999    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:44:58.062145 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.062086    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:44:58.063312 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.063296    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7grfb\""
Jul 20 19:44:58.082727 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.082708    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:44:58.135480 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.135443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.135655 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.135511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kznsz\" (UniqueName: \"kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.236310 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.236279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kznsz\" (UniqueName: \"kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.236477 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.236337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.238702 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.238681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.250487 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.250457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kznsz\" (UniqueName: \"kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz\") pod \"maas-controller-6bb4b6b8f9-l2d6k\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") " pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.368358 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.368277    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:58.513799 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.513769    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:44:58.516479 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:44:58.516447    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760e123a_eba1_464e_8f5a_59aaf6d3a2e8.slice/crio-fb2ea5622d5b8a87cb38c34ccf8876c9110140139170244a43caf5a96197a17a WatchSource:0}: Error finding container fb2ea5622d5b8a87cb38c34ccf8876c9110140139170244a43caf5a96197a17a: Status 404 returned error can't find the container with id fb2ea5622d5b8a87cb38c34ccf8876c9110140139170244a43caf5a96197a17a
Jul 20 19:44:58.517887 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:58.517869    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:44:59.368601 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:59.368562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" event={"ID":"760e123a-eba1-464e-8f5a-59aaf6d3a2e8","Type":"ContainerStarted","Data":"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"}
Jul 20 19:44:59.369013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:59.368622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" event={"ID":"760e123a-eba1-464e-8f5a-59aaf6d3a2e8","Type":"ContainerStarted","Data":"fb2ea5622d5b8a87cb38c34ccf8876c9110140139170244a43caf5a96197a17a"}
Jul 20 19:44:59.369013 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:59.368700    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:44:59.408218 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:44:59.408157    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" podStartSLOduration=0.748638587 podStartE2EDuration="1.408138318s" totalImagesPullingTime="659.499731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:44:59.407239994 +0000 UTC m=+1041.509703344" watchObservedRunningTime="2026-07-20 19:44:59.408138318 +0000 UTC m=+1041.510601666"
Jul 20 19:45:00.192903 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.192867    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"]
Jul 20 19:45:00.196148 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.196132    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"
Jul 20 19:45:00.202641 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.202512    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 19:45:00.205555 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.205536    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"
Jul 20 19:45:00.233254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.233221    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"]
Jul 20 19:45:00.360297 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.360263    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"]
Jul 20 19:45:00.364312 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:45:00.364280    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37080446_876b_464d_9733_9ced344e9b7f.slice/crio-1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1 WatchSource:0}: Error finding container 1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1: Status 404 returned error can't find the container with id 1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1
Jul 20 19:45:00.376836 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:00.376797    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p" event={"ID":"37080446-876b-464d-9733-9ced344e9b7f","Type":"ContainerStarted","Data":"1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1"}
Jul 20 19:45:04.395811 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:04.395742    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p" event={"ID":"37080446-876b-464d-9733-9ced344e9b7f","Type":"ContainerStarted","Data":"3107dc6fe7f8ce222b2ced8d3d184bb3fa7bf5a0738e6004ea0db4d4a4618c46"}
Jul 20 19:45:04.414298 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:04.414243    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p" podStartSLOduration=1.294465153 podStartE2EDuration="4.414226918s" totalImagesPullingTime="3.119761765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:04.413146599 +0000 UTC m=+1046.515609948" watchObservedRunningTime="2026-07-20 19:45:04.414226918 +0000 UTC m=+1046.516690266"
Jul 20 19:45:05.401296 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:05.401257    2571 generic.go:356] "Generic (PLEG): container finished" podID="37080446-876b-464d-9733-9ced344e9b7f" containerID="3107dc6fe7f8ce222b2ced8d3d184bb3fa7bf5a0738e6004ea0db4d4a4618c46" exitCode=0
Jul 20 19:45:05.401697 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:05.401328    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p" event={"ID":"37080446-876b-464d-9733-9ced344e9b7f","Type":"ContainerDied","Data":"3107dc6fe7f8ce222b2ced8d3d184bb3fa7bf5a0738e6004ea0db4d4a4618c46"}
Jul 20 19:45:06.530848 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:06.530823    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"
Jul 20 19:45:07.411669 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:07.411644    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p"
Jul 20 19:45:07.411669 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:07.411649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-6vj2p" event={"ID":"37080446-876b-464d-9733-9ced344e9b7f","Type":"ContainerDied","Data":"1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1"}
Jul 20 19:45:07.411889 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:07.411697    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d939729a701b48d8b1673156cb4965191bded9ee0342096ce9444a2f66460f1"
Jul 20 19:45:10.379137 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:10.379109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:45:15.040347 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.040312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:15.090200 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.090164    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:45:15.090436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.090410    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" podUID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" containerName="manager" containerID="cri-o://b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66" gracePeriod=30
Jul 20 19:45:15.326077 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.326054    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:45:15.448502 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.448465    2571 generic.go:356] "Generic (PLEG): container finished" podID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" containerID="b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66" exitCode=0
Jul 20 19:45:15.448686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.448512    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k"
Jul 20 19:45:15.448686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.448553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" event={"ID":"760e123a-eba1-464e-8f5a-59aaf6d3a2e8","Type":"ContainerDied","Data":"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"}
Jul 20 19:45:15.448686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.448607    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-l2d6k" event={"ID":"760e123a-eba1-464e-8f5a-59aaf6d3a2e8","Type":"ContainerDied","Data":"fb2ea5622d5b8a87cb38c34ccf8876c9110140139170244a43caf5a96197a17a"}
Jul 20 19:45:15.448686 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.448629    2571 scope.go:117] "RemoveContainer" containerID="b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"
Jul 20 19:45:15.456729 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.456711    2571 scope.go:117] "RemoveContainer" containerID="b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"
Jul 20 19:45:15.457021 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:45:15.457002    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66\": container with ID starting with b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66 not found: ID does not exist" containerID="b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"
Jul 20 19:45:15.457068 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.457030    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66"} err="failed to get container status \"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66\": rpc error: code = NotFound desc = could not find container \"b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66\": container with ID starting with b046aff5bac8ab58f392a4ddff7c156e3bc371cd8202e2404c6cd34688152b66 not found: ID does not exist"
Jul 20 19:45:15.491672 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.491642    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kznsz\" (UniqueName: \"kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz\") pod \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") "
Jul 20 19:45:15.491815 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.491729    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert\") pod \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\" (UID: \"760e123a-eba1-464e-8f5a-59aaf6d3a2e8\") "
Jul 20 19:45:15.493790 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.493735    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "760e123a-eba1-464e-8f5a-59aaf6d3a2e8" (UID: "760e123a-eba1-464e-8f5a-59aaf6d3a2e8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:15.493790 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.493782    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz" (OuterVolumeSpecName: "kube-api-access-kznsz") pod "760e123a-eba1-464e-8f5a-59aaf6d3a2e8" (UID: "760e123a-eba1-464e-8f5a-59aaf6d3a2e8"). InnerVolumeSpecName "kube-api-access-kznsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:15.592719 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.592644    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-webhook-cert\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:45:15.592719 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.592672    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kznsz\" (UniqueName: \"kubernetes.io/projected/760e123a-eba1-464e-8f5a-59aaf6d3a2e8-kube-api-access-kznsz\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:45:15.766994 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.766963    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:45:15.775891 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:15.775863    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-l2d6k"]
Jul 20 19:45:16.528127 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.528094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:16.653093 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653056    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-2smhk"]
Jul 20 19:45:16.653395 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653381    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37080446-876b-464d-9733-9ced344e9b7f" containerName="cleanup"
Jul 20 19:45:16.653437 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653397    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="37080446-876b-464d-9733-9ced344e9b7f" containerName="cleanup"
Jul 20 19:45:16.653437 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653407    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" containerName="manager"
Jul 20 19:45:16.653437 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653413    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" containerName="manager"
Jul 20 19:45:16.653526 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653480    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="37080446-876b-464d-9733-9ced344e9b7f" containerName="cleanup"
Jul 20 19:45:16.653526 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.653491    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" containerName="manager"
Jul 20 19:45:16.655961 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.655943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.662296 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.662274    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:45:16.662578 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.662561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:45:16.663817 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.663801    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7grfb\""
Jul 20 19:45:16.678370 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.678341    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-2smhk"]
Jul 20 19:45:16.802885 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.802806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxh97\" (UniqueName: \"kubernetes.io/projected/ad015959-95c9-44b8-ad3e-cc975e0b009a-kube-api-access-nxh97\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.802885 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.802848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad015959-95c9-44b8-ad3e-cc975e0b009a-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.903887 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.903848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxh97\" (UniqueName: \"kubernetes.io/projected/ad015959-95c9-44b8-ad3e-cc975e0b009a-kube-api-access-nxh97\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.904045 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.903898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad015959-95c9-44b8-ad3e-cc975e0b009a-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.906404 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.906380    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad015959-95c9-44b8-ad3e-cc975e0b009a-webhook-cert\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.913582 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.913561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxh97\" (UniqueName: \"kubernetes.io/projected/ad015959-95c9-44b8-ad3e-cc975e0b009a-kube-api-access-nxh97\") pod \"maas-controller-6bb4b6b8f9-2smhk\" (UID: \"ad015959-95c9-44b8-ad3e-cc975e0b009a\") " pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:16.966449 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:16.966411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:17.101875 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:17.101795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb4b6b8f9-2smhk"]
Jul 20 19:45:17.105235 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:45:17.105206    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad015959_95c9_44b8_ad3e_cc975e0b009a.slice/crio-ee86e7bff7edd8eb56431bb7fe7d4039b55e5ba360d60ca857ed4bf1649ca375 WatchSource:0}: Error finding container ee86e7bff7edd8eb56431bb7fe7d4039b55e5ba360d60ca857ed4bf1649ca375: Status 404 returned error can't find the container with id ee86e7bff7edd8eb56431bb7fe7d4039b55e5ba360d60ca857ed4bf1649ca375
Jul 20 19:45:17.459316 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:17.459225    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk" event={"ID":"ad015959-95c9-44b8-ad3e-cc975e0b009a","Type":"ContainerStarted","Data":"ee86e7bff7edd8eb56431bb7fe7d4039b55e5ba360d60ca857ed4bf1649ca375"}
Jul 20 19:45:17.548356 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:17.548324    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="760e123a-eba1-464e-8f5a-59aaf6d3a2e8" path="/var/lib/kubelet/pods/760e123a-eba1-464e-8f5a-59aaf6d3a2e8/volumes"
Jul 20 19:45:18.464642 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:18.464602    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk" event={"ID":"ad015959-95c9-44b8-ad3e-cc975e0b009a","Type":"ContainerStarted","Data":"9414a1d97e98507d3e0523d0c975f6b73c1b1e48912aba50cf41eb19aab3094a"}
Jul 20 19:45:18.464830 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:18.464722    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:18.483157 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:18.483104    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk" podStartSLOduration=2.110102837 podStartE2EDuration="2.483089567s" totalImagesPullingTime="372.98673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:18.480876211 +0000 UTC m=+1060.583339560" watchObservedRunningTime="2026-07-20 19:45:18.483089567 +0000 UTC m=+1060.585552915"
Jul 20 19:45:29.471580 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:29.471547    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb4b6b8f9-2smhk"
Jul 20 19:45:51.765949 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:51.765915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:51.974943 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:51.974910    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:52.146780 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:45:52.146687    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:00.142808 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:00.142752    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:00.448147 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:00.448067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:00.779651 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:00.779612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:01.012938 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:01.012905    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:08.145856 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:08.145814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:08.424178 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:08.424099    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:11.151267 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:11.151232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:55.274452 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:46:55.274418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:39.253961 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:47:39.253931    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:47:39.255534 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:47:39.255517    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:48:02.199816 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:48:02.199782    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:02.287749 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:48:02.287714    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:12.930927 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:48:12.930887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:14.607201 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:48:14.607158    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:05.114065 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:49:05.113975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:22.189917 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:49:22.189882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:22.246732 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:49:22.246698    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:02.321822 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:52:02.321789    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:26.758935 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:52:26.758890    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:39.278623 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:52:39.278592    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:52:39.281128 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:52:39.281109    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:53:53.319492 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.319457    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:53:53.322855 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.322840    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.326247 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.326224    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-a031f581-kserve-self-signed-certs\""
Jul 20 19:53:53.353828 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.353791    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:53:53.361008 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.360980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:53.463352 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.463352 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.463580 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.463580 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5tnk\" (UniqueName: \"kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.463580 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.463580 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.463553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564014 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.563983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564014 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5tnk\" (UniqueName: \"kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564277 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564277 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564277 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564277 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564502 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564567 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564536    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.564614 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.564583    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.566371 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.566343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.566536 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.566519    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.574943 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.574893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5tnk\" (UniqueName: \"kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk\") pod \"e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") " pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.632715 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.632680    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:53:53.768283 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:53.768256    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:53:53.770794 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:53:53.770746    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d97de5_5732_4bf9_8310_87b637245736.slice/crio-7e303c26aad66d18aa348140213290f13ab66b6375286e5dd5f702c4dc2f8f38 WatchSource:0}: Error finding container 7e303c26aad66d18aa348140213290f13ab66b6375286e5dd5f702c4dc2f8f38: Status 404 returned error can't find the container with id 7e303c26aad66d18aa348140213290f13ab66b6375286e5dd5f702c4dc2f8f38
Jul 20 19:53:54.618913 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:54.618874    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" event={"ID":"87d97de5-5732-4bf9-8310-87b637245736","Type":"ContainerStarted","Data":"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"}
Jul 20 19:53:54.619278 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:54.618922    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" event={"ID":"87d97de5-5732-4bf9-8310-87b637245736","Type":"ContainerStarted","Data":"7e303c26aad66d18aa348140213290f13ab66b6375286e5dd5f702c4dc2f8f38"}
Jul 20 19:53:54.639097 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:53:54.639042    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" podStartSLOduration=1.6390268749999999 podStartE2EDuration="1.639026875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:54.637736917 +0000 UTC m=+1576.740200266" watchObservedRunningTime="2026-07-20 19:53:54.639026875 +0000 UTC m=+1576.741490223"
Jul 20 19:54:03.633494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:03.633409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:54:03.633494 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:03.633453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:54:03.645865 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:03.645840    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:54:03.666312 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:03.666281    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:54:25.389196 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.389162    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:54:25.392638 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.392621    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.396076 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.396055    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-a031f581-kserve-self-signed-certs\""
Jul 20 19:54:25.404656 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.404635    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:54:25.432861 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.432822    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:25.460086 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.460231 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.460231 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.460231 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.460231 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.460371 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.460296    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97jxm\" (UniqueName: \"kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561348 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97jxm\" (UniqueName: \"kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561517 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561517 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561517 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561637 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561637 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.561857 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.562001 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.561978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.562053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.562006    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.563654 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.563628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.564021 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.564004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.570454 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.570426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97jxm\" (UniqueName: \"kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm\") pod \"e2e-same-id-b-a031f581-kserve-67b9654795-gj67t\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") " pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.705450 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.705364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:25.836053 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:25.836019    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:54:25.838393 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:54:25.838365    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5200d6e_086c_4f56_a82e_62cf01b874db.slice/crio-a5bf131ebcca0ac232e173b66d9d750bf7dd3bfae41458c4cfccbad0cdd470fe WatchSource:0}: Error finding container a5bf131ebcca0ac232e173b66d9d750bf7dd3bfae41458c4cfccbad0cdd470fe: Status 404 returned error can't find the container with id a5bf131ebcca0ac232e173b66d9d750bf7dd3bfae41458c4cfccbad0cdd470fe
Jul 20 19:54:26.754811 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:26.754748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" event={"ID":"b5200d6e-086c-4f56-a82e-62cf01b874db","Type":"ContainerStarted","Data":"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"}
Jul 20 19:54:26.755253 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:26.754822    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" event={"ID":"b5200d6e-086c-4f56-a82e-62cf01b874db","Type":"ContainerStarted","Data":"a5bf131ebcca0ac232e173b66d9d750bf7dd3bfae41458c4cfccbad0cdd470fe"}
Jul 20 19:54:26.772839 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:26.772783    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" podStartSLOduration=1.772739974 podStartE2EDuration="1.772739974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:54:26.771746878 +0000 UTC m=+1608.874210226" watchObservedRunningTime="2026-07-20 19:54:26.772739974 +0000 UTC m=+1608.875203323"
Jul 20 19:54:35.706266 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:35.706185    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:35.706266 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:35.706231    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:35.718987 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:35.718959    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:54:35.805438 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:54:35.805407    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:55:01.030044 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:01.030006    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:55:01.055788 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:01.055733    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:02.607155 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:02.607120    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:55:02.631430 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:02.631400    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:16.050629 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.050569    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" podUID="87d97de5-5732-4bf9-8310-87b637245736" containerName="main" containerID="cri-o://f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b" gracePeriod=45
Jul 20 19:55:16.293398 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.293376    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:55:16.415041 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.414963    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415041 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415023    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5tnk\" (UniqueName: \"kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415055    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415071    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415103    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415254 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415116    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm\") pod \"87d97de5-5732-4bf9-8310-87b637245736\" (UID: \"87d97de5-5732-4bf9-8310-87b637245736\") "
Jul 20 19:55:16.415457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home" (OuterVolumeSpecName: "home") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:16.415457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415337    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache" (OuterVolumeSpecName: "model-cache") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:16.415457 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.415351    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:16.417334 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.417294    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm" (OuterVolumeSpecName: "dshm") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:16.417451 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.417337    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:55:16.417451 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.417349    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk" (OuterVolumeSpecName: "kube-api-access-g5tnk") pod "87d97de5-5732-4bf9-8310-87b637245736" (UID: "87d97de5-5732-4bf9-8310-87b637245736"). InnerVolumeSpecName "kube-api-access-g5tnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:55:16.516192 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516160    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.516192 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516186    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5tnk\" (UniqueName: \"kubernetes.io/projected/87d97de5-5732-4bf9-8310-87b637245736-kube-api-access-g5tnk\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.516192 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516196    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.516436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516205    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.516436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516215    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d97de5-5732-4bf9-8310-87b637245736-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.516436 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.516222    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d97de5-5732-4bf9-8310-87b637245736-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:16.967134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.967096    2571 generic.go:356] "Generic (PLEG): container finished" podID="87d97de5-5732-4bf9-8310-87b637245736" containerID="f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b" exitCode=0
Jul 20 19:55:16.967134 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.967132    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"
Jul 20 19:55:16.967328 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.967199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" event={"ID":"87d97de5-5732-4bf9-8310-87b637245736","Type":"ContainerDied","Data":"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"}
Jul 20 19:55:16.967328 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.967235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk" event={"ID":"87d97de5-5732-4bf9-8310-87b637245736","Type":"ContainerDied","Data":"7e303c26aad66d18aa348140213290f13ab66b6375286e5dd5f702c4dc2f8f38"}
Jul 20 19:55:16.967328 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.967252    2571 scope.go:117] "RemoveContainer" containerID="f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"
Jul 20 19:55:16.976284 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.976255    2571 scope.go:117] "RemoveContainer" containerID="f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"
Jul 20 19:55:16.976548 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:55:16.976531    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b\": container with ID starting with f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b not found: ID does not exist" containerID="f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"
Jul 20 19:55:16.976599 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.976555    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b"} err="failed to get container status \"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b\": rpc error: code = NotFound desc = could not find container \"f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b\": container with ID starting with f802b6778e20f6072d9dfbebf12e1058a204314ea1a190d4d38ef00aaf17431b not found: ID does not exist"
Jul 20 19:55:16.988631 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.988603    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:55:16.992268 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:16.992241    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-a031f581-kserve-59bf75b75f-8gwnk"]
Jul 20 19:55:17.547084 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.547048    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d97de5-5732-4bf9-8310-87b637245736" path="/var/lib/kubelet/pods/87d97de5-5732-4bf9-8310-87b637245736/volumes"
Jul 20 19:55:17.626881 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.626841    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" podUID="b5200d6e-086c-4f56-a82e-62cf01b874db" containerName="main" containerID="cri-o://b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe" gracePeriod=45
Jul 20 19:55:17.872983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.872958    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:55:17.972905 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.972874    2571 generic.go:356] "Generic (PLEG): container finished" podID="b5200d6e-086c-4f56-a82e-62cf01b874db" containerID="b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe" exitCode=0
Jul 20 19:55:17.973073 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.972922    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"
Jul 20 19:55:17.973073 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.972965    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" event={"ID":"b5200d6e-086c-4f56-a82e-62cf01b874db","Type":"ContainerDied","Data":"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"}
Jul 20 19:55:17.973073 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.973015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t" event={"ID":"b5200d6e-086c-4f56-a82e-62cf01b874db","Type":"ContainerDied","Data":"a5bf131ebcca0ac232e173b66d9d750bf7dd3bfae41458c4cfccbad0cdd470fe"}
Jul 20 19:55:17.973073 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.973039    2571 scope.go:117] "RemoveContainer" containerID="b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"
Jul 20 19:55:17.984171 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.984150    2571 scope.go:117] "RemoveContainer" containerID="b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"
Jul 20 19:55:17.984452 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:55:17.984432    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe\": container with ID starting with b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe not found: ID does not exist" containerID="b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"
Jul 20 19:55:17.984559 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:17.984460    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe"} err="failed to get container status \"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe\": rpc error: code = NotFound desc = could not find container \"b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe\": container with ID starting with b66dc9aab12741aeb5ab1debba145af3a7ed9db248d2954abe1204b565bfcebe not found: ID does not exist"
Jul 20 19:55:18.029524 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029541    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029609    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97jxm\" (UniqueName: \"kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029675 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029662    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029877 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029836    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm\") pod \"b5200d6e-086c-4f56-a82e-62cf01b874db\" (UID: \"b5200d6e-086c-4f56-a82e-62cf01b874db\") "
Jul 20 19:55:18.029877 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029847    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:18.029983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029889    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:18.029983 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.029903    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home" (OuterVolumeSpecName: "home") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:18.030257 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.030080    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.030257 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.030099    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.030257 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.030114    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.031768 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.031736    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:55:18.031768 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.031747    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm" (OuterVolumeSpecName: "dshm") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:55:18.031871 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.031844    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm" (OuterVolumeSpecName: "kube-api-access-97jxm") pod "b5200d6e-086c-4f56-a82e-62cf01b874db" (UID: "b5200d6e-086c-4f56-a82e-62cf01b874db"). InnerVolumeSpecName "kube-api-access-97jxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:55:18.131179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.131099    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5200d6e-086c-4f56-a82e-62cf01b874db-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.131179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.131126    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5200d6e-086c-4f56-a82e-62cf01b874db-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.131179 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.131138    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97jxm\" (UniqueName: \"kubernetes.io/projected/b5200d6e-086c-4f56-a82e-62cf01b874db-kube-api-access-97jxm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:55:18.306925 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.306892    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:55:18.315341 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:18.315311    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-a031f581-kserve-67b9654795-gj67t"]
Jul 20 19:55:19.546963 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:55:19.546925    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5200d6e-086c-4f56-a82e-62cf01b874db" path="/var/lib/kubelet/pods/b5200d6e-086c-4f56-a82e-62cf01b874db/volumes"
Jul 20 19:57:39.309838 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:57:39.309806    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:57:39.312940 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:57:39.312914    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 19:57:40.365386 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:57:40.365351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:19.490904 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:19.490862    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:29.174963 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:29.174915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:37.453106 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:37.453069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:42.767556 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:42.767525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:45.919521 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:45.919483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:46.007099 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:46.007061    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:46.398264 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:46.398232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:52.532315 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:52.532280    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:52.599737 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:52.599701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:52.783537 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:52.783453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:53.084453 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:53.084370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:53.242854 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:53.242819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:55.435848 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.435813    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:55.600740 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.600711    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:58:55.601058 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601045    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5200d6e-086c-4f56-a82e-62cf01b874db" containerName="main"
Jul 20 19:58:55.601111 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601059    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5200d6e-086c-4f56-a82e-62cf01b874db" containerName="main"
Jul 20 19:58:55.601111 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601073    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d97de5-5732-4bf9-8310-87b637245736" containerName="main"
Jul 20 19:58:55.601111 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601079    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d97de5-5732-4bf9-8310-87b637245736" containerName="main"
Jul 20 19:58:55.601219 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601129    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5200d6e-086c-4f56-a82e-62cf01b874db" containerName="main"
Jul 20 19:58:55.601219 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.601138    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d97de5-5732-4bf9-8310-87b637245736" containerName="main"
Jul 20 19:58:55.603906 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.603875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.610195 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.610168    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4f42155d-serving-cert\""
Jul 20 19:58:55.617783 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.617739    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:58:55.685484 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.685448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.685484 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.685482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.685688 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.685501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc5sv\" (UniqueName: \"kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.786394 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.786351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.786394 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.786393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.786643 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.786419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc5sv\" (UniqueName: \"kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.786643 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:58:55.786538    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-serving-cert: secret "maas-api-e2e-ait-4f42155d-serving-cert" not found
Jul 20 19:58:55.786643 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:58:55.786618    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls podName:24df13ef-dbb6-4e5e-b5bf-30d463828a40 nodeName:}" failed. No retries permitted until 2026-07-20 19:58:56.286596683 +0000 UTC m=+1878.389060015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls") pod "maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" (UID: "24df13ef-dbb6-4e5e-b5bf-30d463828a40") : secret "maas-api-e2e-ait-4f42155d-serving-cert" not found
Jul 20 19:58:55.787145 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.787127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:55.804667 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:55.804641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc5sv\" (UniqueName: \"kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:56.290453 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.290414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:56.292877 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.292851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") pod \"maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:56.517206 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.517169    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:56.660251 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.660202    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:58:56.663260 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:58:56.663221    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24df13ef_dbb6_4e5e_b5bf_30d463828a40.slice/crio-98addaed3e460dfac182848125d44644b9d80226ed23c5fcffcd5cba65e2110b WatchSource:0}: Error finding container 98addaed3e460dfac182848125d44644b9d80226ed23c5fcffcd5cba65e2110b: Status 404 returned error can't find the container with id 98addaed3e460dfac182848125d44644b9d80226ed23c5fcffcd5cba65e2110b
Jul 20 19:58:56.664493 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.664472    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:58:56.881586 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.881494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" event={"ID":"24df13ef-dbb6-4e5e-b5bf-30d463828a40","Type":"ContainerStarted","Data":"98addaed3e460dfac182848125d44644b9d80226ed23c5fcffcd5cba65e2110b"}
Jul 20 19:58:56.952113 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:56.952075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:57.886816 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:57.886777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" event={"ID":"24df13ef-dbb6-4e5e-b5bf-30d463828a40","Type":"ContainerStarted","Data":"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"}
Jul 20 19:58:57.887250 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:57.886885    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:58:57.909486 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:58:57.909435    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" podStartSLOduration=2.454836925 podStartE2EDuration="2.909418605s" totalImagesPullingTime="454.58168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:58:57.908837816 +0000 UTC m=+1880.011301168" watchObservedRunningTime="2026-07-20 19:58:57.909418605 +0000 UTC m=+1880.011881954"
Jul 20 19:59:03.896736 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:03.896702    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:59:21.105397 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.105353    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"]
Jul 20 19:59:21.109146 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.109124    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:21.113264 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.113243    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 19:59:21.122188 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.122163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"]
Jul 20 19:59:21.199221 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.199188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4f42155d-x29d5\" (UID: \"f821cdfd-3f29-4152-89a5-2dc7efeef790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:21.300470 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.300430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4f42155d-x29d5\" (UID: \"f821cdfd-3f29-4152-89a5-2dc7efeef790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:21.301201 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.301178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4f42155d-x29d5\" (UID: \"f821cdfd-3f29-4152-89a5-2dc7efeef790\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:21.418891 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.418810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:21.549551 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.549529    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"]
Jul 20 19:59:21.550138 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:59:21.550108    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf821cdfd_3f29_4152_89a5_2dc7efeef790.slice/crio-dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f WatchSource:0}: Error finding container dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f: Status 404 returned error can't find the container with id dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f
Jul 20 19:59:21.997546 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.997509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5" event={"ID":"f821cdfd-3f29-4152-89a5-2dc7efeef790","Type":"ContainerStarted","Data":"1551bb56f2c76a1128475eb7c8a31b8ab0a4575527036e394b1ee92c122d9946"}
Jul 20 19:59:21.997724 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:21.997560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5" event={"ID":"f821cdfd-3f29-4152-89a5-2dc7efeef790","Type":"ContainerStarted","Data":"dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f"}
Jul 20 19:59:22.014031 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:22.013931    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5" podStartSLOduration=1.013913962 podStartE2EDuration="1.013913962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:22.011967544 +0000 UTC m=+1904.114430917" watchObservedRunningTime="2026-07-20 19:59:22.013913962 +0000 UTC m=+1904.116377353"
Jul 20 19:59:23.003268 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:23.003232    2571 generic.go:356] "Generic (PLEG): container finished" podID="f821cdfd-3f29-4152-89a5-2dc7efeef790" containerID="1551bb56f2c76a1128475eb7c8a31b8ab0a4575527036e394b1ee92c122d9946" exitCode=0
Jul 20 19:59:23.003663 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:23.003311    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5" event={"ID":"f821cdfd-3f29-4152-89a5-2dc7efeef790","Type":"ContainerDied","Data":"1551bb56f2c76a1128475eb7c8a31b8ab0a4575527036e394b1ee92c122d9946"}
Jul 20 19:59:24.132064 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:24.132036    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:24.225708 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:24.225678    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca\") pod \"f821cdfd-3f29-4152-89a5-2dc7efeef790\" (UID: \"f821cdfd-3f29-4152-89a5-2dc7efeef790\") "
Jul 20 19:59:24.226047 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:24.226025    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f821cdfd-3f29-4152-89a5-2dc7efeef790" (UID: "f821cdfd-3f29-4152-89a5-2dc7efeef790"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:59:24.327238 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:24.327148    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f821cdfd-3f29-4152-89a5-2dc7efeef790-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:59:25.010354 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:25.010321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:25.012788 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:25.012750    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"
Jul 20 19:59:25.012905 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:25.012790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5" event={"ID":"f821cdfd-3f29-4152-89a5-2dc7efeef790","Type":"ContainerDied","Data":"dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f"}
Jul 20 19:59:25.012905 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:25.012834    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd2fe5ba757bed6e9eaf0790b130df5b278a520755d1ce3aca4bf90ceb9eac4f"
Jul 20 19:59:31.671000 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.670966    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:59:31.671472 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.671201    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" podUID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" containerName="maas-api" containerID="cri-o://7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e" gracePeriod=30
Jul 20 19:59:31.699973 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.699946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:31.909721 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.909698    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:59:31.991706 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.991676    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") pod \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") "
Jul 20 19:59:31.991878 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.991748    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca\") pod \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") "
Jul 20 19:59:31.991878 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.991809    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc5sv\" (UniqueName: \"kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv\") pod \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\" (UID: \"24df13ef-dbb6-4e5e-b5bf-30d463828a40\") "
Jul 20 19:59:31.992175 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.992149    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24df13ef-dbb6-4e5e-b5bf-30d463828a40" (UID: "24df13ef-dbb6-4e5e-b5bf-30d463828a40"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:59:31.993993 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.993973    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24df13ef-dbb6-4e5e-b5bf-30d463828a40" (UID: "24df13ef-dbb6-4e5e-b5bf-30d463828a40"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:59:31.994140 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:31.994116    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv" (OuterVolumeSpecName: "kube-api-access-gc5sv") pod "24df13ef-dbb6-4e5e-b5bf-30d463828a40" (UID: "24df13ef-dbb6-4e5e-b5bf-30d463828a40"). InnerVolumeSpecName "kube-api-access-gc5sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:59:32.043197 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.043168    2571 generic.go:356] "Generic (PLEG): container finished" podID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" containerID="7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e" exitCode=0
Jul 20 19:59:32.043311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.043214    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"
Jul 20 19:59:32.043311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.043220    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" event={"ID":"24df13ef-dbb6-4e5e-b5bf-30d463828a40","Type":"ContainerDied","Data":"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"}
Jul 20 19:59:32.043311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.043261    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk" event={"ID":"24df13ef-dbb6-4e5e-b5bf-30d463828a40","Type":"ContainerDied","Data":"98addaed3e460dfac182848125d44644b9d80226ed23c5fcffcd5cba65e2110b"}
Jul 20 19:59:32.043311 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.043281    2571 scope.go:117] "RemoveContainer" containerID="7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"
Jul 20 19:59:32.052258 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.052239    2571 scope.go:117] "RemoveContainer" containerID="7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"
Jul 20 19:59:32.052473 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:59:32.052455    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e\": container with ID starting with 7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e not found: ID does not exist" containerID="7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"
Jul 20 19:59:32.052524 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.052481    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e"} err="failed to get container status \"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e\": rpc error: code = NotFound desc = could not find container \"7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e\": container with ID starting with 7d61e70afa1838fad168fc405489ecf7cc048ef36a432a4b7e7de8c6f482af4e not found: ID does not exist"
Jul 20 19:59:32.065375 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.065342    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:59:32.069175 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.069153    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4f42155d-78b46c8f6f-fv6rk"]
Jul 20 19:59:32.093028 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.093005    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24df13ef-dbb6-4e5e-b5bf-30d463828a40-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:59:32.093028 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.093027    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24df13ef-dbb6-4e5e-b5bf-30d463828a40-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:59:32.093126 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:32.093038    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc5sv\" (UniqueName: \"kubernetes.io/projected/24df13ef-dbb6-4e5e-b5bf-30d463828a40-kube-api-access-gc5sv\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 19:59:33.547284 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:33.547249    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" path="/var/lib/kubelet/pods/24df13ef-dbb6-4e5e-b5bf-30d463828a40/volumes"
Jul 20 19:59:36.192715 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.192675    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"]
Jul 20 19:59:36.192715 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.192705    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:36.194815 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.194795    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4f42155d-x29d5"]
Jul 20 19:59:36.376554 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.376518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:36.656523 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.656490    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:36.963741 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:36.963650    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:37.108962 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:37.108929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:37.289317 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:37.289287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:37.547217 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:37.547142    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f821cdfd-3f29-4152-89a5-2dc7efeef790" path="/var/lib/kubelet/pods/f821cdfd-3f29-4152-89a5-2dc7efeef790/volumes"
Jul 20 19:59:37.666570 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:37.666538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:37.766102 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:37.766065    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:39.892709 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:39.892669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:40.094557 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.094522    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 19:59:40.095051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095029    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f821cdfd-3f29-4152-89a5-2dc7efeef790" containerName="revoke-keys"
Jul 20 19:59:40.095147 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095055    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f821cdfd-3f29-4152-89a5-2dc7efeef790" containerName="revoke-keys"
Jul 20 19:59:40.095147 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095099    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" containerName="maas-api"
Jul 20 19:59:40.095147 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095109    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" containerName="maas-api"
Jul 20 19:59:40.095310 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095196    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="24df13ef-dbb6-4e5e-b5bf-30d463828a40" containerName="maas-api"
Jul 20 19:59:40.095310 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.095210    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f821cdfd-3f29-4152-89a5-2dc7efeef790" containerName="revoke-keys"
Jul 20 19:59:40.098441 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.098420    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.101029 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.101009    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a2049ed7-serving-cert\""
Jul 20 19:59:40.109322 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.109294    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 19:59:40.130636 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.130610    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:40.164597 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.164507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgvj\" (UniqueName: \"kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.164772 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.164626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.164772 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.164674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.265894 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.265855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.265894 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.265899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.266233 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.265925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgvj\" (UniqueName: \"kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.266233 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:59:40.266012    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-serving-cert: secret "maas-api-e2e-migrate-a2049ed7-serving-cert" not found
Jul 20 19:59:40.266233 ip-10-0-132-45 kubenswrapper[2571]: E0720 19:59:40.266089    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls podName:43272afa-3272-4341-90d0-812e109eb1d5 nodeName:}" failed. No retries permitted until 2026-07-20 19:59:40.76607295 +0000 UTC m=+1922.868536277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls") pod "maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" (UID: "43272afa-3272-4341-90d0-812e109eb1d5") : secret "maas-api-e2e-migrate-a2049ed7-serving-cert" not found
Jul 20 19:59:40.266651 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.266627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.274874 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.274851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgvj\" (UniqueName: \"kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.635433 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.635380    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:40.736155 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.736118    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:40.771317 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.771288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.773725 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.773692    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") pod \"maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:40.838816 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:40.838778    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:41.009052 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:41.009017    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:41.140914 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:41.140876    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 19:59:41.143828 ip-10-0-132-45 kubenswrapper[2571]: W0720 19:59:41.143798    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43272afa_3272_4341_90d0_812e109eb1d5.slice/crio-29caa560900d8881580fcbc6d5d0c48445781de3262760091e09d4923f4d6b66 WatchSource:0}: Error finding container 29caa560900d8881580fcbc6d5d0c48445781de3262760091e09d4923f4d6b66: Status 404 returned error can't find the container with id 29caa560900d8881580fcbc6d5d0c48445781de3262760091e09d4923f4d6b66
Jul 20 19:59:42.088051 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:42.088018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" event={"ID":"43272afa-3272-4341-90d0-812e109eb1d5","Type":"ContainerStarted","Data":"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"}
Jul 20 19:59:42.088438 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:42.088078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" event={"ID":"43272afa-3272-4341-90d0-812e109eb1d5","Type":"ContainerStarted","Data":"29caa560900d8881580fcbc6d5d0c48445781de3262760091e09d4923f4d6b66"}
Jul 20 19:59:42.088438 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:42.088160    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 19:59:42.109083 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:42.109029    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" podStartSLOduration=1.666872017 podStartE2EDuration="2.109007822s" totalImagesPullingTime="442.135805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:42.108920997 +0000 UTC m=+1924.211384347" watchObservedRunningTime="2026-07-20 19:59:42.109007822 +0000 UTC m=+1924.211471174"
Jul 20 19:59:48.097879 ip-10-0-132-45 kubenswrapper[2571]: I0720 19:59:48.097844    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 20:00:00.131389 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.131354    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"]
Jul 20 20:00:00.134901 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.134875    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"]
Jul 20 20:00:00.135037 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.134992    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"
Jul 20 20:00:00.137721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.137693    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:00:00.137871 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.137857    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"
Jul 20 20:00:00.143022 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.143001    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"]
Jul 20 20:00:00.144563 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.144543    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"]
Jul 20 20:00:00.146167 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.146012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"
Jul 20 20:00:00.156881 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.156856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"
Jul 20 20:00:00.301936 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.301899    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"]
Jul 20 20:00:00.306073 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:00:00.306039    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dba2330_f48c_40da_acd5_db2b85e2938b.slice/crio-e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658 WatchSource:0}: Error finding container e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658: Status 404 returned error can't find the container with id e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658
Jul 20 20:00:00.320123 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:00.320012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"]
Jul 20 20:00:00.323028 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:00:00.322999    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d107a5_363b_4aae_add9_cd2300e5f041.slice/crio-02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1 WatchSource:0}: Error finding container 02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1: Status 404 returned error can't find the container with id 02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1
Jul 20 20:00:01.173648 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.173608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7" event={"ID":"43d107a5-363b-4aae-add9-cd2300e5f041","Type":"ContainerStarted","Data":"8c8f5b158840110659eb97996787a93e1ce644d0c3ef0f3385e9a656f9afb652"}
Jul 20 20:00:01.174102 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.173666    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7" event={"ID":"43d107a5-363b-4aae-add9-cd2300e5f041","Type":"ContainerStarted","Data":"02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1"}
Jul 20 20:00:01.175047 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.175026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6" event={"ID":"7dba2330-f48c-40da-acd5-db2b85e2938b","Type":"ContainerStarted","Data":"e0a685a1945893891e811c0ba7fffe3d5a630e5c281e3bcc28910027171057e8"}
Jul 20 20:00:01.175114 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.175065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6" event={"ID":"7dba2330-f48c-40da-acd5-db2b85e2938b","Type":"ContainerStarted","Data":"e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658"}
Jul 20 20:00:01.195682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.195628    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7" podStartSLOduration=1.195612379 podStartE2EDuration="1.195612379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:01.19355519 +0000 UTC m=+1943.296018539" watchObservedRunningTime="2026-07-20 20:00:01.195612379 +0000 UTC m=+1943.298075727"
Jul 20 20:00:01.209774 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:01.209704    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6" podStartSLOduration=1.209689708 podStartE2EDuration="1.209689708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:01.209431403 +0000 UTC m=+1943.311894752" watchObservedRunningTime="2026-07-20 20:00:01.209689708 +0000 UTC m=+1943.312153056"
Jul 20 20:00:02.180469 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:02.180423    2571 generic.go:356] "Generic (PLEG): container finished" podID="43d107a5-363b-4aae-add9-cd2300e5f041" containerID="8c8f5b158840110659eb97996787a93e1ce644d0c3ef0f3385e9a656f9afb652" exitCode=0
Jul 20 20:00:02.180954 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:02.180476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7" event={"ID":"43d107a5-363b-4aae-add9-cd2300e5f041","Type":"ContainerDied","Data":"8c8f5b158840110659eb97996787a93e1ce644d0c3ef0f3385e9a656f9afb652"}
Jul 20 20:00:02.182052 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:02.182031    2571 generic.go:356] "Generic (PLEG): container finished" podID="7dba2330-f48c-40da-acd5-db2b85e2938b" containerID="e0a685a1945893891e811c0ba7fffe3d5a630e5c281e3bcc28910027171057e8" exitCode=0
Jul 20 20:00:02.182167 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:02.182093    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6" event={"ID":"7dba2330-f48c-40da-acd5-db2b85e2938b","Type":"ContainerDied","Data":"e0a685a1945893891e811c0ba7fffe3d5a630e5c281e3bcc28910027171057e8"}
Jul 20 20:00:03.329087 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:03.329063    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"
Jul 20 20:00:03.331921 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:03.331903    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"
Jul 20 20:00:04.193914 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.193883    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6"
Jul 20 20:00:04.194100 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.193923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742960-md4l6" event={"ID":"7dba2330-f48c-40da-acd5-db2b85e2938b","Type":"ContainerDied","Data":"e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658"}
Jul 20 20:00:04.194100 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.193971    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e19859aff13939bf52bbf1886e45efb8364e9fbbeb0ab9b6ba04d83864f5f658"
Jul 20 20:00:04.195225 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.195203    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7" event={"ID":"43d107a5-363b-4aae-add9-cd2300e5f041","Type":"ContainerDied","Data":"02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1"}
Jul 20 20:00:04.195364 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.195246    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02a956caf4221c67f8845ef57cf380318d5b4cc0f90ec039b19c2efddac353d1"
Jul 20 20:00:04.195364 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.195215    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"
Jul 20 20:00:04.938497 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938461    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"]
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938810    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d107a5-363b-4aae-add9-cd2300e5f041" containerName="cleanup"
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938824    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d107a5-363b-4aae-add9-cd2300e5f041" containerName="cleanup"
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938834    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dba2330-f48c-40da-acd5-db2b85e2938b" containerName="cleanup"
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938840    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dba2330-f48c-40da-acd5-db2b85e2938b" containerName="cleanup"
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938902    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="43d107a5-363b-4aae-add9-cd2300e5f041" containerName="cleanup"
Jul 20 20:00:04.939016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.938912    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dba2330-f48c-40da-acd5-db2b85e2938b" containerName="cleanup"
Jul 20 20:00:04.941883 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.941856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:04.944731 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.944705    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:00:04.950996 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.950972    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"]
Jul 20 20:00:04.982183 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:04.982154    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc\" (UID: \"e668c68a-db38-40ad-815d-f2a7a54ab84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:05.083321 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:05.083288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc\" (UID: \"e668c68a-db38-40ad-815d-f2a7a54ab84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:05.083947 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:05.083914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc\" (UID: \"e668c68a-db38-40ad-815d-f2a7a54ab84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:05.255540 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:05.255507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:05.389823 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:05.387168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"]
Jul 20 20:00:05.391379 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:00:05.391350    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode668c68a_db38_40ad_815d_f2a7a54ab84d.slice/crio-10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5 WatchSource:0}: Error finding container 10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5: Status 404 returned error can't find the container with id 10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5
Jul 20 20:00:06.205025 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:06.204986    2571 generic.go:356] "Generic (PLEG): container finished" podID="e668c68a-db38-40ad-815d-f2a7a54ab84d" containerID="9d42032ab952bb0642f14e2689c7f486abb88ddb5dc2fe45b3bb0927e5fd553d" exitCode=0
Jul 20 20:00:06.205397 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:06.205033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc" event={"ID":"e668c68a-db38-40ad-815d-f2a7a54ab84d","Type":"ContainerDied","Data":"9d42032ab952bb0642f14e2689c7f486abb88ddb5dc2fe45b3bb0927e5fd553d"}
Jul 20 20:00:06.205397 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:06.205071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc" event={"ID":"e668c68a-db38-40ad-815d-f2a7a54ab84d","Type":"ContainerStarted","Data":"10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5"}
Jul 20 20:00:07.336620 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:07.336591    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:07.401955 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:07.401916    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca\") pod \"e668c68a-db38-40ad-815d-f2a7a54ab84d\" (UID: \"e668c68a-db38-40ad-815d-f2a7a54ab84d\") "
Jul 20 20:00:07.402272 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:07.402250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e668c68a-db38-40ad-815d-f2a7a54ab84d" (UID: "e668c68a-db38-40ad-815d-f2a7a54ab84d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:07.502410 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:07.502377    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e668c68a-db38-40ad-815d-f2a7a54ab84d-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:08.214816 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:08.214785    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"
Jul 20 20:00:08.215022 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:08.214783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc" event={"ID":"e668c68a-db38-40ad-815d-f2a7a54ab84d","Type":"ContainerDied","Data":"10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5"}
Jul 20 20:00:08.215022 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:08.214905    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10ce663dd49e1af83632b4cd446cbbca40430869ffba465b7dca77ee4c68c7a5"
Jul 20 20:00:15.449126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.449091    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 20:00:15.449564 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.449291    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" podUID="43272afa-3272-4341-90d0-812e109eb1d5" containerName="maas-api" containerID="cri-o://4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d" gracePeriod=30
Jul 20 20:00:15.465001 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.464978    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"]
Jul 20 20:00:15.469126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.469103    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a2049ed7-29742960-kljb7"]
Jul 20 20:00:15.476126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.476105    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:15.546929 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.546893    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43d107a5-363b-4aae-add9-cd2300e5f041" path="/var/lib/kubelet/pods/43d107a5-363b-4aae-add9-cd2300e5f041/volumes"
Jul 20 20:00:15.688817 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.688793    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 20:00:15.771418 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.771383    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgvj\" (UniqueName: \"kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj\") pod \"43272afa-3272-4341-90d0-812e109eb1d5\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") "
Jul 20 20:00:15.771595 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.771447    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca\") pod \"43272afa-3272-4341-90d0-812e109eb1d5\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") "
Jul 20 20:00:15.771595 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.771493    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") pod \"43272afa-3272-4341-90d0-812e109eb1d5\" (UID: \"43272afa-3272-4341-90d0-812e109eb1d5\") "
Jul 20 20:00:15.771864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.771839    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "43272afa-3272-4341-90d0-812e109eb1d5" (UID: "43272afa-3272-4341-90d0-812e109eb1d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:15.773610 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.773583    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj" (OuterVolumeSpecName: "kube-api-access-srgvj") pod "43272afa-3272-4341-90d0-812e109eb1d5" (UID: "43272afa-3272-4341-90d0-812e109eb1d5"). InnerVolumeSpecName "kube-api-access-srgvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:15.773737 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.773636    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "43272afa-3272-4341-90d0-812e109eb1d5" (UID: "43272afa-3272-4341-90d0-812e109eb1d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:00:15.872343 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.872311    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43272afa-3272-4341-90d0-812e109eb1d5-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:15.872343 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.872338    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43272afa-3272-4341-90d0-812e109eb1d5-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:15.872343 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:15.872347    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgvj\" (UniqueName: \"kubernetes.io/projected/43272afa-3272-4341-90d0-812e109eb1d5-kube-api-access-srgvj\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:16.253365 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.253326    2571 generic.go:356] "Generic (PLEG): container finished" podID="43272afa-3272-4341-90d0-812e109eb1d5" containerID="4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d" exitCode=0
Jul 20 20:00:16.253547 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.253382    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"
Jul 20 20:00:16.253547 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.253381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" event={"ID":"43272afa-3272-4341-90d0-812e109eb1d5","Type":"ContainerDied","Data":"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"}
Jul 20 20:00:16.253547 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.253497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7" event={"ID":"43272afa-3272-4341-90d0-812e109eb1d5","Type":"ContainerDied","Data":"29caa560900d8881580fcbc6d5d0c48445781de3262760091e09d4923f4d6b66"}
Jul 20 20:00:16.253677 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.253548    2571 scope.go:117] "RemoveContainer" containerID="4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"
Jul 20 20:00:16.262720 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.262702    2571 scope.go:117] "RemoveContainer" containerID="4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"
Jul 20 20:00:16.263002 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:00:16.262983    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d\": container with ID starting with 4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d not found: ID does not exist" containerID="4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"
Jul 20 20:00:16.263068 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.263012    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d"} err="failed to get container status \"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d\": rpc error: code = NotFound desc = could not find container \"4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d\": container with ID starting with 4e24071471a14e73707e45cfbdd5c539a2a57f241d9b93a32b26b46c226b958d not found: ID does not exist"
Jul 20 20:00:16.275624 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.275600    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 20:00:16.281751 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:16.281729    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a2049ed7-7d6888449-rttl7"]
Jul 20 20:00:17.547751 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:17.547715    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43272afa-3272-4341-90d0-812e109eb1d5" path="/var/lib/kubelet/pods/43272afa-3272-4341-90d0-812e109eb1d5/volumes"
Jul 20 20:00:20.041726 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.041691    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"]
Jul 20 20:00:20.044132 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.044105    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2049ed7-vbqdc"]
Jul 20 20:00:20.112192 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.112158    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:20.200157 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.200123    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:20.444966 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.444876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:20.691619 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:20.691587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:21.037019 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:21.036989    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:21.381879 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:21.381793    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:21.547273 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:21.547240    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e668c68a-db38-40ad-815d-f2a7a54ab84d" path="/var/lib/kubelet/pods/e668c68a-db38-40ad-815d-f2a7a54ab84d/volumes"
Jul 20 20:00:22.926685 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:22.926648    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:23.019279 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.019241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:23.145609 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.145569    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:00:23.145979 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.145961    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43272afa-3272-4341-90d0-812e109eb1d5" containerName="maas-api"
Jul 20 20:00:23.146074 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.145981    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="43272afa-3272-4341-90d0-812e109eb1d5" containerName="maas-api"
Jul 20 20:00:23.146074 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.146009    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e668c68a-db38-40ad-815d-f2a7a54ab84d" containerName="revoke-keys"
Jul 20 20:00:23.146074 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.146018    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e668c68a-db38-40ad-815d-f2a7a54ab84d" containerName="revoke-keys"
Jul 20 20:00:23.146217 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.146096    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="43272afa-3272-4341-90d0-812e109eb1d5" containerName="maas-api"
Jul 20 20:00:23.146217 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.146109    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e668c68a-db38-40ad-815d-f2a7a54ab84d" containerName="revoke-keys"
Jul 20 20:00:23.150317 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.150294    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.153675 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.153657    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8b313d06-serving-cert\""
Jul 20 20:00:23.168407 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.168386    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:00:23.196411 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.196338    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:23.235116 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.235080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.235263 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.235152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.235263 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.235176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2w5\" (UniqueName: \"kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.336288 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.336260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.336441 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.336406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.336441 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:00:23.336416    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-serving-cert: secret "maas-api-e2e-ait-8b313d06-serving-cert" not found
Jul 20 20:00:23.336441 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.336427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2w5\" (UniqueName: \"kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.336615 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:00:23.336492    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls podName:c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b nodeName:}" failed. No retries permitted until 2026-07-20 20:00:23.83647164 +0000 UTC m=+1965.938934982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls") pod "maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" (UID: "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b") : secret "maas-api-e2e-ait-8b313d06-serving-cert" not found
Jul 20 20:00:23.337102 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.337085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.348971 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.348949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2w5\" (UniqueName: \"kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.840537 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.840503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:23.840710 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:00:23.840652    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-serving-cert: secret "maas-api-e2e-ait-8b313d06-serving-cert" not found
Jul 20 20:00:23.840774 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:00:23.840725    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls podName:c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b nodeName:}" failed. No retries permitted until 2026-07-20 20:00:24.840709749 +0000 UTC m=+1966.943173079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls") pod "maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" (UID: "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b") : secret "maas-api-e2e-ait-8b313d06-serving-cert" not found
Jul 20 20:00:23.881743 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.881706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:23.983225 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:23.983187    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:24.291653 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:24.291624    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:24.850279 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:24.850246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:24.852730 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:24.852708    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:24.960243 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:24.960198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:25.100699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:25.100632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:00:25.101572 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:00:25.101550    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39a6840_56d3_4f4d_8b29_1e1bdfad5b5b.slice/crio-4a676a5e23dde6e5e4a7852af772e963f9730d3531d63cd4e3588f6fb44b17ae WatchSource:0}: Error finding container 4a676a5e23dde6e5e4a7852af772e963f9730d3531d63cd4e3588f6fb44b17ae: Status 404 returned error can't find the container with id 4a676a5e23dde6e5e4a7852af772e963f9730d3531d63cd4e3588f6fb44b17ae
Jul 20 20:00:25.300144 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:25.300107    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" event={"ID":"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b","Type":"ContainerStarted","Data":"4a676a5e23dde6e5e4a7852af772e963f9730d3531d63cd4e3588f6fb44b17ae"}
Jul 20 20:00:27.310963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:27.310927    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" event={"ID":"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b","Type":"ContainerStarted","Data":"324395a906ef9c5b82f75ed3bb89756b11dc62536e80e291ec6fdfcb687c9e31"}
Jul 20 20:00:27.311391 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:27.311056    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:27.329569 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:27.329523    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" podStartSLOduration=3.016635968 podStartE2EDuration="4.329505731s" totalImagesPullingTime="1.312869763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:27.329156773 +0000 UTC m=+1969.431620188" watchObservedRunningTime="2026-07-20 20:00:27.329505731 +0000 UTC m=+1969.431969079"
Jul 20 20:00:33.321782 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:33.321681    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:38.908638 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:38.908608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:39.011877 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:39.011839    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:45.916321 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:45.916275    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:46.018987 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:46.018956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:48.852017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:48.851982    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"]
Jul 20 20:00:48.855270 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:48.855255    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:48.858334 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:48.858311    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:00:48.866365 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:48.866339    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"]
Jul 20 20:00:48.959191 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:48.959152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv\" (UID: \"09516b22-5f4b-4654-8af4-033e2016d358\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:49.060541 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:49.060499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv\" (UID: \"09516b22-5f4b-4654-8af4-033e2016d358\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:49.061253 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:49.061219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv\" (UID: \"09516b22-5f4b-4654-8af4-033e2016d358\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:49.164956 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:49.164864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:49.293752 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:49.293650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"]
Jul 20 20:00:49.296454 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:00:49.296423    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09516b22_5f4b_4654_8af4_033e2016d358.slice/crio-b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af WatchSource:0}: Error finding container b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af: Status 404 returned error can't find the container with id b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af
Jul 20 20:00:49.414136 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:49.414094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv" event={"ID":"09516b22-5f4b-4654-8af4-033e2016d358","Type":"ContainerStarted","Data":"b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af"}
Jul 20 20:00:50.420573 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:50.420539    2571 generic.go:356] "Generic (PLEG): container finished" podID="09516b22-5f4b-4654-8af4-033e2016d358" containerID="2c033c1028a67c902736fc059ecc54331ab15b95342ed1264628a927f4dcd7e7" exitCode=0
Jul 20 20:00:50.420975 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:50.420640    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv" event={"ID":"09516b22-5f4b-4654-8af4-033e2016d358","Type":"ContainerDied","Data":"2c033c1028a67c902736fc059ecc54331ab15b95342ed1264628a927f4dcd7e7"}
Jul 20 20:00:51.550842 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:51.550818    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:51.682530 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:51.682441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca\") pod \"09516b22-5f4b-4654-8af4-033e2016d358\" (UID: \"09516b22-5f4b-4654-8af4-033e2016d358\") "
Jul 20 20:00:51.682819 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:51.682797    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "09516b22-5f4b-4654-8af4-033e2016d358" (UID: "09516b22-5f4b-4654-8af4-033e2016d358"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:51.783381 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:51.783346    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09516b22-5f4b-4654-8af4-033e2016d358-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:52.436731 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:52.436690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv" event={"ID":"09516b22-5f4b-4654-8af4-033e2016d358","Type":"ContainerDied","Data":"b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af"}
Jul 20 20:00:52.436920 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:52.436706    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"
Jul 20 20:00:52.436920 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:52.436799    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b87ac70be075626d3a8411677f7ecacebee2553d7d756ae7eaa2c1a2ba5837af"
Jul 20 20:00:59.320694 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.319902    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:00:59.320694 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.320141    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" podUID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" containerName="maas-api" containerID="cri-o://324395a906ef9c5b82f75ed3bb89756b11dc62536e80e291ec6fdfcb687c9e31" gracePeriod=30
Jul 20 20:00:59.453479 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.453432    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:59.470341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.470310    2571 generic.go:356] "Generic (PLEG): container finished" podID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" containerID="324395a906ef9c5b82f75ed3bb89756b11dc62536e80e291ec6fdfcb687c9e31" exitCode=0
Jul 20 20:00:59.470491 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.470373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" event={"ID":"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b","Type":"ContainerDied","Data":"324395a906ef9c5b82f75ed3bb89756b11dc62536e80e291ec6fdfcb687c9e31"}
Jul 20 20:00:59.563986 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.563962    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:00:59.647260 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.647169    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd2w5\" (UniqueName: \"kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5\") pod \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") "
Jul 20 20:00:59.647260 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.647218    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca\") pod \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") "
Jul 20 20:00:59.647495 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.647277    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") pod \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\" (UID: \"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b\") "
Jul 20 20:00:59.647677 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.647654    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" (UID: "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:59.649396 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.649373    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5" (OuterVolumeSpecName: "kube-api-access-gd2w5") pod "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" (UID: "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b"). InnerVolumeSpecName "kube-api-access-gd2w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:59.649491 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.649396    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" (UID: "c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:00:59.748168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.748137    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd2w5\" (UniqueName: \"kubernetes.io/projected/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-kube-api-access-gd2w5\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:59.748168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.748164    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:00:59.748168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:00:59.748174    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:01:00.475677 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:00.475638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t" event={"ID":"c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b","Type":"ContainerDied","Data":"4a676a5e23dde6e5e4a7852af772e963f9730d3531d63cd4e3588f6fb44b17ae"}
Jul 20 20:01:00.476101 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:00.475686    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"
Jul 20 20:01:00.476101 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:00.475727    2571 scope.go:117] "RemoveContainer" containerID="324395a906ef9c5b82f75ed3bb89756b11dc62536e80e291ec6fdfcb687c9e31"
Jul 20 20:01:00.501740 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:00.501717    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:01:00.505168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:00.505145    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8b313d06-77dc6b8db5-8lq8t"]
Jul 20 20:01:01.547899 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:01.547863    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" path="/var/lib/kubelet/pods/c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b/volumes"
Jul 20 20:01:03.938984 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:03.938951    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"]
Jul 20 20:01:03.941490 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:03.941464    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b313d06-j5jfv"]
Jul 20 20:01:04.177667 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:04.177637    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:05.238117 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:05.238082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:05.483428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:05.483395    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:05.546998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:05.546905    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09516b22-5f4b-4654-8af4-033e2016d358" path="/var/lib/kubelet/pods/09516b22-5f4b-4654-8af4-033e2016d358/volumes"
Jul 20 20:01:05.753290 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:05.753249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:06.154109 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:06.154075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:06.375197 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:06.375166    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.190390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.190351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.291296 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.291261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.392182 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392147    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:08.392580 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392559    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09516b22-5f4b-4654-8af4-033e2016d358" containerName="revoke-keys"
Jul 20 20:01:08.392650 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392584    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="09516b22-5f4b-4654-8af4-033e2016d358" containerName="revoke-keys"
Jul 20 20:01:08.392650 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392601    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" containerName="maas-api"
Jul 20 20:01:08.392650 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392610    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" containerName="maas-api"
Jul 20 20:01:08.392806 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392733    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c39a6840-56d3-4f4d-8b29-1e1bdfad5b5b" containerName="maas-api"
Jul 20 20:01:08.392806 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.392749    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="09516b22-5f4b-4654-8af4-033e2016d358" containerName="revoke-keys"
Jul 20 20:01:08.397131 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.397115    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.400053 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.400035    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-06dcaf8a-serving-cert\""
Jul 20 20:01:08.407015 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.406991    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:08.421436 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.421411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.421548 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.421472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5m9s\" (UniqueName: \"kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.421548 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.421504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.431905 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.431877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.522166 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.522135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5m9s\" (UniqueName: \"kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.522346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.522177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.522346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.522218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.522428 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:01:08.522361    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-serving-cert: secret "maas-api-e2e-derive-06dcaf8a-serving-cert" not found
Jul 20 20:01:08.522428 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:01:08.522423    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls podName:0e4b0508-d886-4e28-9774-085dd10472af nodeName:}" failed. No retries permitted until 2026-07-20 20:01:09.022406913 +0000 UTC m=+2011.124870242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls") pod "maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" (UID: "0e4b0508-d886-4e28-9774-085dd10472af") : secret "maas-api-e2e-derive-06dcaf8a-serving-cert" not found
Jul 20 20:01:08.522905 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.522887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.531320 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.531297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5m9s\" (UniqueName: \"kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:08.694258 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.694228    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.987132 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:08.987104    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:09.026510 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.026483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:09.029015 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.028993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") pod \"maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:09.087464 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.087436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:09.309259 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.309167    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:09.444968 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.444919    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:09.447497 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:01:09.447466    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4b0508_d886_4e28_9774_085dd10472af.slice/crio-bcf0369ae91f218d99d1fd7cac97dec4aebb86d1e14343e59d52a6c1569ca917 WatchSource:0}: Error finding container bcf0369ae91f218d99d1fd7cac97dec4aebb86d1e14343e59d52a6c1569ca917: Status 404 returned error can't find the container with id bcf0369ae91f218d99d1fd7cac97dec4aebb86d1e14343e59d52a6c1569ca917
Jul 20 20:01:09.520359 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:09.520326    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" event={"ID":"0e4b0508-d886-4e28-9774-085dd10472af","Type":"ContainerStarted","Data":"bcf0369ae91f218d99d1fd7cac97dec4aebb86d1e14343e59d52a6c1569ca917"}
Jul 20 20:01:11.536386 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:11.536339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" event={"ID":"0e4b0508-d886-4e28-9774-085dd10472af","Type":"ContainerStarted","Data":"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"}
Jul 20 20:01:11.536847 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:11.536441    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:11.555683 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:11.555628    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" podStartSLOduration=2.313865082 podStartE2EDuration="3.555614236s" totalImagesPullingTime="1.241749154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:01:11.553905269 +0000 UTC m=+2013.656368621" watchObservedRunningTime="2026-07-20 20:01:11.555614236 +0000 UTC m=+2013.658077758"
Jul 20 20:01:17.547872 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:17.547835    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:33.096511 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.096473    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"]
Jul 20 20:01:33.101082 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.101061    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:33.103920 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.103894    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:01:33.107439 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.107416    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"]
Jul 20 20:01:33.239524 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.239492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7\" (UID: \"9dad0775-5b1b-4e38-9a10-25ebd2a9234d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:33.340215 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.340177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7\" (UID: \"9dad0775-5b1b-4e38-9a10-25ebd2a9234d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:33.340868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.340848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7\" (UID: \"9dad0775-5b1b-4e38-9a10-25ebd2a9234d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:33.413653 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.413578    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:33.548661 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:01:33.548630    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dad0775_5b1b_4e38_9a10_25ebd2a9234d.slice/crio-b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623 WatchSource:0}: Error finding container b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623: Status 404 returned error can't find the container with id b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623
Jul 20 20:01:33.548661 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.548634    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"]
Jul 20 20:01:33.639560 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:33.639526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7" event={"ID":"9dad0775-5b1b-4e38-9a10-25ebd2a9234d","Type":"ContainerStarted","Data":"b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623"}
Jul 20 20:01:34.645867 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:34.645749    2571 generic.go:356] "Generic (PLEG): container finished" podID="9dad0775-5b1b-4e38-9a10-25ebd2a9234d" containerID="f9f1cb0a80cd9bef16b3acddc170aa4ac997bb8258f05e36808bebb0787bf6a7" exitCode=0
Jul 20 20:01:34.645867 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:34.645796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7" event={"ID":"9dad0775-5b1b-4e38-9a10-25ebd2a9234d","Type":"ContainerDied","Data":"f9f1cb0a80cd9bef16b3acddc170aa4ac997bb8258f05e36808bebb0787bf6a7"}
Jul 20 20:01:35.775043 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:35.775021    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:35.859100 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:35.859062    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca\") pod \"9dad0775-5b1b-4e38-9a10-25ebd2a9234d\" (UID: \"9dad0775-5b1b-4e38-9a10-25ebd2a9234d\") "
Jul 20 20:01:35.859444 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:35.859421    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9dad0775-5b1b-4e38-9a10-25ebd2a9234d" (UID: "9dad0775-5b1b-4e38-9a10-25ebd2a9234d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:01:35.960538 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:35.960447    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dad0775-5b1b-4e38-9a10-25ebd2a9234d-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:01:36.655852 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:36.655819    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"
Jul 20 20:01:36.656159 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:36.655859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7" event={"ID":"9dad0775-5b1b-4e38-9a10-25ebd2a9234d","Type":"ContainerDied","Data":"b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623"}
Jul 20 20:01:36.656159 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:36.655905    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b15773efbfca22308177f41e26ce854bae6b205ccf9ba324066652f3364f6623"
Jul 20 20:01:43.806294 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:43.806256    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:43.806667 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:43.806457    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" podUID="0e4b0508-d886-4e28-9774-085dd10472af" containerName="maas-api" containerID="cri-o://3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c" gracePeriod=30
Jul 20 20:01:43.870442 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:43.870411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:44.048788 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.048748    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:44.234572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.234538    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") pod \"0e4b0508-d886-4e28-9774-085dd10472af\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") "
Jul 20 20:01:44.234736 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.234581    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca\") pod \"0e4b0508-d886-4e28-9774-085dd10472af\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") "
Jul 20 20:01:44.234817 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.234751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5m9s\" (UniqueName: \"kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s\") pod \"0e4b0508-d886-4e28-9774-085dd10472af\" (UID: \"0e4b0508-d886-4e28-9774-085dd10472af\") "
Jul 20 20:01:44.235052 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.235018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e4b0508-d886-4e28-9774-085dd10472af" (UID: "0e4b0508-d886-4e28-9774-085dd10472af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:01:44.236667 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.236632    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e4b0508-d886-4e28-9774-085dd10472af" (UID: "0e4b0508-d886-4e28-9774-085dd10472af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:01:44.236798 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.236724    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s" (OuterVolumeSpecName: "kube-api-access-f5m9s") pod "0e4b0508-d886-4e28-9774-085dd10472af" (UID: "0e4b0508-d886-4e28-9774-085dd10472af"). InnerVolumeSpecName "kube-api-access-f5m9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:01:44.335675 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.335636    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5m9s\" (UniqueName: \"kubernetes.io/projected/0e4b0508-d886-4e28-9774-085dd10472af-kube-api-access-f5m9s\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:01:44.335675 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.335667    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4b0508-d886-4e28-9774-085dd10472af-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:01:44.335675 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.335678    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4b0508-d886-4e28-9774-085dd10472af-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:01:44.692139 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.692049    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e4b0508-d886-4e28-9774-085dd10472af" containerID="3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c" exitCode=0
Jul 20 20:01:44.692139 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.692117    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"
Jul 20 20:01:44.692338 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.692137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" event={"ID":"0e4b0508-d886-4e28-9774-085dd10472af","Type":"ContainerDied","Data":"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"}
Jul 20 20:01:44.692338 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.692198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr" event={"ID":"0e4b0508-d886-4e28-9774-085dd10472af","Type":"ContainerDied","Data":"bcf0369ae91f218d99d1fd7cac97dec4aebb86d1e14343e59d52a6c1569ca917"}
Jul 20 20:01:44.692338 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.692224    2571 scope.go:117] "RemoveContainer" containerID="3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"
Jul 20 20:01:44.702899 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.702879    2571 scope.go:117] "RemoveContainer" containerID="3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"
Jul 20 20:01:44.703150 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:01:44.703129    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c\": container with ID starting with 3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c not found: ID does not exist" containerID="3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"
Jul 20 20:01:44.703227 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.703162    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c"} err="failed to get container status \"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c\": rpc error: code = NotFound desc = could not find container \"3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c\": container with ID starting with 3e10554c6d4daa028c33bbc34815871d614a98246d7ea16f6d2c88deb5637d4c not found: ID does not exist"
Jul 20 20:01:44.716797 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.716746    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:44.726334 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:44.726305    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-06dcaf8a-559d89cdb8-86snr"]
Jul 20 20:01:45.546728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:45.546693    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4b0508-d886-4e28-9774-085dd10472af" path="/var/lib/kubelet/pods/0e4b0508-d886-4e28-9774-085dd10472af/volumes"
Jul 20 20:01:48.182352 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:48.182313    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:48.186912 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:48.186877    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"]
Jul 20 20:01:48.189272 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:48.189248    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-06dcaf8a-j2rq7"]
Jul 20 20:01:48.373009 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:48.372971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:48.599288 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:48.599253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:49.114882 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:49.114848    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:49.211378 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:49.211336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:49.313275 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:49.313240    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:49.547101 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:49.547070    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dad0775-5b1b-4e38-9a10-25ebd2a9234d" path="/var/lib/kubelet/pods/9dad0775-5b1b-4e38-9a10-25ebd2a9234d/volumes"
Jul 20 20:01:51.410513 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:51.410471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:57.260539 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:57.260499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:57.377986 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:57.377950    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:57.513478 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:57.513403    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:57.646129 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:57.646090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:58.090205 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:01:58.090173    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:24.163847 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:24.163814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:30.936137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:30.936102    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:31.046161 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:31.046126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:31.156072 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:31.156037    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:39.337677 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:39.337641    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:02:39.341119 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:39.341097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:02:47.173940 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:47.173902    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:53.053963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:53.053917    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:53.199200 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:53.199162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:02:53.293612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:02:53.293577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:03.916963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:03.916927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:04.873693 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:04.873652    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:07.626853 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:07.626820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:11.506596 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:11.506559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:11.612806 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:11.612749    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:11.736318 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:11.736285    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:11.828062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:11.827968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:12.698845 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:12.698785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:12.789914 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:12.789880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:12.890010 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:12.889976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:14.550864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:14.550831    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:17.524955 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:17.524915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:21.250017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:21.249979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:21.350929 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:21.350893    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:22.166253 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:22.166217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:29.525282 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:29.525244    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:29.627996 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:29.627965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:29.869333 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:29.869252    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:30.059728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:30.059695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:32.815192 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.815154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:32.934649 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.934603    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:32.952934 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.952887    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:32.953487 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953466    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dad0775-5b1b-4e38-9a10-25ebd2a9234d" containerName="revoke-keys"
Jul 20 20:03:32.953660 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953487    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dad0775-5b1b-4e38-9a10-25ebd2a9234d" containerName="revoke-keys"
Jul 20 20:03:32.953660 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953518    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4b0508-d886-4e28-9774-085dd10472af" containerName="maas-api"
Jul 20 20:03:32.953660 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953527    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4b0508-d886-4e28-9774-085dd10472af" containerName="maas-api"
Jul 20 20:03:32.953660 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953618    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4b0508-d886-4e28-9774-085dd10472af" containerName="maas-api"
Jul 20 20:03:32.953660 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.953634    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dad0775-5b1b-4e38-9a10-25ebd2a9234d" containerName="revoke-keys"
Jul 20 20:03:32.956973 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.956953    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:32.960181 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.960159    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-166791b0-serving-cert\""
Jul 20 20:03:32.981776 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:32.981733    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:33.038156 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.038119    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lw85\" (UniqueName: \"kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.038334 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.038184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.038334 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.038203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.082808 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.082706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:33.139418 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.139377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.139418 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.139417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.139664 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.139496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lw85\" (UniqueName: \"kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.139664 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:03:33.139530    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-serving-cert: secret "maas-api-e2e-mt-166791b0-serving-cert" not found
Jul 20 20:03:33.139664 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:03:33.139610    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls podName:b27a7a0a-afa8-4352-93dd-c88a4abf739e nodeName:}" failed. No retries permitted until 2026-07-20 20:03:33.639589951 +0000 UTC m=+2155.742053278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls") pod "maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" (UID: "b27a7a0a-afa8-4352-93dd-c88a4abf739e") : secret "maas-api-e2e-mt-166791b0-serving-cert" not found
Jul 20 20:03:33.140172 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.140152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.151099 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.151077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lw85\" (UniqueName: \"kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.479397 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.479365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:33.597184 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.597151    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:33.644837 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.644805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.647359 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.647337    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") pod \"maas-api-e2e-mt-166791b0-59d8645f6f-wfflm\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:33.697857 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.697824    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:33.867885 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:33.867799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:34.010066 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:34.010039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:34.012957 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:03:34.012925    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27a7a0a_afa8_4352_93dd_c88a4abf739e.slice/crio-1309a5a312e84039a67b8ffca33e7d0d29dfb3bc2d74849780d665025282f070 WatchSource:0}: Error finding container 1309a5a312e84039a67b8ffca33e7d0d29dfb3bc2d74849780d665025282f070: Status 404 returned error can't find the container with id 1309a5a312e84039a67b8ffca33e7d0d29dfb3bc2d74849780d665025282f070
Jul 20 20:03:34.181432 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:34.181345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" event={"ID":"b27a7a0a-afa8-4352-93dd-c88a4abf739e","Type":"ContainerStarted","Data":"1309a5a312e84039a67b8ffca33e7d0d29dfb3bc2d74849780d665025282f070"}
Jul 20 20:03:35.187456 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:35.187422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" event={"ID":"b27a7a0a-afa8-4352-93dd-c88a4abf739e","Type":"ContainerStarted","Data":"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"}
Jul 20 20:03:35.187947 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:35.187530    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:35.207314 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:35.207263    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" podStartSLOduration=2.604421786 podStartE2EDuration="3.207246537s" totalImagesPullingTime="602.824751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:03:35.205549992 +0000 UTC m=+2157.308013342" watchObservedRunningTime="2026-07-20 20:03:35.207246537 +0000 UTC m=+2157.309709887"
Jul 20 20:03:37.309213 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:37.309180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:38.074955 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:38.074923    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:38.180457 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:38.180422    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:38.525355 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:38.525321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:41.198697 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:41.198666    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:44.518838 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.518804    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:44.614675 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.614642    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:44.938889 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.938794    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"]
Jul 20 20:03:44.941999 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.941975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:44.942535 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.942504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166791b0-6rsl8\" (UID: \"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:44.944822 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.944804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:03:44.955098 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:44.955074    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"]
Jul 20 20:03:45.043560 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:45.043517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166791b0-6rsl8\" (UID: \"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:45.044221 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:45.044196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166791b0-6rsl8\" (UID: \"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:45.255576 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:45.255546    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:45.382818 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:45.382795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"]
Jul 20 20:03:45.385454 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:03:45.385421    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cd0f4d_9c2e_4a59_b1e4_d21fdeeb8611.slice/crio-dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43 WatchSource:0}: Error finding container dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43: Status 404 returned error can't find the container with id dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43
Jul 20 20:03:46.238056 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:46.238017    2571 generic.go:356] "Generic (PLEG): container finished" podID="e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" containerID="eea2fd6dfe8cd85bef58f9c918b6a65cab4263184218a8334b6c61fbc7156720" exitCode=0
Jul 20 20:03:46.238482 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:46.238115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8" event={"ID":"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611","Type":"ContainerDied","Data":"eea2fd6dfe8cd85bef58f9c918b6a65cab4263184218a8334b6c61fbc7156720"}
Jul 20 20:03:46.238482 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:46.238189    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8" event={"ID":"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611","Type":"ContainerStarted","Data":"dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43"}
Jul 20 20:03:47.375384 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:47.375360    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:47.463051 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:47.463011    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca\") pod \"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611\" (UID: \"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611\") "
Jul 20 20:03:47.463392 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:47.463365    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" (UID: "e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:03:47.563711 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:47.563680    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:03:48.248577 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:48.248552    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"
Jul 20 20:03:48.248727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:48.248545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8" event={"ID":"e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611","Type":"ContainerDied","Data":"dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43"}
Jul 20 20:03:48.248727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:48.248676    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfac034cb5eb6b1759ce4db19136869b9156c0e2644dfb104423c8dd4ab45b43"
Jul 20 20:03:55.536126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.536089    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:55.538605 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.536316    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" podUID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" containerName="maas-api" containerID="cri-o://1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee" gracePeriod=30
Jul 20 20:03:55.584747 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.584711    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:03:55.780705 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.780676    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:55.822707 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.822637    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") pod \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") "
Jul 20 20:03:55.822707 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.822692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca\") pod \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") "
Jul 20 20:03:55.822940 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.822841    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lw85\" (UniqueName: \"kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85\") pod \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\" (UID: \"b27a7a0a-afa8-4352-93dd-c88a4abf739e\") "
Jul 20 20:03:55.823083 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.823057    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b27a7a0a-afa8-4352-93dd-c88a4abf739e" (UID: "b27a7a0a-afa8-4352-93dd-c88a4abf739e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:03:55.824851 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.824815    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85" (OuterVolumeSpecName: "kube-api-access-9lw85") pod "b27a7a0a-afa8-4352-93dd-c88a4abf739e" (UID: "b27a7a0a-afa8-4352-93dd-c88a4abf739e"). InnerVolumeSpecName "kube-api-access-9lw85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:03:55.824851 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.824833    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b27a7a0a-afa8-4352-93dd-c88a4abf739e" (UID: "b27a7a0a-afa8-4352-93dd-c88a4abf739e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:03:55.924421 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.924382    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lw85\" (UniqueName: \"kubernetes.io/projected/b27a7a0a-afa8-4352-93dd-c88a4abf739e-kube-api-access-9lw85\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:03:55.924421 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.924416    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b27a7a0a-afa8-4352-93dd-c88a4abf739e-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:03:55.924421 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:55.924429    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27a7a0a-afa8-4352-93dd-c88a4abf739e-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:03:56.289388 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.289351    2571 generic.go:356] "Generic (PLEG): container finished" podID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" containerID="1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee" exitCode=0
Jul 20 20:03:56.289585 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.289393    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"
Jul 20 20:03:56.289585 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.289442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" event={"ID":"b27a7a0a-afa8-4352-93dd-c88a4abf739e","Type":"ContainerDied","Data":"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"}
Jul 20 20:03:56.289585 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.289504    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm" event={"ID":"b27a7a0a-afa8-4352-93dd-c88a4abf739e","Type":"ContainerDied","Data":"1309a5a312e84039a67b8ffca33e7d0d29dfb3bc2d74849780d665025282f070"}
Jul 20 20:03:56.289585 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.289539    2571 scope.go:117] "RemoveContainer" containerID="1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"
Jul 20 20:03:56.298612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.298596    2571 scope.go:117] "RemoveContainer" containerID="1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"
Jul 20 20:03:56.298909 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:03:56.298890    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee\": container with ID starting with 1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee not found: ID does not exist" containerID="1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"
Jul 20 20:03:56.298955 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.298918    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee"} err="failed to get container status \"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee\": rpc error: code = NotFound desc = could not find container \"1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee\": container with ID starting with 1916157f2a5222195a50afdf5ad316427f5b1c630a008fd31dd743f905045fee not found: ID does not exist"
Jul 20 20:03:56.310420 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.310399    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:56.314600 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:56.314579    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166791b0-59d8645f6f-wfflm"]
Jul 20 20:03:57.547341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:03:57.547305    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" path="/var/lib/kubelet/pods/b27a7a0a-afa8-4352-93dd-c88a4abf739e/volumes"
Jul 20 20:04:00.109991 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:00.109954    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:00.122673 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:00.122638    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"]
Jul 20 20:04:00.127137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:00.127115    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166791b0-6rsl8"]
Jul 20 20:04:01.371618 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:01.371565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:01.547067 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:01.547036    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" path="/var/lib/kubelet/pods/e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611/volumes"
Jul 20 20:04:06.383133 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:06.383073    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:06.448895 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:06.448861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:06.678095 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:06.677969    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:06.980287 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:06.980244    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:07.073485 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:07.073446    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:07.284610 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:07.284511    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:13.113034 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:13.112962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:13.223097 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:13.223056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:13.317082 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:13.317043    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:13.494748 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:13.494715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:19.529699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:19.529664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:19.631034 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:19.631003    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:26.536102 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:26.536060    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:26.871048 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:26.870961    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:27.287029 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:27.286997    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:29.954397 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:29.954332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:30.040886 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.040848    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:04:30.041168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041154    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" containerName="revoke-keys"
Jul 20 20:04:30.041168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041166    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" containerName="revoke-keys"
Jul 20 20:04:30.041390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041178    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" containerName="maas-api"
Jul 20 20:04:30.041390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041184    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" containerName="maas-api"
Jul 20 20:04:30.041390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041269    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9cd0f4d-9c2e-4a59-b1e4-d21fdeeb8611" containerName="revoke-keys"
Jul 20 20:04:30.041390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.041278    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27a7a0a-afa8-4352-93dd-c88a4abf739e" containerName="maas-api"
Jul 20 20:04:30.044304 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.044283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.045510 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.045481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:30.047318 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.047296    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0243e2c4-serving-cert\""
Jul 20 20:04:30.056214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.056195    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:04:30.112532 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.112497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.112735 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.112560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.112735 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.112698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blrv5\" (UniqueName: \"kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.119699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.119673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:30.213786 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.213680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.213786 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.213733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blrv5\" (UniqueName: \"kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.214027 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.213786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.214366 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.214344    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.216155 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.216137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.223547 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.223525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blrv5\" (UniqueName: \"kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5\") pod \"maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.224074 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.224053    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:30.355367 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.355332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:30.521341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.521315    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:04:30.523094 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:04:30.523064    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf214c404_0589_4818_8c50_fea8ffe087c7.slice/crio-41d7dd3b322a9250d3b558b68d7904abd1d301a9808363b6703bef22e28db9db WatchSource:0}: Error finding container 41d7dd3b322a9250d3b558b68d7904abd1d301a9808363b6703bef22e28db9db: Status 404 returned error can't find the container with id 41d7dd3b322a9250d3b558b68d7904abd1d301a9808363b6703bef22e28db9db
Jul 20 20:04:30.524400 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.524383    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:04:30.729221 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.729186    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:30.830214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:30.830128    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:31.455046 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:31.455010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" event={"ID":"f214c404-0589-4818-8c50-fea8ffe087c7","Type":"ContainerStarted","Data":"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"}
Jul 20 20:04:31.455484 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:31.455065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" event={"ID":"f214c404-0589-4818-8c50-fea8ffe087c7","Type":"ContainerStarted","Data":"41d7dd3b322a9250d3b558b68d7904abd1d301a9808363b6703bef22e28db9db"}
Jul 20 20:04:31.455484 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:31.455090    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:31.473683 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:31.473637    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" podStartSLOduration=0.695346657 podStartE2EDuration="1.473622046s" totalImagesPullingTime="778.275389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:31.471805391 +0000 UTC m=+2213.574268738" watchObservedRunningTime="2026-07-20 20:04:31.473622046 +0000 UTC m=+2213.576085395"
Jul 20 20:04:34.485869 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:34.485829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:37.466106 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:37.466080    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:04:48.392635 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.392599    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:04:48.395825 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.395803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.398775 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.398733    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0243e2c4\"/\"default-dockercfg-hg4pq\""
Jul 20 20:04:48.398912 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.398845    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0243e2c4\"/\"kube-root-ca.crt\""
Jul 20 20:04:48.400089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.400066    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0243e2c4\"/\"e2e-lifecycle-model-0243e2c4-kserve-self-signed-certs\""
Jul 20 20:04:48.400202 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.400101    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0243e2c4\"/\"openshift-service-ca.crt\""
Jul 20 20:04:48.407977 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.407955    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:04:48.423480 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.423451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:48.565040 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.565222 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565060    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2966n\" (UniqueName: \"kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.565222 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.565222 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.565222 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.565222 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.565200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2966n\" (UniqueName: \"kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666548 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666255    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666548 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666695 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666670    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666798 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.666864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.666801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.668423 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.668406    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.668709 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.668690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.674432 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.674409    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2966n\" (UniqueName: \"kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n\") pod \"e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") " pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.683631 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.683602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:04:48.704993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.704973    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:48.835162 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:48.835134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:04:48.837691 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:04:48.837662    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38f3bed1_a4c9_4cf5_9fa2_bc722ac57152.slice/crio-a3f2dcb9ac167f6e211561e382933c68acdcb743767e629f954bfb8e83d41e64 WatchSource:0}: Error finding container a3f2dcb9ac167f6e211561e382933c68acdcb743767e629f954bfb8e83d41e64: Status 404 returned error can't find the container with id a3f2dcb9ac167f6e211561e382933c68acdcb743767e629f954bfb8e83d41e64
Jul 20 20:04:49.551366 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:49.551330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" event={"ID":"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152","Type":"ContainerStarted","Data":"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"}
Jul 20 20:04:49.551718 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:49.551373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" event={"ID":"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152","Type":"ContainerStarted","Data":"a3f2dcb9ac167f6e211561e382933c68acdcb743767e629f954bfb8e83d41e64"}
Jul 20 20:04:49.573544 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:49.573498    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" podStartSLOduration=1.573485608 podStartE2EDuration="1.573485608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:04:49.571531355 +0000 UTC m=+2231.673994727" watchObservedRunningTime="2026-07-20 20:04:49.573485608 +0000 UTC m=+2231.675948957"
Jul 20 20:04:58.706017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:58.705985    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:58.706354 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:58.706123    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:58.719111 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:58.719087    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:04:59.598489 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:04:59.598459    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:05:13.447327 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.447292    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"]
Jul 20 20:05:13.450590 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.450572    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:13.454501 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.454482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:05:13.464743 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.464721    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"]
Jul 20 20:05:13.562316 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.562280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0243e2c4-pp655\" (UID: \"5d1768fc-de50-414e-b4de-75f9a8dd0822\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:13.663245 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.663207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0243e2c4-pp655\" (UID: \"5d1768fc-de50-414e-b4de-75f9a8dd0822\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:13.663877 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.663858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0243e2c4-pp655\" (UID: \"5d1768fc-de50-414e-b4de-75f9a8dd0822\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:13.761559 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.761527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:13.926716 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:13.926694    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"]
Jul 20 20:05:13.929467 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:05:13.929438    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1768fc_de50_414e_b4de_75f9a8dd0822.slice/crio-a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b WatchSource:0}: Error finding container a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b: Status 404 returned error can't find the container with id a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b
Jul 20 20:05:14.663592 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:14.663555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655" event={"ID":"5d1768fc-de50-414e-b4de-75f9a8dd0822","Type":"ContainerStarted","Data":"9a832d5eb3e23c5f0596a4dd1872635ee77d7ce528eb140c210194e86bc3fe52"}
Jul 20 20:05:14.664101 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:14.663617    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655" event={"ID":"5d1768fc-de50-414e-b4de-75f9a8dd0822","Type":"ContainerStarted","Data":"a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b"}
Jul 20 20:05:15.670143 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:15.670106    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d1768fc-de50-414e-b4de-75f9a8dd0822" containerID="9a832d5eb3e23c5f0596a4dd1872635ee77d7ce528eb140c210194e86bc3fe52" exitCode=0
Jul 20 20:05:15.670521 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:15.670154    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655" event={"ID":"5d1768fc-de50-414e-b4de-75f9a8dd0822","Type":"ContainerDied","Data":"9a832d5eb3e23c5f0596a4dd1872635ee77d7ce528eb140c210194e86bc3fe52"}
Jul 20 20:05:16.801973 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:16.801952    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:16.893703 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:16.893672    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca\") pod \"5d1768fc-de50-414e-b4de-75f9a8dd0822\" (UID: \"5d1768fc-de50-414e-b4de-75f9a8dd0822\") "
Jul 20 20:05:16.894029 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:16.894006    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d1768fc-de50-414e-b4de-75f9a8dd0822" (UID: "5d1768fc-de50-414e-b4de-75f9a8dd0822"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:05:16.994916 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:16.994886    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1768fc-de50-414e-b4de-75f9a8dd0822-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:17.681372 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:17.681341    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"
Jul 20 20:05:17.681538 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:17.681384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655" event={"ID":"5d1768fc-de50-414e-b4de-75f9a8dd0822","Type":"ContainerDied","Data":"a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b"}
Jul 20 20:05:17.681538 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:17.681439    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a73f4164142908980899b747906e0f83af6d4fe8422a732d97429c82e0f22c7b"
Jul 20 20:05:29.099487 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.099454    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:05:29.099945 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.099648    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" podUID="f214c404-0589-4818-8c50-fea8ffe087c7" containerName="maas-api" containerID="cri-o://8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a" gracePeriod=30
Jul 20 20:05:29.143238 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.143207    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:29.341458 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.341435    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:05:29.403526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.403453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls\") pod \"f214c404-0589-4818-8c50-fea8ffe087c7\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") "
Jul 20 20:05:29.403526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.403511    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blrv5\" (UniqueName: \"kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5\") pod \"f214c404-0589-4818-8c50-fea8ffe087c7\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") "
Jul 20 20:05:29.403721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.403545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca\") pod \"f214c404-0589-4818-8c50-fea8ffe087c7\" (UID: \"f214c404-0589-4818-8c50-fea8ffe087c7\") "
Jul 20 20:05:29.403992 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.403965    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f214c404-0589-4818-8c50-fea8ffe087c7" (UID: "f214c404-0589-4818-8c50-fea8ffe087c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:05:29.405556 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.405533    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f214c404-0589-4818-8c50-fea8ffe087c7" (UID: "f214c404-0589-4818-8c50-fea8ffe087c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:05:29.405686 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.405665    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5" (OuterVolumeSpecName: "kube-api-access-blrv5") pod "f214c404-0589-4818-8c50-fea8ffe087c7" (UID: "f214c404-0589-4818-8c50-fea8ffe087c7"). InnerVolumeSpecName "kube-api-access-blrv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:29.504614 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.504582    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f214c404-0589-4818-8c50-fea8ffe087c7-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:29.504614 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.504608    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f214c404-0589-4818-8c50-fea8ffe087c7-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:29.504614 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.504620    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blrv5\" (UniqueName: \"kubernetes.io/projected/f214c404-0589-4818-8c50-fea8ffe087c7-kube-api-access-blrv5\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:29.738560 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.738526    2571 generic.go:356] "Generic (PLEG): container finished" podID="f214c404-0589-4818-8c50-fea8ffe087c7" containerID="8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a" exitCode=0
Jul 20 20:05:29.738728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.738588    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"
Jul 20 20:05:29.738728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.738614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" event={"ID":"f214c404-0589-4818-8c50-fea8ffe087c7","Type":"ContainerDied","Data":"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"}
Jul 20 20:05:29.738728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.738689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn" event={"ID":"f214c404-0589-4818-8c50-fea8ffe087c7","Type":"ContainerDied","Data":"41d7dd3b322a9250d3b558b68d7904abd1d301a9808363b6703bef22e28db9db"}
Jul 20 20:05:29.738728 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.738711    2571 scope.go:117] "RemoveContainer" containerID="8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"
Jul 20 20:05:29.746977 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.746959    2571 scope.go:117] "RemoveContainer" containerID="8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"
Jul 20 20:05:29.747244 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:05:29.747222    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a\": container with ID starting with 8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a not found: ID does not exist" containerID="8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"
Jul 20 20:05:29.747294 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.747253    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a"} err="failed to get container status \"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a\": rpc error: code = NotFound desc = could not find container \"8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a\": container with ID starting with 8d1eb09ff58744977fe5af9632a31bcd712fe8e291eaa4f0cd20e0bf7231bd4a not found: ID does not exist"
Jul 20 20:05:29.765071 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.765040    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:05:29.768716 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:29.768693    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0243e2c4-85bc769466-dvpsn"]
Jul 20 20:05:31.547906 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:31.547872    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f214c404-0589-4818-8c50-fea8ffe087c7" path="/var/lib/kubelet/pods/f214c404-0589-4818-8c50-fea8ffe087c7/volumes"
Jul 20 20:05:33.539152 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:33.539121    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"]
Jul 20 20:05:33.539526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:33.539417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:33.547064 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:33.547041    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0243e2c4-pp655"]
Jul 20 20:05:35.547625 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:35.547587    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1768fc-de50-414e-b4de-75f9a8dd0822" path="/var/lib/kubelet/pods/5d1768fc-de50-414e-b4de-75f9a8dd0822/volumes"
Jul 20 20:05:36.016073 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:36.016039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:39.414337 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:39.414305    2571 scope.go:117] "RemoveContainer" containerID="1551bb56f2c76a1128475eb7c8a31b8ab0a4575527036e394b1ee92c122d9946"
Jul 20 20:05:39.781447 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:39.781413    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:39.883964 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:39.883937    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:40.059168 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:40.059072    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:40.965969 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:40.965931    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:05:41.060854 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:41.060818    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:05:55.986061 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:55.986001    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" podUID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" containerName="main" containerID="cri-o://0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f" gracePeriod=45
Jul 20 20:05:56.234390 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.234367    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:05:56.335774 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.335674    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.335774 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.335737    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2966n\" (UniqueName: \"kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.335979 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.335790    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.335979 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.335838    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.336086 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336001    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.336086 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336058    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home\") pod \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\" (UID: \"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152\") "
Jul 20 20:05:56.336086 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336058    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:56.336086 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336071    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache" (OuterVolumeSpecName: "model-cache") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:56.336299 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336262    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home" (OuterVolumeSpecName: "home") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:56.336388 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336365    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.336449 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336391    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.336449 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.336406    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.337993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.337970    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm" (OuterVolumeSpecName: "dshm") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:05:56.337993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.337985    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n" (OuterVolumeSpecName: "kube-api-access-2966n") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "kube-api-access-2966n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:05:56.338133 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.338023    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" (UID: "38f3bed1-a4c9-4cf5-9fa2-bc722ac57152"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:05:56.437214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.437171    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.437214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.437209    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2966n\" (UniqueName: \"kubernetes.io/projected/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-kube-api-access-2966n\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.437214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.437220    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:05:56.864281 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.864250    2571 generic.go:356] "Generic (PLEG): container finished" podID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" containerID="0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f" exitCode=0
Jul 20 20:05:56.864456 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.864288    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"
Jul 20 20:05:56.864456 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.864314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" event={"ID":"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152","Type":"ContainerDied","Data":"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"}
Jul 20 20:05:56.864456 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.864347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g" event={"ID":"38f3bed1-a4c9-4cf5-9fa2-bc722ac57152","Type":"ContainerDied","Data":"a3f2dcb9ac167f6e211561e382933c68acdcb743767e629f954bfb8e83d41e64"}
Jul 20 20:05:56.864456 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.864364    2571 scope.go:117] "RemoveContainer" containerID="0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"
Jul 20 20:05:56.872928 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.872912    2571 scope.go:117] "RemoveContainer" containerID="0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"
Jul 20 20:05:56.873177 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:05:56.873158    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f\": container with ID starting with 0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f not found: ID does not exist" containerID="0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"
Jul 20 20:05:56.873243 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.873185    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f"} err="failed to get container status \"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f\": rpc error: code = NotFound desc = could not find container \"0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f\": container with ID starting with 0e2c38381865a73537477fe469d796c725f32c0f1694da632333c2900722e28f not found: ID does not exist"
Jul 20 20:05:56.884925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.884902    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:05:56.889062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:56.889042    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0243e2c4/e2e-lifecycle-model-0243e2c4-kserve-5ddc464755-9cl9g"]
Jul 20 20:05:57.546898 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:05:57.546866    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" path="/var/lib/kubelet/pods/38f3bed1-a4c9-4cf5-9fa2-bc722ac57152/volumes"
Jul 20 20:06:01.303466 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:01.303428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:18.621883 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:18.621849    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:18.721499 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:18.721468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:25.286799 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:25.286750    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:25.393866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:25.393837    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:25.612851 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:25.612740    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:25.925501 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:25.925414    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:27.037162 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:27.037130    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:27.130708 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:27.130667    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:27.233594 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:27.233557    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:28.092166 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:28.092137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:28.183020 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:28.182983    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:28.283352 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:28.283320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:29.745470 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:29.745385    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:35.669654 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:35.669618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:35.774702 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:35.774668    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:36.410007 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:36.409973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:39.436693 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:39.436653    2571 scope.go:117] "RemoveContainer" containerID="8c8f5b158840110659eb97996787a93e1ce644d0c3ef0f3385e9a656f9afb652"
Jul 20 20:06:39.444676 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:39.444654    2571 scope.go:117] "RemoveContainer" containerID="9d42032ab952bb0642f14e2689c7f486abb88ddb5dc2fe45b3bb0927e5fd553d"
Jul 20 20:06:43.207587 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:43.207551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:43.323782 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:43.323726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:43.443673 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:43.443632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:54.044884 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:54.044852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:06:54.397751 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:06:54.397669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:15.418742 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:15.418704    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:22.067713 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:22.067677    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:22.168057 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:22.168022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:22.486969 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:22.486932    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:22.985055 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:22.985025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:23.184268 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:23.184229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:26.323927 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.323895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:26.432654 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.432620    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:07:26.433035 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433019    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f214c404-0589-4818-8c50-fea8ffe087c7" containerName="maas-api"
Jul 20 20:07:26.433089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433036    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f214c404-0589-4818-8c50-fea8ffe087c7" containerName="maas-api"
Jul 20 20:07:26.433089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433048    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1768fc-de50-414e-b4de-75f9a8dd0822" containerName="revoke-keys"
Jul 20 20:07:26.433089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433054    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1768fc-de50-414e-b4de-75f9a8dd0822" containerName="revoke-keys"
Jul 20 20:07:26.433089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433073    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" containerName="main"
Jul 20 20:07:26.433089 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433078    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" containerName="main"
Jul 20 20:07:26.433293 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433154    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="38f3bed1-a4c9-4cf5-9fa2-bc722ac57152" containerName="main"
Jul 20 20:07:26.433293 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433172    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f214c404-0589-4818-8c50-fea8ffe087c7" containerName="maas-api"
Jul 20 20:07:26.433293 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.433180    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1768fc-de50-414e-b4de-75f9a8dd0822" containerName="revoke-keys"
Jul 20 20:07:26.436061 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.436043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.439712 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.439692    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-b42b86-serving-cert\""
Jul 20 20:07:26.466337 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.466308    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:07:26.542638 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.542599    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:26.605137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.605051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.605137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.605093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.605137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.605126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf7rp\" (UniqueName: \"kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.657618 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.657586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:26.706003 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.705968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.706003 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.706006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.706255 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.706030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf7rp\" (UniqueName: \"kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.706699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.706673    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.708502 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.708481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.718466 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.718440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf7rp\" (UniqueName: \"kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp\") pod \"maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.745146 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.745111    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:26.893351 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:26.893281    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:07:26.896201 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:07:26.896172    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57209560_f992_442a_aacc_997143f0e691.slice/crio-007a7863c1b9a6256502932dc040b97818327feac724a43f524d6b4084fe4cef WatchSource:0}: Error finding container 007a7863c1b9a6256502932dc040b97818327feac724a43f524d6b4084fe4cef: Status 404 returned error can't find the container with id 007a7863c1b9a6256502932dc040b97818327feac724a43f524d6b4084fe4cef
Jul 20 20:07:27.177016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:27.176928    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:27.271931 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:27.271897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" event={"ID":"57209560-f992-442a-aacc-997143f0e691","Type":"ContainerStarted","Data":"007a7863c1b9a6256502932dc040b97818327feac724a43f524d6b4084fe4cef"}
Jul 20 20:07:27.288771 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:27.288736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:28.279682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:28.279647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" event={"ID":"57209560-f992-442a-aacc-997143f0e691","Type":"ContainerStarted","Data":"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"}
Jul 20 20:07:28.280250 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:28.279739    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:28.300029 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:28.299980    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" podStartSLOduration=1.861290503 podStartE2EDuration="2.299960271s" totalImagesPullingTime="438.669768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:28.299403 +0000 UTC m=+2390.401866349" watchObservedRunningTime="2026-07-20 20:07:28.299960271 +0000 UTC m=+2390.402423621"
Jul 20 20:07:30.663254 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:30.663218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:31.058017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:31.057984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:31.371875 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:31.371800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:31.635743 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:31.635656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:33.963429 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:33.963385    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:34.063111 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.063079    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:34.245201 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.245163    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:07:34.248528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.248505    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.251962 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.251944    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-850607-serving-cert\""
Jul 20 20:07:34.276842 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.276818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:07:34.290029 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.290007    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:07:34.329227 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.329199    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:34.369848 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.369815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.370016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.369861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cz4s\" (UniqueName: \"kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.370016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.369884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.470980 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.470944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.471179 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.470998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cz4s\" (UniqueName: \"kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.471179 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.471025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.471300 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:07:34.471212    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-serving-cert: secret "maas-api-e2e-inf-b-850607-serving-cert" not found
Jul 20 20:07:34.471300 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:07:34.471295    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls podName:13eafa65-f4e7-41f1-af10-e8e8ec90a0af nodeName:}" failed. No retries permitted until 2026-07-20 20:07:34.971272551 +0000 UTC m=+2397.073735890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls") pod "maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" (UID: "13eafa65-f4e7-41f1-af10-e8e8ec90a0af") : secret "maas-api-e2e-inf-b-850607-serving-cert" not found
Jul 20 20:07:34.471646 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.471625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.497148 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.497084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cz4s\" (UniqueName: \"kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.670418 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.670370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:34.975195 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.975163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.977885 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.977861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") pod \"maas-api-e2e-inf-b-850607-6cb874675b-mbw8v\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:34.988586 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:34.988562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:35.100069 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:35.100035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:35.158845 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:35.158809    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:35.298524 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:35.298502    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:07:35.300700 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:07:35.300668    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13eafa65_f4e7_41f1_af10_e8e8ec90a0af.slice/crio-6edea632437279a648c1fb89cc14d60184d65ea14446db469228f2e1d406fd08 WatchSource:0}: Error finding container 6edea632437279a648c1fb89cc14d60184d65ea14446db469228f2e1d406fd08: Status 404 returned error can't find the container with id 6edea632437279a648c1fb89cc14d60184d65ea14446db469228f2e1d406fd08
Jul 20 20:07:35.311482 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:35.311454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" event={"ID":"13eafa65-f4e7-41f1-af10-e8e8ec90a0af","Type":"ContainerStarted","Data":"6edea632437279a648c1fb89cc14d60184d65ea14446db469228f2e1d406fd08"}
Jul 20 20:07:36.317331 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:36.317298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" event={"ID":"13eafa65-f4e7-41f1-af10-e8e8ec90a0af","Type":"ContainerStarted","Data":"efb30f1943be9d19583a17feccde7b5ade666f295712cdf85e393d3480de9088"}
Jul 20 20:07:36.317718 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:36.317406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:36.343893 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:36.343841    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" podStartSLOduration=1.764159577 podStartE2EDuration="2.34382532s" totalImagesPullingTime="579.665743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:07:36.343356289 +0000 UTC m=+2398.445819638" watchObservedRunningTime="2026-07-20 20:07:36.34382532 +0000 UTC m=+2398.446288726"
Jul 20 20:07:38.527509 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:38.527473    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:39.364672 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:39.364635    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:07:39.368899 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:39.368876    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:07:39.468855 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:39.468823    2571 scope.go:117] "RemoveContainer" containerID="f9f1cb0a80cd9bef16b3acddc170aa4ac997bb8258f05e36808bebb0787bf6a7"
Jul 20 20:07:39.477335 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:39.477315    2571 scope.go:117] "RemoveContainer" containerID="2c033c1028a67c902736fc059ecc54331ab15b95342ed1264628a927f4dcd7e7"
Jul 20 20:07:42.327268 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:42.327241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:07:48.208738 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:48.208703    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:48.309951 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:48.309916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:55.861543 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:55.861499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:07:55.961497 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:07:55.961447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:08:02.295371 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.295286    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:08:02.298769 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.298738    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.301453 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.301431    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b42b86\"/\"openshift-service-ca.crt\""
Jul 20 20:08:02.302682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.302665    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b42b86\"/\"default-dockercfg-xkvq5\""
Jul 20 20:08:02.302784 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.302667    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b42b86\"/\"kube-root-ca.crt\""
Jul 20 20:08:02.303028 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.303007    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b42b86\"/\"test-model-b42b86-kserve-self-signed-certs\""
Jul 20 20:08:02.308308 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.308286    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:08:02.398593 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.398519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:08:02.411466 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.411606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.411606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.411606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.411792 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hh6\" (UniqueName: \"kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.411792 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.411688    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512275 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512291    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hh6\" (UniqueName: \"kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512746 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512746 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.512899 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.512831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.514657 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.514636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.514859 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.514841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.523105 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.523084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hh6\" (UniqueName: \"kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6\") pod \"test-model-b42b86-kserve-64d45f5c89-8fqdw\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") " pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.607916 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.607829    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:02.740576 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:02.740549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:08:02.743183 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:08:02.743155    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767d7f1b_e313_4777_8df9_0f7a65844352.slice/crio-e10f4ceb4423da0873c960182951501c8fe77c7c926e5aad4c4c06e3dbabe97a WatchSource:0}: Error finding container e10f4ceb4423da0873c960182951501c8fe77c7c926e5aad4c4c06e3dbabe97a: Status 404 returned error can't find the container with id e10f4ceb4423da0873c960182951501c8fe77c7c926e5aad4c4c06e3dbabe97a
Jul 20 20:08:03.442501 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:03.442464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" event={"ID":"767d7f1b-e313-4777-8df9-0f7a65844352","Type":"ContainerStarted","Data":"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"}
Jul 20 20:08:03.442921 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:03.442508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" event={"ID":"767d7f1b-e313-4777-8df9-0f7a65844352","Type":"ContainerStarted","Data":"e10f4ceb4423da0873c960182951501c8fe77c7c926e5aad4c4c06e3dbabe97a"}
Jul 20 20:08:03.462505 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:03.462454    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" podStartSLOduration=1.462438494 podStartE2EDuration="1.462438494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:08:03.460845657 +0000 UTC m=+2425.563309018" watchObservedRunningTime="2026-07-20 20:08:03.462438494 +0000 UTC m=+2425.564901844"
Jul 20 20:08:12.608686 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:12.608650    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:12.609124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:12.608743    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:12.621197 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:12.621170    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:13.495589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:13.495558    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:08:19.995595 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:19.995564    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:08:20.074051 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:20.074020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:08:27.457126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:08:27.457092    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:13.718198 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:13.718164    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:09:13.748106 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:13.748077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:14.780998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:14.780968    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"]
Jul 20 20:09:14.784200 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:14.784179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:14.787003 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:14.786983    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:09:14.793451 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:14.793412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"]
Jul 20 20:09:14.954181 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:14.954147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k\" (UID: \"fc7ae993-cb99-4501-8af2-fb3931544453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:15.055600 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.055503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k\" (UID: \"fc7ae993-cb99-4501-8af2-fb3931544453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:15.056358 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.056329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k\" (UID: \"fc7ae993-cb99-4501-8af2-fb3931544453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:15.095498 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.095468    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:15.158241 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.158120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:15.229625 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.229594    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"]
Jul 20 20:09:15.233556 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:09:15.233527    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc7ae993_cb99_4501_8af2_fb3931544453.slice/crio-ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66 WatchSource:0}: Error finding container ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66: Status 404 returned error can't find the container with id ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66
Jul 20 20:09:15.368405 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.368323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:15.468925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.468903    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:15.761736 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.761693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k" event={"ID":"fc7ae993-cb99-4501-8af2-fb3931544453","Type":"ContainerStarted","Data":"12d3f2ff04fe01ed17dec57c102588f8b28095a6acd7a6f063e2b0dc06fe76cd"}
Jul 20 20:09:15.761966 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.761808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k" event={"ID":"fc7ae993-cb99-4501-8af2-fb3931544453","Type":"ContainerStarted","Data":"ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66"}
Jul 20 20:09:15.781165 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:15.781106    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k" podStartSLOduration=1.781088166 podStartE2EDuration="1.781088166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:09:15.780942875 +0000 UTC m=+2497.883406228" watchObservedRunningTime="2026-07-20 20:09:15.781088166 +0000 UTC m=+2497.883551560"
Jul 20 20:09:16.767670 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:16.767629    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc7ae993-cb99-4501-8af2-fb3931544453" containerID="12d3f2ff04fe01ed17dec57c102588f8b28095a6acd7a6f063e2b0dc06fe76cd" exitCode=0
Jul 20 20:09:16.767864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:16.767692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k" event={"ID":"fc7ae993-cb99-4501-8af2-fb3931544453","Type":"ContainerDied","Data":"12d3f2ff04fe01ed17dec57c102588f8b28095a6acd7a6f063e2b0dc06fe76cd"}
Jul 20 20:09:17.900211 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:17.900183    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:18.081261 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.081171    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca\") pod \"fc7ae993-cb99-4501-8af2-fb3931544453\" (UID: \"fc7ae993-cb99-4501-8af2-fb3931544453\") "
Jul 20 20:09:18.081528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.081504    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc7ae993-cb99-4501-8af2-fb3931544453" (UID: "fc7ae993-cb99-4501-8af2-fb3931544453"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:09:18.181812 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.181778    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7ae993-cb99-4501-8af2-fb3931544453-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:18.777745 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.777711    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"
Jul 20 20:09:18.777745 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.777738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k" event={"ID":"fc7ae993-cb99-4501-8af2-fb3931544453","Type":"ContainerDied","Data":"ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66"}
Jul 20 20:09:18.777977 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:18.777799    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca9567b0ef9def1534d7e0c9f1f9e6a66ab8ec8d1991e1c13ad66c3e622d1e66"
Jul 20 20:09:23.287692 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:23.287656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:25.275903 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.275861    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:09:25.276384 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.276113    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" podUID="57209560-f992-442a-aacc-997143f0e691" containerName="maas-api" containerID="cri-o://dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867" gracePeriod=30
Jul 20 20:09:25.304315 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.304291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:25.520358 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.520334    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:09:25.542483 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.542393    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls\") pod \"57209560-f992-442a-aacc-997143f0e691\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") "
Jul 20 20:09:25.542483 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.542440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca\") pod \"57209560-f992-442a-aacc-997143f0e691\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") "
Jul 20 20:09:25.542483 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.542474    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf7rp\" (UniqueName: \"kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp\") pod \"57209560-f992-442a-aacc-997143f0e691\" (UID: \"57209560-f992-442a-aacc-997143f0e691\") "
Jul 20 20:09:25.543289 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.543241    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57209560-f992-442a-aacc-997143f0e691" (UID: "57209560-f992-442a-aacc-997143f0e691"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:09:25.545503 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.545476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57209560-f992-442a-aacc-997143f0e691" (UID: "57209560-f992-442a-aacc-997143f0e691"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:09:25.545503 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.545475    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp" (OuterVolumeSpecName: "kube-api-access-cf7rp") pod "57209560-f992-442a-aacc-997143f0e691" (UID: "57209560-f992-442a-aacc-997143f0e691"). InnerVolumeSpecName "kube-api-access-cf7rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:09:25.643963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.643918    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57209560-f992-442a-aacc-997143f0e691-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:25.643963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.643961    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57209560-f992-442a-aacc-997143f0e691-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:25.643963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.643971    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf7rp\" (UniqueName: \"kubernetes.io/projected/57209560-f992-442a-aacc-997143f0e691-kube-api-access-cf7rp\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:25.809612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.809522    2571 generic.go:356] "Generic (PLEG): container finished" podID="57209560-f992-442a-aacc-997143f0e691" containerID="dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867" exitCode=0
Jul 20 20:09:25.809612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.809574    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"
Jul 20 20:09:25.809826 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.809608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" event={"ID":"57209560-f992-442a-aacc-997143f0e691","Type":"ContainerDied","Data":"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"}
Jul 20 20:09:25.809826 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.809670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5" event={"ID":"57209560-f992-442a-aacc-997143f0e691","Type":"ContainerDied","Data":"007a7863c1b9a6256502932dc040b97818327feac724a43f524d6b4084fe4cef"}
Jul 20 20:09:25.809826 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.809700    2571 scope.go:117] "RemoveContainer" containerID="dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"
Jul 20 20:09:25.818278 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.818261    2571 scope.go:117] "RemoveContainer" containerID="dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"
Jul 20 20:09:25.818540 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:09:25.818524    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867\": container with ID starting with dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867 not found: ID does not exist" containerID="dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"
Jul 20 20:09:25.818590 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.818548    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867"} err="failed to get container status \"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867\": rpc error: code = NotFound desc = could not find container \"dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867\": container with ID starting with dcc22425d667b967b819a90fbe8c417200be1273f4fa1522e28cd3eafd598867 not found: ID does not exist"
Jul 20 20:09:25.827278 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.827251    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:09:25.831210 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:25.831188    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b42b86-59674d74c-7zsg5"]
Jul 20 20:09:27.547045 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:27.547009    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57209560-f992-442a-aacc-997143f0e691" path="/var/lib/kubelet/pods/57209560-f992-442a-aacc-997143f0e691/volumes"
Jul 20 20:09:28.737439 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:28.737399    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" podUID="767d7f1b-e313-4777-8df9-0f7a65844352" containerName="main" containerID="cri-o://27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd" gracePeriod=45
Jul 20 20:09:28.984786 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:28.984748    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:09:29.071938 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.071848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.071938 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.071900    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.072180 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.071944    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.072180 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.071961    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6hh6\" (UniqueName: \"kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.072180 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072002    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.072328 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072176    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm\") pod \"767d7f1b-e313-4777-8df9-0f7a65844352\" (UID: \"767d7f1b-e313-4777-8df9-0f7a65844352\") "
Jul 20 20:09:29.072328 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072198    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home" (OuterVolumeSpecName: "home") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:09:29.072328 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072240    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache" (OuterVolumeSpecName: "model-cache") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:09:29.072328 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:09:29.072499 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072475    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.072499 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072500    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.072622 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.072510    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.074226 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.074205    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:09:29.074320 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.074272    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm" (OuterVolumeSpecName: "dshm") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:09:29.074320 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.074303    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6" (OuterVolumeSpecName: "kube-api-access-m6hh6") pod "767d7f1b-e313-4777-8df9-0f7a65844352" (UID: "767d7f1b-e313-4777-8df9-0f7a65844352"). InnerVolumeSpecName "kube-api-access-m6hh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:09:29.173256 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.173220    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d7f1b-e313-4777-8df9-0f7a65844352-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.173256 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.173255    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6hh6\" (UniqueName: \"kubernetes.io/projected/767d7f1b-e313-4777-8df9-0f7a65844352-kube-api-access-m6hh6\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.173490 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.173268    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d7f1b-e313-4777-8df9-0f7a65844352-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:29.835613 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.835518    2571 generic.go:356] "Generic (PLEG): container finished" podID="767d7f1b-e313-4777-8df9-0f7a65844352" containerID="27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd" exitCode=0
Jul 20 20:09:29.835613 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.835566    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"
Jul 20 20:09:29.835613 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.835600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" event={"ID":"767d7f1b-e313-4777-8df9-0f7a65844352","Type":"ContainerDied","Data":"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"}
Jul 20 20:09:29.836128 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.835645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw" event={"ID":"767d7f1b-e313-4777-8df9-0f7a65844352","Type":"ContainerDied","Data":"e10f4ceb4423da0873c960182951501c8fe77c7c926e5aad4c4c06e3dbabe97a"}
Jul 20 20:09:29.836128 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.835670    2571 scope.go:117] "RemoveContainer" containerID="27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"
Jul 20 20:09:29.844163 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.844144    2571 scope.go:117] "RemoveContainer" containerID="27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"
Jul 20 20:09:29.844476 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:09:29.844452    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd\": container with ID starting with 27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd not found: ID does not exist" containerID="27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"
Jul 20 20:09:29.844528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.844488    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd"} err="failed to get container status \"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd\": rpc error: code = NotFound desc = could not find container \"27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd\": container with ID starting with 27c795d48f61d1b1dab24aa89e225719c434e5ab6949de32bda12bfe839921bd not found: ID does not exist"
Jul 20 20:09:29.855184 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.855158    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:09:29.861826 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.861798    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b42b86/test-model-b42b86-kserve-64d45f5c89-8fqdw"]
Jul 20 20:09:29.897673 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.897641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:29.917988 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.917964    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"]
Jul 20 20:09:29.921272 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:29.921250    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b42b86-5ck6k"]
Jul 20 20:09:30.305989 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:30.305964    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:31.547214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:31.547180    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767d7f1b-e313-4777-8df9-0f7a65844352" path="/var/lib/kubelet/pods/767d7f1b-e313-4777-8df9-0f7a65844352/volumes"
Jul 20 20:09:31.547693 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:31.547502    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc7ae993-cb99-4501-8af2-fb3931544453" path="/var/lib/kubelet/pods/fc7ae993-cb99-4501-8af2-fb3931544453/volumes"
Jul 20 20:09:36.557054 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:36.557017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:36.644018 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:36.643978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:36.844069 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:36.843987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:37.080490 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.080454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:37.199536 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199439    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"]
Jul 20 20:09:37.199847 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199829    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc7ae993-cb99-4501-8af2-fb3931544453" containerName="revoke-keys"
Jul 20 20:09:37.199847 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199847    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc7ae993-cb99-4501-8af2-fb3931544453" containerName="revoke-keys"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199862    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57209560-f992-442a-aacc-997143f0e691" containerName="maas-api"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199868    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="57209560-f992-442a-aacc-997143f0e691" containerName="maas-api"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199884    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767d7f1b-e313-4777-8df9-0f7a65844352" containerName="main"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199893    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="767d7f1b-e313-4777-8df9-0f7a65844352" containerName="main"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199947    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="767d7f1b-e313-4777-8df9-0f7a65844352" containerName="main"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199956    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc7ae993-cb99-4501-8af2-fb3931544453" containerName="revoke-keys"
Jul 20 20:09:37.199998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.199967    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="57209560-f992-442a-aacc-997143f0e691" containerName="maas-api"
Jul 20 20:09:37.204206 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.204181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:37.207469 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.207446    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:09:37.215137 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.215115    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"]
Jul 20 20:09:37.242455 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.242414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-850607-m9wd7\" (UID: \"04c1c944-eb66-4e1c-837e-6b3ff6bc2204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:37.343518 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.343485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-850607-m9wd7\" (UID: \"04c1c944-eb66-4e1c-837e-6b3ff6bc2204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:37.344153 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.344129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-850607-m9wd7\" (UID: \"04c1c944-eb66-4e1c-837e-6b3ff6bc2204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:37.515348 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.515297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:37.652070 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.652038    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"]
Jul 20 20:09:37.654526 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:09:37.654500    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c1c944_eb66_4e1c_837e_6b3ff6bc2204.slice/crio-1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c WatchSource:0}: Error finding container 1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c: Status 404 returned error can't find the container with id 1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c
Jul 20 20:09:37.871707 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.871670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7" event={"ID":"04c1c944-eb66-4e1c-837e-6b3ff6bc2204","Type":"ContainerStarted","Data":"1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c"}
Jul 20 20:09:37.921468 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:37.921436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:38.022283 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:38.022248    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:38.877986 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:38.877956    2571 generic.go:356] "Generic (PLEG): container finished" podID="04c1c944-eb66-4e1c-837e-6b3ff6bc2204" containerID="e664caded76d3a4855c5587d737daeea418b28eb1e7fc78943bb2730247825a1" exitCode=0
Jul 20 20:09:38.878377 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:38.878050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7" event={"ID":"04c1c944-eb66-4e1c-837e-6b3ff6bc2204","Type":"ContainerDied","Data":"e664caded76d3a4855c5587d737daeea418b28eb1e7fc78943bb2730247825a1"}
Jul 20 20:09:40.012405 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.012377    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:40.067367 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.067339    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca\") pod \"04c1c944-eb66-4e1c-837e-6b3ff6bc2204\" (UID: \"04c1c944-eb66-4e1c-837e-6b3ff6bc2204\") "
Jul 20 20:09:40.067698 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.067672    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04c1c944-eb66-4e1c-837e-6b3ff6bc2204" (UID: "04c1c944-eb66-4e1c-837e-6b3ff6bc2204"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:09:40.168217 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.168133    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04c1c944-eb66-4e1c-837e-6b3ff6bc2204-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:40.888378 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.888351    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"
Jul 20 20:09:40.888654 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.888351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7" event={"ID":"04c1c944-eb66-4e1c-837e-6b3ff6bc2204","Type":"ContainerDied","Data":"1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c"}
Jul 20 20:09:40.888832 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:40.888674    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1edf5102f76f4a24bbda6bba7c0e897afdfe25ec1cc79afde6060b21bf64b98c"
Jul 20 20:09:47.713534 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.713503    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:09:47.714063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.713691    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" podUID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" containerName="maas-api" containerID="cri-o://efb30f1943be9d19583a17feccde7b5ade666f295712cdf85e393d3480de9088" gracePeriod=30
Jul 20 20:09:47.740454 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.740424    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:47.919842 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.919813    2571 generic.go:356] "Generic (PLEG): container finished" podID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" containerID="efb30f1943be9d19583a17feccde7b5ade666f295712cdf85e393d3480de9088" exitCode=0
Jul 20 20:09:47.919995 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.919887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" event={"ID":"13eafa65-f4e7-41f1-af10-e8e8ec90a0af","Type":"ContainerDied","Data":"efb30f1943be9d19583a17feccde7b5ade666f295712cdf85e393d3480de9088"}
Jul 20 20:09:47.955672 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:47.955648    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:09:48.034628 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.034598    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") pod \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") "
Jul 20 20:09:48.034818 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.034656    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca\") pod \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") "
Jul 20 20:09:48.034818 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.034692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cz4s\" (UniqueName: \"kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s\") pod \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\" (UID: \"13eafa65-f4e7-41f1-af10-e8e8ec90a0af\") "
Jul 20 20:09:48.035039 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.035018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13eafa65-f4e7-41f1-af10-e8e8ec90a0af" (UID: "13eafa65-f4e7-41f1-af10-e8e8ec90a0af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:09:48.036822 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.036804    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s" (OuterVolumeSpecName: "kube-api-access-5cz4s") pod "13eafa65-f4e7-41f1-af10-e8e8ec90a0af" (UID: "13eafa65-f4e7-41f1-af10-e8e8ec90a0af"). InnerVolumeSpecName "kube-api-access-5cz4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:09:48.036878 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.036816    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13eafa65-f4e7-41f1-af10-e8e8ec90a0af" (UID: "13eafa65-f4e7-41f1-af10-e8e8ec90a0af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:09:48.135487 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.135456    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:48.135487 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.135486    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:48.135487 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.135498    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cz4s\" (UniqueName: \"kubernetes.io/projected/13eafa65-f4e7-41f1-af10-e8e8ec90a0af-kube-api-access-5cz4s\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:09:48.926359 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.926328    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"
Jul 20 20:09:48.926359 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.926336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v" event={"ID":"13eafa65-f4e7-41f1-af10-e8e8ec90a0af","Type":"ContainerDied","Data":"6edea632437279a648c1fb89cc14d60184d65ea14446db469228f2e1d406fd08"}
Jul 20 20:09:48.926929 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.926396    2571 scope.go:117] "RemoveContainer" containerID="efb30f1943be9d19583a17feccde7b5ade666f295712cdf85e393d3480de9088"
Jul 20 20:09:48.950263 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.950235    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:09:48.955615 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:48.955591    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-850607-6cb874675b-mbw8v"]
Jul 20 20:09:49.546936 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:49.546901    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" path="/var/lib/kubelet/pods/13eafa65-f4e7-41f1-af10-e8e8ec90a0af/volumes"
Jul 20 20:09:52.294126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:52.294082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:52.301663 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:52.301636    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"]
Jul 20 20:09:52.304717 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:52.304695    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-850607-m9wd7"]
Jul 20 20:09:52.695783 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:52.695669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:53.547085 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:53.547051    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04c1c944-eb66-4e1c-837e-6b3ff6bc2204" path="/var/lib/kubelet/pods/04c1c944-eb66-4e1c-837e-6b3ff6bc2204/volumes"
Jul 20 20:09:58.543483 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:58.543451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:58.644857 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:58.644825    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:58.867147 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:58.867068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:59.186958 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:59.186879    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:59.544956 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:59.544914    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:09:59.908860 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:09:59.908780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:00.337379 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:00.337345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:02.831289 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.831251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:02.956646 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.956605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:02.961528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.961498    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:02.961923 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.961906    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" containerName="maas-api"
Jul 20 20:10:02.961923 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.961924    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" containerName="maas-api"
Jul 20 20:10:02.962062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.961938    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c1c944-eb66-4e1c-837e-6b3ff6bc2204" containerName="revoke-keys"
Jul 20 20:10:02.962062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.961947    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c1c944-eb66-4e1c-837e-6b3ff6bc2204" containerName="revoke-keys"
Jul 20 20:10:02.962062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.962037    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c1c944-eb66-4e1c-837e-6b3ff6bc2204" containerName="revoke-keys"
Jul 20 20:10:02.962062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.962050    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="13eafa65-f4e7-41f1-af10-e8e8ec90a0af" containerName="maas-api"
Jul 20 20:10:02.966321 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.966301    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:02.971007 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.970984    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b18634-serving-cert\""
Jul 20 20:10:02.985446 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:02.985419    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:03.067605 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.067568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.067785 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.067624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.067785 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.067729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbbqf\" (UniqueName: \"kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.095567 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.095493    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:03.168670 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.168638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.168888 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.168696    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbqf\" (UniqueName: \"kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.168888 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.168736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.169308 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.169287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.171074 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.171053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.178723 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.178701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbbqf\" (UniqueName: \"kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf\") pod \"maas-api-e2e-api-a-b18634-fff569f4-rbrns\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.196428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.196403    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:03.277109 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.277075    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:03.418109 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.418085    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:03.419899 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:10:03.419871    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebeec71e_9df2_4d2f_ae8f_02da300e14de.slice/crio-e7fdfdc59393fb2aa29bd438e996ba6030dd606291e7cdab52db2092e79465ba WatchSource:0}: Error finding container e7fdfdc59393fb2aa29bd438e996ba6030dd606291e7cdab52db2092e79465ba: Status 404 returned error can't find the container with id e7fdfdc59393fb2aa29bd438e996ba6030dd606291e7cdab52db2092e79465ba
Jul 20 20:10:03.421617 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.421603    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:10:03.799997 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.799965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:03.897989 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.897950    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:03.999169 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:03.999133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" event={"ID":"ebeec71e-9df2-4d2f-ae8f-02da300e14de","Type":"ContainerStarted","Data":"e7fdfdc59393fb2aa29bd438e996ba6030dd606291e7cdab52db2092e79465ba"}
Jul 20 20:10:05.005219 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:05.005184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" event={"ID":"ebeec71e-9df2-4d2f-ae8f-02da300e14de","Type":"ContainerStarted","Data":"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"}
Jul 20 20:10:05.005601 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:05.005269    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:05.031894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:05.031845    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" podStartSLOduration=2.213383654 podStartE2EDuration="3.031827835s" totalImagesPullingTime="818.444181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:10:05.02921423 +0000 UTC m=+2547.131677580" watchObservedRunningTime="2026-07-20 20:10:05.031827835 +0000 UTC m=+2547.134291183"
Jul 20 20:10:07.431561 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:07.431526    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:07.956008 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:07.955971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:08.276592 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:08.276562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:08.426141 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:08.426108    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:10.838945 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.838911    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:10.936081 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.936053    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:10.940412 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.940384    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:10:10.943960 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.943943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:10.947185 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.947165    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fffcf6-serving-cert\""
Jul 20 20:10:10.959917 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:10.959889    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:10:11.015518 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.015490    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:11.015880 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.015856    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:11.136695 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.136593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbmh\" (UniqueName: \"kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.136695 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.136631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.136947 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.136815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.238179 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.238142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbmh\" (UniqueName: \"kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.238179 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.238183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.238415 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.238281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.238415 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:10:11.238381    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-serving-cert: secret "maas-api-e2e-api-b-fffcf6-serving-cert" not found
Jul 20 20:10:11.238497 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:10:11.238455    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls podName:519f5493-9a23-48d9-9365-7bff7d6a49ae nodeName:}" failed. No retries permitted until 2026-07-20 20:10:11.738433114 +0000 UTC m=+2553.840896441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls") pod "maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" (UID: "519f5493-9a23-48d9-9365-7bff7d6a49ae") : secret "maas-api-e2e-api-b-fffcf6-serving-cert" not found
Jul 20 20:10:11.238897 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.238878    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.247298 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.247273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbmh\" (UniqueName: \"kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.337936 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.337903    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:11.525286 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.525245    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:11.625210 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.625165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:11.741464 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.741425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.743776 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.743728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") pod \"maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.853987 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.853894    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:11.987393 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:11.987366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:10:11.989521 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:10:11.989489    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519f5493_9a23_48d9_9365_7bff7d6a49ae.slice/crio-90933cf7120a701b7e919c7109bd54e51bdd343bd6c55ba7faabcd3cc5d45b80 WatchSource:0}: Error finding container 90933cf7120a701b7e919c7109bd54e51bdd343bd6c55ba7faabcd3cc5d45b80: Status 404 returned error can't find the container with id 90933cf7120a701b7e919c7109bd54e51bdd343bd6c55ba7faabcd3cc5d45b80
Jul 20 20:10:12.039160 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:12.039118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" event={"ID":"519f5493-9a23-48d9-9365-7bff7d6a49ae","Type":"ContainerStarted","Data":"90933cf7120a701b7e919c7109bd54e51bdd343bd6c55ba7faabcd3cc5d45b80"}
Jul 20 20:10:13.046045 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:13.046009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" event={"ID":"519f5493-9a23-48d9-9365-7bff7d6a49ae","Type":"ContainerStarted","Data":"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"}
Jul 20 20:10:13.046490 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:13.046193    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:13.070741 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:13.070681    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" podStartSLOduration=2.743877524 podStartE2EDuration="3.070665022s" totalImagesPullingTime="326.787498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:10:13.070182801 +0000 UTC m=+2555.172646151" watchObservedRunningTime="2026-07-20 20:10:13.070665022 +0000 UTC m=+2555.173128370"
Jul 20 20:10:15.413385 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:15.413348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:19.056368 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:19.056340    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:10:23.728320 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.728283    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"]
Jul 20 20:10:23.731516 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.731496    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:23.734535 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.734518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:10:23.740880 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.740857    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"]
Jul 20 20:10:23.845281 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.845237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b18634-kh8sp\" (UID: \"8ad90859-403b-41fc-8f69-5dd45e21a9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:23.946614 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.946576    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b18634-kh8sp\" (UID: \"8ad90859-403b-41fc-8f69-5dd45e21a9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:23.947251 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:23.947229    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b18634-kh8sp\" (UID: \"8ad90859-403b-41fc-8f69-5dd45e21a9c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:24.043162 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:24.043079    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:24.180721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:24.180678    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"]
Jul 20 20:10:24.183029 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:10:24.182996    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad90859_403b_41fc_8f69_5dd45e21a9c2.slice/crio-3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8 WatchSource:0}: Error finding container 3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8: Status 404 returned error can't find the container with id 3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8
Jul 20 20:10:24.302469 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:24.302383    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:24.403890 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:24.403850    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:25.106053 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:25.105961    2571 generic.go:356] "Generic (PLEG): container finished" podID="8ad90859-403b-41fc-8f69-5dd45e21a9c2" containerID="289ebff7adf1b51ad61b062f83bdde95c1bc30cb095417fdb14cca4f96eebf78" exitCode=0
Jul 20 20:10:25.106404 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:25.106051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp" event={"ID":"8ad90859-403b-41fc-8f69-5dd45e21a9c2","Type":"ContainerDied","Data":"289ebff7adf1b51ad61b062f83bdde95c1bc30cb095417fdb14cca4f96eebf78"}
Jul 20 20:10:25.106404 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:25.106098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp" event={"ID":"8ad90859-403b-41fc-8f69-5dd45e21a9c2","Type":"ContainerStarted","Data":"3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8"}
Jul 20 20:10:26.241413 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:26.241389    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:26.368864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:26.368750    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca\") pod \"8ad90859-403b-41fc-8f69-5dd45e21a9c2\" (UID: \"8ad90859-403b-41fc-8f69-5dd45e21a9c2\") "
Jul 20 20:10:26.369108 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:26.369084    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ad90859-403b-41fc-8f69-5dd45e21a9c2" (UID: "8ad90859-403b-41fc-8f69-5dd45e21a9c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:10:26.469806 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:26.469748    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ad90859-403b-41fc-8f69-5dd45e21a9c2-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:10:27.116107 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:27.116078    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"
Jul 20 20:10:27.116107 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:27.116088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp" event={"ID":"8ad90859-403b-41fc-8f69-5dd45e21a9c2","Type":"ContainerDied","Data":"3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8"}
Jul 20 20:10:27.116328 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:27.116141    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b1298611256f0a746bf2f6ac490ef839e75b42a7f94fc0d864b391e6f6063a8"
Jul 20 20:10:27.589895 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:27.589856    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:32.361234 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:32.361196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:32.462871 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:32.462840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:34.355872 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:34.355831    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:34.997255 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:34.997223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:39.520088 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.520052    2571 scope.go:117] "RemoveContainer" containerID="eea2fd6dfe8cd85bef58f9c918b6a65cab4263184218a8334b6c61fbc7156720"
Jul 20 20:10:39.600090 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.600059    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:39.600304 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.600278    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" podUID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" containerName="maas-api" containerID="cri-o://67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3" gracePeriod=30
Jul 20 20:10:39.615441 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.615415    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:39.845209 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.845184    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:39.984824 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.984796    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls\") pod \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") "
Jul 20 20:10:39.984983 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.984888    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca\") pod \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") "
Jul 20 20:10:39.984983 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.984924    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbbqf\" (UniqueName: \"kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf\") pod \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\" (UID: \"ebeec71e-9df2-4d2f-ae8f-02da300e14de\") "
Jul 20 20:10:39.985235 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.985202    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebeec71e-9df2-4d2f-ae8f-02da300e14de" (UID: "ebeec71e-9df2-4d2f-ae8f-02da300e14de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:10:39.986872 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.986849    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebeec71e-9df2-4d2f-ae8f-02da300e14de" (UID: "ebeec71e-9df2-4d2f-ae8f-02da300e14de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:10:39.986952 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:39.986869    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf" (OuterVolumeSpecName: "kube-api-access-bbbqf") pod "ebeec71e-9df2-4d2f-ae8f-02da300e14de" (UID: "ebeec71e-9df2-4d2f-ae8f-02da300e14de"). InnerVolumeSpecName "kube-api-access-bbbqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:10:40.085926 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.085837    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebeec71e-9df2-4d2f-ae8f-02da300e14de-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:10:40.085926 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.085862    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebeec71e-9df2-4d2f-ae8f-02da300e14de-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:10:40.085926 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.085873    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbbqf\" (UniqueName: \"kubernetes.io/projected/ebeec71e-9df2-4d2f-ae8f-02da300e14de-kube-api-access-bbbqf\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:10:40.175890 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.175858    2571 generic.go:356] "Generic (PLEG): container finished" podID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" containerID="67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3" exitCode=0
Jul 20 20:10:40.176063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.175904    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"
Jul 20 20:10:40.176063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.175940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" event={"ID":"ebeec71e-9df2-4d2f-ae8f-02da300e14de","Type":"ContainerDied","Data":"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"}
Jul 20 20:10:40.176063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.175996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns" event={"ID":"ebeec71e-9df2-4d2f-ae8f-02da300e14de","Type":"ContainerDied","Data":"e7fdfdc59393fb2aa29bd438e996ba6030dd606291e7cdab52db2092e79465ba"}
Jul 20 20:10:40.176063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.176021    2571 scope.go:117] "RemoveContainer" containerID="67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"
Jul 20 20:10:40.184902 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.184885    2571 scope.go:117] "RemoveContainer" containerID="67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"
Jul 20 20:10:40.185156 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:10:40.185140    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3\": container with ID starting with 67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3 not found: ID does not exist" containerID="67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"
Jul 20 20:10:40.185213 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.185163    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3"} err="failed to get container status \"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3\": rpc error: code = NotFound desc = could not find container \"67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3\": container with ID starting with 67992c7a510bcdd2933b230410dd5c71cb8c705c89928e02f96ac6d8f344aed3 not found: ID does not exist"
Jul 20 20:10:40.198053 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.198027    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:40.204422 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.204400    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b18634-fff569f4-rbrns"]
Jul 20 20:10:40.691535 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.691500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:40.790625 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:40.790590    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:41.547542 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:41.547506    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" path="/var/lib/kubelet/pods/ebeec71e-9df2-4d2f-ae8f-02da300e14de/volumes"
Jul 20 20:10:43.831490 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:43.831454    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"]
Jul 20 20:10:43.833788 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:43.833746    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b18634-kh8sp"]
Jul 20 20:10:43.842969 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:43.842939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:44.359529 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:44.359499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:45.547461 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:45.547418    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad90859-403b-41fc-8f69-5dd45e21a9c2" path="/var/lib/kubelet/pods/8ad90859-403b-41fc-8f69-5dd45e21a9c2/volumes"
Jul 20 20:10:50.012207 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.012167    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:50.113924 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.113891    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:50.311121 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.311033    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:50.568252 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.568160    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:50.687370 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687335    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"]
Jul 20 20:10:50.687832 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687814    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad90859-403b-41fc-8f69-5dd45e21a9c2" containerName="revoke-keys"
Jul 20 20:10:50.687886 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687835    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad90859-403b-41fc-8f69-5dd45e21a9c2" containerName="revoke-keys"
Jul 20 20:10:50.687886 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687855    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" containerName="maas-api"
Jul 20 20:10:50.687886 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687864    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" containerName="maas-api"
Jul 20 20:10:50.687993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687950    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebeec71e-9df2-4d2f-ae8f-02da300e14de" containerName="maas-api"
Jul 20 20:10:50.687993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.687964    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad90859-403b-41fc-8f69-5dd45e21a9c2" containerName="revoke-keys"
Jul 20 20:10:50.691123 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.691104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:50.693768 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.693739    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:10:50.697771 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.697733    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"]
Jul 20 20:10:50.779426 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.779390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn\" (UID: \"c1ea2e34-a136-4d79-9303-b3a59671eb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:50.879930 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.879834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn\" (UID: \"c1ea2e34-a136-4d79-9303-b3a59671eb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:50.880474 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:50.880452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn\" (UID: \"c1ea2e34-a136-4d79-9303-b3a59671eb2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:51.002606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:51.002570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:51.140232 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:51.140100    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"]
Jul 20 20:10:51.142973 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:10:51.142950    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ea2e34_a136_4d79_9303_b3a59671eb2d.slice/crio-fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587 WatchSource:0}: Error finding container fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587: Status 404 returned error can't find the container with id fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587
Jul 20 20:10:51.227638 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:51.227603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn" event={"ID":"c1ea2e34-a136-4d79-9303-b3a59671eb2d","Type":"ContainerStarted","Data":"fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587"}
Jul 20 20:10:51.646538 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:51.646503    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:51.740046 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:51.740017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:10:52.233871 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:52.233836    2571 generic.go:356] "Generic (PLEG): container finished" podID="c1ea2e34-a136-4d79-9303-b3a59671eb2d" containerID="ce201874913b3d59e36d95d94213fcbbf2b7fc813ff8be178166e9f6d1a5e33a" exitCode=0
Jul 20 20:10:52.234324 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:52.233921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn" event={"ID":"c1ea2e34-a136-4d79-9303-b3a59671eb2d","Type":"ContainerDied","Data":"ce201874913b3d59e36d95d94213fcbbf2b7fc813ff8be178166e9f6d1a5e33a"}
Jul 20 20:10:53.364023 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:53.363999    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:53.504220 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:53.504126    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca\") pod \"c1ea2e34-a136-4d79-9303-b3a59671eb2d\" (UID: \"c1ea2e34-a136-4d79-9303-b3a59671eb2d\") "
Jul 20 20:10:53.504527 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:53.504493    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1ea2e34-a136-4d79-9303-b3a59671eb2d" (UID: "c1ea2e34-a136-4d79-9303-b3a59671eb2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:10:53.605649 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:53.605613    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1ea2e34-a136-4d79-9303-b3a59671eb2d-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:10:54.244735 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:54.244702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn" event={"ID":"c1ea2e34-a136-4d79-9303-b3a59671eb2d","Type":"ContainerDied","Data":"fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587"}
Jul 20 20:10:54.244735 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:54.244730    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"
Jul 20 20:10:54.244970 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:10:54.244751    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fac354c8c77a481fd105519149727737f75810ce0ebe42f6231fa33aa8463587"
Jul 20 20:11:06.242838 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.242746    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:11:06.243343 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.243008    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" podUID="519f5493-9a23-48d9-9365-7bff7d6a49ae" containerName="maas-api" containerID="cri-o://b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785" gracePeriod=30
Jul 20 20:11:06.276533 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.276507    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:06.486445 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.486421    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:11:06.513649 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.513578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca\") pod \"519f5493-9a23-48d9-9365-7bff7d6a49ae\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") "
Jul 20 20:11:06.513799 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.513653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnbmh\" (UniqueName: \"kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh\") pod \"519f5493-9a23-48d9-9365-7bff7d6a49ae\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") "
Jul 20 20:11:06.513799 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.513687    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") pod \"519f5493-9a23-48d9-9365-7bff7d6a49ae\" (UID: \"519f5493-9a23-48d9-9365-7bff7d6a49ae\") "
Jul 20 20:11:06.513926 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.513910    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "519f5493-9a23-48d9-9365-7bff7d6a49ae" (UID: "519f5493-9a23-48d9-9365-7bff7d6a49ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:11:06.515704 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.515674    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh" (OuterVolumeSpecName: "kube-api-access-qnbmh") pod "519f5493-9a23-48d9-9365-7bff7d6a49ae" (UID: "519f5493-9a23-48d9-9365-7bff7d6a49ae"). InnerVolumeSpecName "kube-api-access-qnbmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:11:06.515857 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.515735    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "519f5493-9a23-48d9-9365-7bff7d6a49ae" (UID: "519f5493-9a23-48d9-9365-7bff7d6a49ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:11:06.614346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.614305    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/519f5493-9a23-48d9-9365-7bff7d6a49ae-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:11:06.614346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.614337    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnbmh\" (UniqueName: \"kubernetes.io/projected/519f5493-9a23-48d9-9365-7bff7d6a49ae-kube-api-access-qnbmh\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:11:06.614346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:06.614348    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/519f5493-9a23-48d9-9365-7bff7d6a49ae-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:11:07.303210 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.303174    2571 generic.go:356] "Generic (PLEG): container finished" podID="519f5493-9a23-48d9-9365-7bff7d6a49ae" containerID="b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785" exitCode=0
Jul 20 20:11:07.303682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.303223    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"
Jul 20 20:11:07.303682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.303265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" event={"ID":"519f5493-9a23-48d9-9365-7bff7d6a49ae","Type":"ContainerDied","Data":"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"}
Jul 20 20:11:07.303682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.303321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk" event={"ID":"519f5493-9a23-48d9-9365-7bff7d6a49ae","Type":"ContainerDied","Data":"90933cf7120a701b7e919c7109bd54e51bdd343bd6c55ba7faabcd3cc5d45b80"}
Jul 20 20:11:07.303682 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.303347    2571 scope.go:117] "RemoveContainer" containerID="b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"
Jul 20 20:11:07.311929 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.311910    2571 scope.go:117] "RemoveContainer" containerID="b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"
Jul 20 20:11:07.312228 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:07.312208    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785\": container with ID starting with b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785 not found: ID does not exist" containerID="b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"
Jul 20 20:11:07.312277 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.312237    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785"} err="failed to get container status \"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785\": rpc error: code = NotFound desc = could not find container \"b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785\": container with ID starting with b2e2d6e70f579312d3e29d946d16c1f0a6f0257617fb4a921bba71025463f785 not found: ID does not exist"
Jul 20 20:11:07.325474 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.325451    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:11:07.329566 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.329543    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fffcf6-db6b5f8fd-tfxjk"]
Jul 20 20:11:07.546707 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:07.546671    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519f5493-9a23-48d9-9365-7bff7d6a49ae" path="/var/lib/kubelet/pods/519f5493-9a23-48d9-9365-7bff7d6a49ae/volumes"
Jul 20 20:11:10.775056 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:10.775025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:10.787586 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:10.787555    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"]
Jul 20 20:11:10.789049 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:10.789027    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fffcf6-kj7gn"]
Jul 20 20:11:11.174314 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:11.174231    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:11.547410 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:11.547372    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ea2e34-a136-4d79-9303-b3a59671eb2d" path="/var/lib/kubelet/pods/c1ea2e34-a136-4d79-9303-b3a59671eb2d/volumes"
Jul 20 20:11:17.005697 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:17.005667    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:17.104907 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:17.104876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:17.318314 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:17.318223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:17.572307 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:17.572212    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:17.955845 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:17.955747    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:18.302727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:18.302696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:18.715450 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:18.715374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:21.359302 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.359268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:21.458713 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.458677    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:21.511866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.511837    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:11:21.512205 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512191    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ea2e34-a136-4d79-9303-b3a59671eb2d" containerName="revoke-keys"
Jul 20 20:11:21.512252 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512207    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ea2e34-a136-4d79-9303-b3a59671eb2d" containerName="revoke-keys"
Jul 20 20:11:21.512252 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512231    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519f5493-9a23-48d9-9365-7bff7d6a49ae" containerName="maas-api"
Jul 20 20:11:21.512252 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512237    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="519f5493-9a23-48d9-9365-7bff7d6a49ae" containerName="maas-api"
Jul 20 20:11:21.512350 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512290    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ea2e34-a136-4d79-9303-b3a59671eb2d" containerName="revoke-keys"
Jul 20 20:11:21.512350 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.512303    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="519f5493-9a23-48d9-9365-7bff7d6a49ae" containerName="maas-api"
Jul 20 20:11:21.515124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.515104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.520273 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.520249    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-9305d0-serving-cert\""
Jul 20 20:11:21.526308 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.526286    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:11:21.555017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.554986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:21.625526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.625440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxx5f\" (UniqueName: \"kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.625526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.625486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.625526 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.625512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.726047 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.726011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.726215 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.726053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.726215 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.726131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxx5f\" (UniqueName: \"kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.726215 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:21.726198    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-serving-cert: secret "maas-api-e2e-shared-a-9305d0-serving-cert" not found
Jul 20 20:11:21.726323 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:21.726271    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls podName:c9cfae1f-b496-4883-b822-2ba8b35f4be6 nodeName:}" failed. No retries permitted until 2026-07-20 20:11:22.226250899 +0000 UTC m=+2624.328714238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls") pod "maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" (UID: "c9cfae1f-b496-4883-b822-2ba8b35f4be6") : secret "maas-api-e2e-shared-a-9305d0-serving-cert" not found
Jul 20 20:11:21.726593 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.726575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.740546 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.740517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxx5f\" (UniqueName: \"kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:21.850622 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:21.850585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:22.172110 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.172077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:22.230160 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.230126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:22.232613 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.232590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") pod \"maas-api-e2e-shared-a-9305d0-c996cb444-l92gg\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:22.269871 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.269840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:22.425724 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.425639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:22.564275 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:22.564243    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:11:22.570858 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:11:22.570830    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cfae1f_b496_4883_b822_2ba8b35f4be6.slice/crio-e3c93ec3d003a1d5051f0b981241a8c7b92ccc0814d7e4c8b6eb7ff074ffa645 WatchSource:0}: Error finding container e3c93ec3d003a1d5051f0b981241a8c7b92ccc0814d7e4c8b6eb7ff074ffa645: Status 404 returned error can't find the container with id e3c93ec3d003a1d5051f0b981241a8c7b92ccc0814d7e4c8b6eb7ff074ffa645
Jul 20 20:11:23.382874 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:23.382787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" event={"ID":"c9cfae1f-b496-4883-b822-2ba8b35f4be6","Type":"ContainerStarted","Data":"b69576655bb5c913e48120f1b85aa4a631243468d469db3d290367f7c815dc83"}
Jul 20 20:11:23.382874 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:23.382840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" event={"ID":"c9cfae1f-b496-4883-b822-2ba8b35f4be6","Type":"ContainerStarted","Data":"e3c93ec3d003a1d5051f0b981241a8c7b92ccc0814d7e4c8b6eb7ff074ffa645"}
Jul 20 20:11:23.382874 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:23.382868    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:23.404476 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:23.404429    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" podStartSLOduration=1.9418269970000002 podStartE2EDuration="2.40441659s" totalImagesPullingTime="462.589593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:11:23.402033015 +0000 UTC m=+2625.504496366" watchObservedRunningTime="2026-07-20 20:11:23.40441659 +0000 UTC m=+2625.506879988"
Jul 20 20:11:25.947628 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:25.947593    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:26.388134 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:26.388104    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:26.688320 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:26.688233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:26.797002 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:26.796972    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:27.228998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:27.228968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:29.372145 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.372112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:29.393807 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.393776    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:11:29.476808 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.476777    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:11:29.480039 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.480006    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:29.480367 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.480349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.483230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.483206    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b02932-serving-cert\""
Jul 20 20:11:29.495710 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.495585    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:11:29.580484 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.580449    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:29.592622 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.592596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.592727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.592629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzlzk\" (UniqueName: \"kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.592727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.592676    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.693868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.693787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzlzk\" (UniqueName: \"kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.693868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.693854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.694038 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.693909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.694038 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:29.694017    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-serving-cert: secret "maas-api-e2e-shared-b-b02932-serving-cert" not found
Jul 20 20:11:29.694122 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:29.694083    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls podName:1fc86eb8-2689-45cf-9620-df6be11bcc39 nodeName:}" failed. No retries permitted until 2026-07-20 20:11:30.19406545 +0000 UTC m=+2632.296528796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls") pod "maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" (UID: "1fc86eb8-2689-45cf-9620-df6be11bcc39") : secret "maas-api-e2e-shared-b-b02932-serving-cert" not found
Jul 20 20:11:29.694741 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.694714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:29.702953 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:29.702923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzlzk\" (UniqueName: \"kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:30.058376 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:30.058346    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:30.158952 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:30.158919    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:30.199433 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:30.199399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:30.199607 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:30.199549    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-serving-cert: secret "maas-api-e2e-shared-b-b02932-serving-cert" not found
Jul 20 20:11:30.199654 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:11:30.199619    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls podName:1fc86eb8-2689-45cf-9620-df6be11bcc39 nodeName:}" failed. No retries permitted until 2026-07-20 20:11:31.199599229 +0000 UTC m=+2633.302062574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls") pod "maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" (UID: "1fc86eb8-2689-45cf-9620-df6be11bcc39") : secret "maas-api-e2e-shared-b-b02932-serving-cert" not found
Jul 20 20:11:30.540916 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:30.540885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:31.208261 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:31.208221    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:31.210648 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:31.210620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"maas-api-e2e-shared-b-b02932-85646c5886-ljvlh\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:31.291710 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:31.291675    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:31.426572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:31.426461    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:11:31.428820 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:11:31.428791    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc86eb8_2689_45cf_9620_df6be11bcc39.slice/crio-0975870c961986ddb59609596ed9918194522dfa3b45a0ec31d1de46948f519f WatchSource:0}: Error finding container 0975870c961986ddb59609596ed9918194522dfa3b45a0ec31d1de46948f519f: Status 404 returned error can't find the container with id 0975870c961986ddb59609596ed9918194522dfa3b45a0ec31d1de46948f519f
Jul 20 20:11:32.427285 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:32.427192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" event={"ID":"1fc86eb8-2689-45cf-9620-df6be11bcc39","Type":"ContainerStarted","Data":"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"}
Jul 20 20:11:32.427285 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:32.427245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" event={"ID":"1fc86eb8-2689-45cf-9620-df6be11bcc39","Type":"ContainerStarted","Data":"0975870c961986ddb59609596ed9918194522dfa3b45a0ec31d1de46948f519f"}
Jul 20 20:11:32.427285 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:32.427275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:32.447466 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:32.447416    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" podStartSLOduration=2.795294739 podStartE2EDuration="3.447402691s" totalImagesPullingTime="652.107952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:11:32.445802327 +0000 UTC m=+2634.548265677" watchObservedRunningTime="2026-07-20 20:11:32.447402691 +0000 UTC m=+2634.549866041"
Jul 20 20:11:33.933329 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:33.933294    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:38.437133 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:38.437103    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:11:39.543362 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:39.543325    2571 scope.go:117] "RemoveContainer" containerID="9a832d5eb3e23c5f0596a4dd1872635ee77d7ce528eb140c210194e86bc3fe52"
Jul 20 20:11:42.974175 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:42.974137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:43.073969 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:43.073918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:50.883297 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:50.883256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:11:50.984644 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:11:50.984612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:12:26.765282 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.765248    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:12:26.768803 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.768780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.772877 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.772847    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"kube-root-ca.crt\""
Jul 20 20:12:26.772877 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.772874    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"default-dockercfg-nc7gx\""
Jul 20 20:12:26.773032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.772906    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"openshift-service-ca.crt\""
Jul 20 20:12:26.773032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.772908    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"auth-test-model-9305d0-kserve-self-signed-certs\""
Jul 20 20:12:26.779436 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.779415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:12:26.792475 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.792448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:12:26.885357 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9lb8\" (UniqueName: \"kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.885536 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.885536 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.885536 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.885536 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.885722 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.885541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.986721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.986682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.986721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.986722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.986980 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.986864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9lb8\" (UniqueName: \"kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.986980 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.986955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.987096 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.987015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.987096 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.987051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.987206 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.987181    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.987206 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.987195    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.987406 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.987372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.989194 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.989174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.989358 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.989340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:26.995389 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:26.995366    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9lb8\" (UniqueName: \"kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8\") pod \"auth-test-model-9305d0-kserve-54db84df95-4bnnz\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") " pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:27.079039 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:27.078952    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:27.209894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:27.209873    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:12:27.211773 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:12:27.211735    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f54bd20_751e_4518_bb8b_53f7efd9fae7.slice/crio-897d7c01a7fc328f7e3365f59182a5312fe03b90a88c1f10eac7fbe7c374cf3e WatchSource:0}: Error finding container 897d7c01a7fc328f7e3365f59182a5312fe03b90a88c1f10eac7fbe7c374cf3e: Status 404 returned error can't find the container with id 897d7c01a7fc328f7e3365f59182a5312fe03b90a88c1f10eac7fbe7c374cf3e
Jul 20 20:12:27.676507 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:27.676463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" event={"ID":"9f54bd20-751e-4518-bb8b-53f7efd9fae7","Type":"ContainerStarted","Data":"f9d803b45201df7a3a5ce7a50f4463efe2949ce641b791f768bfc1ced2a802ae"}
Jul 20 20:12:27.676507 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:27.676514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" event={"ID":"9f54bd20-751e-4518-bb8b-53f7efd9fae7","Type":"ContainerStarted","Data":"897d7c01a7fc328f7e3365f59182a5312fe03b90a88c1f10eac7fbe7c374cf3e"}
Jul 20 20:12:27.695722 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:27.695673    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" podStartSLOduration=1.695659256 podStartE2EDuration="1.695659256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:12:27.693872055 +0000 UTC m=+2689.796335404" watchObservedRunningTime="2026-07-20 20:12:27.695659256 +0000 UTC m=+2689.798122604"
Jul 20 20:12:29.847080 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:29.846999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:12:29.948297 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:29.948261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:12:37.079823 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:37.079780    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:37.079823 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:37.079831    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:37.092507 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:37.092477    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:37.732466 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:37.732438    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:12:39.398078 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:39.398043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:12:39.404003 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:39.403981    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:12:54.306805 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:12:54.306744    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:13:44.908872 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:13:44.908836    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:14:57.292405 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:14:57.292370    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:14:57.360354 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:14:57.360325    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:14:58.679823 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:14:58.679790    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:00.136507 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.136476    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"]
Jul 20 20:15:00.139898 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.139870    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"
Jul 20 20:15:00.140895 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.140870    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"]
Jul 20 20:15:00.142538 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.142518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:15:00.143867 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.143850    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"]
Jul 20 20:15:00.143975 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.143958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"
Jul 20 20:15:00.147392 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.146948    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"
Jul 20 20:15:00.150419 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.150394    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"]
Jul 20 20:15:00.152012 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.151987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"]
Jul 20 20:15:00.152305 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.152286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"
Jul 20 20:15:00.161425 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.161405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"
Jul 20 20:15:00.166167 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.166136    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"]
Jul 20 20:15:00.199678 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.199655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"
Jul 20 20:15:00.320212 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.319092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"]
Jul 20 20:15:00.322688 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:15:00.322652    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5e287a_71a4_41cd_98b1_1472e1a083cf.slice/crio-7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520 WatchSource:0}: Error finding container 7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520: Status 404 returned error can't find the container with id 7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520
Jul 20 20:15:00.349547 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.349520    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"]
Jul 20 20:15:00.353011 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:15:00.352986    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626fd30a_87e1_4403_8b4b_5650b5c21841.slice/crio-76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f WatchSource:0}: Error finding container 76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f: Status 404 returned error can't find the container with id 76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f
Jul 20 20:15:00.367820 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.367793    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7" event={"ID":"8f5e287a-71a4-41cd-98b1-1472e1a083cf","Type":"ContainerStarted","Data":"7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520"}
Jul 20 20:15:00.369100 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.369075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx" event={"ID":"626fd30a-87e1-4403-8b4b-5650b5c21841","Type":"ContainerStarted","Data":"76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f"}
Jul 20 20:15:00.372187 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:00.372164    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"]
Jul 20 20:15:00.386848 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:15:00.386790    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ba639a_efc4_4b5a_98c0_7724559fe379.slice/crio-2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406 WatchSource:0}: Error finding container 2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406: Status 404 returned error can't find the container with id 2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406
Jul 20 20:15:01.375167 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.375132    2571 generic.go:356] "Generic (PLEG): container finished" podID="8f5e287a-71a4-41cd-98b1-1472e1a083cf" containerID="99d399796bb9fbc1e3ad28223668e73eb9f84ccf88b2cc333d423c1485883ec7" exitCode=0
Jul 20 20:15:01.375541 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.375163    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7" event={"ID":"8f5e287a-71a4-41cd-98b1-1472e1a083cf","Type":"ContainerDied","Data":"99d399796bb9fbc1e3ad28223668e73eb9f84ccf88b2cc333d423c1485883ec7"}
Jul 20 20:15:01.376814 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.376781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx" event={"ID":"626fd30a-87e1-4403-8b4b-5650b5c21841","Type":"ContainerStarted","Data":"a0022a93bcce6171340bfcd888c458aa54ec8d1567f7b8cb7ca4e0faf80742a0"}
Jul 20 20:15:01.378141 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.378121    2571 generic.go:356] "Generic (PLEG): container finished" podID="c4ba639a-efc4-4b5a-98c0-7724559fe379" containerID="c0a685d142e1a1670551c8dcbc47f74fe7d761d874e924fb81ad2d9d21b6fed3" exitCode=0
Jul 20 20:15:01.378262 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.378151    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm" event={"ID":"c4ba639a-efc4-4b5a-98c0-7724559fe379","Type":"ContainerDied","Data":"c0a685d142e1a1670551c8dcbc47f74fe7d761d874e924fb81ad2d9d21b6fed3"}
Jul 20 20:15:01.378262 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.378190    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm" event={"ID":"c4ba639a-efc4-4b5a-98c0-7724559fe379","Type":"ContainerStarted","Data":"2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406"}
Jul 20 20:15:01.424336 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:01.424290    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx" podStartSLOduration=1.424273841 podStartE2EDuration="1.424273841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:15:01.423074041 +0000 UTC m=+2843.525537393" watchObservedRunningTime="2026-07-20 20:15:01.424273841 +0000 UTC m=+2843.526737189"
Jul 20 20:15:02.384740 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:02.384706    2571 generic.go:356] "Generic (PLEG): container finished" podID="626fd30a-87e1-4403-8b4b-5650b5c21841" containerID="a0022a93bcce6171340bfcd888c458aa54ec8d1567f7b8cb7ca4e0faf80742a0" exitCode=0
Jul 20 20:15:02.385233 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:02.384796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx" event={"ID":"626fd30a-87e1-4403-8b4b-5650b5c21841","Type":"ContainerDied","Data":"a0022a93bcce6171340bfcd888c458aa54ec8d1567f7b8cb7ca4e0faf80742a0"}
Jul 20 20:15:02.525803 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:02.525779    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"
Jul 20 20:15:02.528544 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:02.528524    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"
Jul 20 20:15:03.390572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.390540    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"
Jul 20 20:15:03.390572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.390569    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm" event={"ID":"c4ba639a-efc4-4b5a-98c0-7724559fe379","Type":"ContainerDied","Data":"2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406"}
Jul 20 20:15:03.391060 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.390613    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d3203ecc5ac56082f111e9b8dbc343feee40e3c62c9095e96aaf13e91d5a406"
Jul 20 20:15:03.392003 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.391980    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"
Jul 20 20:15:03.392134 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.391978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7" event={"ID":"8f5e287a-71a4-41cd-98b1-1472e1a083cf","Type":"ContainerDied","Data":"7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520"}
Jul 20 20:15:03.392134 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.392097    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7596377a8c10fe75a969ce8d96f5950b219ab90010ec414f3a4d72ee317de520"
Jul 20 20:15:03.519995 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:03.519966    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"
Jul 20 20:15:04.397500 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:04.397462    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx"
Jul 20 20:15:04.397500 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:04.397477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742975-zkwjx" event={"ID":"626fd30a-87e1-4403-8b4b-5650b5c21841","Type":"ContainerDied","Data":"76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f"}
Jul 20 20:15:04.397910 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:04.397518    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76702f60142b436f657e30be327313abcf1bcd2ae33a0705430dd5b462569d7f"
Jul 20 20:15:08.882024 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.881991    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:15:08.882506 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882486    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626fd30a-87e1-4403-8b4b-5650b5c21841" containerName="cleanup"
Jul 20 20:15:08.882589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882508    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="626fd30a-87e1-4403-8b4b-5650b5c21841" containerName="cleanup"
Jul 20 20:15:08.882589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882532    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f5e287a-71a4-41cd-98b1-1472e1a083cf" containerName="cleanup"
Jul 20 20:15:08.882589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882540    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f5e287a-71a4-41cd-98b1-1472e1a083cf" containerName="cleanup"
Jul 20 20:15:08.882589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882558    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ba639a-efc4-4b5a-98c0-7724559fe379" containerName="cleanup"
Jul 20 20:15:08.882589 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882566    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ba639a-efc4-4b5a-98c0-7724559fe379" containerName="cleanup"
Jul 20 20:15:08.882866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882643    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="626fd30a-87e1-4403-8b4b-5650b5c21841" containerName="cleanup"
Jul 20 20:15:08.882866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882658    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f5e287a-71a4-41cd-98b1-1472e1a083cf" containerName="cleanup"
Jul 20 20:15:08.882866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.882669    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ba639a-efc4-4b5a-98c0-7724559fe379" containerName="cleanup"
Jul 20 20:15:08.885804 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.885782    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.888713 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.888695    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"sub-test-model-9305d0-kserve-self-signed-certs\""
Jul 20 20:15:08.897552 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.897526    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:15:08.909808 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.909750    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:08.988043 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27f7\" (UniqueName: \"kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.988214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.988214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.988214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.988214 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:08.988352 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:08.988241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089398 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089398 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089601 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089601 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k27f7\" (UniqueName: \"kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089668 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089750 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089862 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.089997 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.089980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.090093 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.090075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.091810 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.091790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.091988 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.091971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.097927 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.097898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27f7\" (UniqueName: \"kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7\") pod \"sub-test-model-9305d0-kserve-6867c76985-kxkd2\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") " pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.196454 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.196378    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:09.330483 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.330456    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:15:09.332304 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:15:09.332275    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ae7d166_af91_4fab_a018_679e8aecdb5d.slice/crio-e449fb064038f9965f2620bd4c4b027d28777773302003ac0eee0fbcf3b6cdd7 WatchSource:0}: Error finding container e449fb064038f9965f2620bd4c4b027d28777773302003ac0eee0fbcf3b6cdd7: Status 404 returned error can't find the container with id e449fb064038f9965f2620bd4c4b027d28777773302003ac0eee0fbcf3b6cdd7
Jul 20 20:15:09.421649 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.421609    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" event={"ID":"0ae7d166-af91-4fab-a018-679e8aecdb5d","Type":"ContainerStarted","Data":"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"}
Jul 20 20:15:09.421865 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.421662    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" event={"ID":"0ae7d166-af91-4fab-a018-679e8aecdb5d","Type":"ContainerStarted","Data":"e449fb064038f9965f2620bd4c4b027d28777773302003ac0eee0fbcf3b6cdd7"}
Jul 20 20:15:09.441371 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:09.441322    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" podStartSLOduration=1.441299162 podStartE2EDuration="1.441299162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:15:09.440049069 +0000 UTC m=+2851.542512420" watchObservedRunningTime="2026-07-20 20:15:09.441299162 +0000 UTC m=+2851.543762544"
Jul 20 20:15:12.311891 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.311839    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" podUID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" containerName="main" containerID="cri-o://f9d803b45201df7a3a5ce7a50f4463efe2949ce641b791f768bfc1ced2a802ae" gracePeriod=45
Jul 20 20:15:12.437365 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.437335    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" containerID="f9d803b45201df7a3a5ce7a50f4463efe2949ce641b791f768bfc1ced2a802ae" exitCode=0
Jul 20 20:15:12.437498 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.437410    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" event={"ID":"9f54bd20-751e-4518-bb8b-53f7efd9fae7","Type":"ContainerDied","Data":"f9d803b45201df7a3a5ce7a50f4463efe2949ce641b791f768bfc1ced2a802ae"}
Jul 20 20:15:12.562111 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.562039    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:15:12.722032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.721998    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722218 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722218 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722115    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722218 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722136    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722218 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9lb8\" (UniqueName: \"kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722218 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm\") pod \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\" (UID: \"9f54bd20-751e-4518-bb8b-53f7efd9fae7\") "
Jul 20 20:15:12.722489 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722308    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:15:12.722489 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722394    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home" (OuterVolumeSpecName: "home") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:15:12.722489 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.722403    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:15:12.724434 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.724401    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm" (OuterVolumeSpecName: "dshm") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:15:12.724544 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.724489    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:15:12.724544 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.724530    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8" (OuterVolumeSpecName: "kube-api-access-v9lb8") pod "9f54bd20-751e-4518-bb8b-53f7efd9fae7" (UID: "9f54bd20-751e-4518-bb8b-53f7efd9fae7"). InnerVolumeSpecName "kube-api-access-v9lb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823807    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823836    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823847    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f54bd20-751e-4518-bb8b-53f7efd9fae7-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823854    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823864    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9lb8\" (UniqueName: \"kubernetes.io/projected/9f54bd20-751e-4518-bb8b-53f7efd9fae7-kube-api-access-v9lb8\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:12.823894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:12.823872    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f54bd20-751e-4518-bb8b-53f7efd9fae7-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:15:13.443934 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.443899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz" event={"ID":"9f54bd20-751e-4518-bb8b-53f7efd9fae7","Type":"ContainerDied","Data":"897d7c01a7fc328f7e3365f59182a5312fe03b90a88c1f10eac7fbe7c374cf3e"}
Jul 20 20:15:13.443934 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.443932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"
Jul 20 20:15:13.444455 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.443955    2571 scope.go:117] "RemoveContainer" containerID="f9d803b45201df7a3a5ce7a50f4463efe2949ce641b791f768bfc1ced2a802ae"
Jul 20 20:15:13.463952 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.463926    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:15:13.467630 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.467610    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/auth-test-model-9305d0-kserve-54db84df95-4bnnz"]
Jul 20 20:15:13.547341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:13.547313    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" path="/var/lib/kubelet/pods/9f54bd20-751e-4518-bb8b-53f7efd9fae7/volumes"
Jul 20 20:15:17.883978 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:17.883949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:19.196732 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:19.196700    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:19.197134 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:19.196749    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:19.209082 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:19.209059    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:19.483115 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:19.483088    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:15:22.917738 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:22.917699    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:39.588107 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:39.588032    2571 scope.go:117] "RemoveContainer" containerID="e664caded76d3a4855c5587d737daeea418b28eb1e7fc78943bb2730247825a1"
Jul 20 20:15:39.595812 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:39.595794    2571 scope.go:117] "RemoveContainer" containerID="12d3f2ff04fe01ed17dec57c102588f8b28095a6acd7a6f063e2b0dc06fe76cd"
Jul 20 20:15:40.463160 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:40.463125    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:41.565341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:41.565307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:15:41.665418 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:15:41.665378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:13.260920 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:13.260882    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:16:13.294499 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:13.294466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:14.118993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:14.118961    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:27.088928 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.088897    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:16:27.089434 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.089413    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" containerName="main"
Jul 20 20:16:27.089509 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.089438    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" containerName="main"
Jul 20 20:16:27.089561 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.089525    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f54bd20-751e-4518-bb8b-53f7efd9fae7" containerName="main"
Jul 20 20:16:27.092475 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.092456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.095303 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.095284    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9305d0\"/\"rate-test-model-9305d0-kserve-self-signed-certs\""
Jul 20 20:16:27.106598 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.106573    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:16:27.130677 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.130647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:27.169181 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.169339 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.169339 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.169339 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.169509 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.169509 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.169417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnc4s\" (UniqueName: \"kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270562 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270732 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270732 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270732 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270655    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnc4s\" (UniqueName: \"kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270732 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.270968 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.270736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.271076 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.271053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.271138 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.271085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.271138 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.271104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.272831 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.272812    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.273224 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.273205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.280853 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.280820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnc4s\" (UniqueName: \"kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s\") pod \"rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") " pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.401041 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.400960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:27.534038 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.534012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:16:27.536112 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:16:27.536084    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdde1891_f086_4cbc_b743_a652b4d13b3f.slice/crio-2b4b45808d72cf4e3f40387793b9d9550cef6a33a5a01fe4e9973fb4ed459a85 WatchSource:0}: Error finding container 2b4b45808d72cf4e3f40387793b9d9550cef6a33a5a01fe4e9973fb4ed459a85: Status 404 returned error can't find the container with id 2b4b45808d72cf4e3f40387793b9d9550cef6a33a5a01fe4e9973fb4ed459a85
Jul 20 20:16:27.784606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.784572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" event={"ID":"cdde1891-f086-4cbc-b743-a652b4d13b3f","Type":"ContainerStarted","Data":"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"}
Jul 20 20:16:27.784804 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.784615    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" event={"ID":"cdde1891-f086-4cbc-b743-a652b4d13b3f","Type":"ContainerStarted","Data":"2b4b45808d72cf4e3f40387793b9d9550cef6a33a5a01fe4e9973fb4ed459a85"}
Jul 20 20:16:27.804796 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:27.804724    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" podStartSLOduration=0.804706767 podStartE2EDuration="804.706767ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:16:27.80242043 +0000 UTC m=+2929.904883785" watchObservedRunningTime="2026-07-20 20:16:27.804706767 +0000 UTC m=+2929.907170135"
Jul 20 20:16:28.281656 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.281614    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" podUID="0ae7d166-af91-4fab-a018-679e8aecdb5d" containerName="main" containerID="cri-o://6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025" gracePeriod=45
Jul 20 20:16:28.531312 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.531290    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:16:28.581267 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581191    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581402 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581273    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k27f7\" (UniqueName: \"kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581402 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581323    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581402 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581402 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581391    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581564 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs\") pod \"0ae7d166-af91-4fab-a018-679e8aecdb5d\" (UID: \"0ae7d166-af91-4fab-a018-679e8aecdb5d\") "
Jul 20 20:16:28.581564 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581450    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:16:28.581650 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581613    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:16:28.581696 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581671    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home" (OuterVolumeSpecName: "home") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:16:28.581747 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581700    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.581747 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.581715    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.583504 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.583471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm" (OuterVolumeSpecName: "dshm") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:16:28.583626 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.583504    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:16:28.583626 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.583554    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7" (OuterVolumeSpecName: "kube-api-access-k27f7") pod "0ae7d166-af91-4fab-a018-679e8aecdb5d" (UID: "0ae7d166-af91-4fab-a018-679e8aecdb5d"). InnerVolumeSpecName "kube-api-access-k27f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:16:28.683016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.682990    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k27f7\" (UniqueName: \"kubernetes.io/projected/0ae7d166-af91-4fab-a018-679e8aecdb5d-kube-api-access-k27f7\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.683016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.683013    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.683016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.683022    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae7d166-af91-4fab-a018-679e8aecdb5d-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.683016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.683030    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae7d166-af91-4fab-a018-679e8aecdb5d-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:16:28.789847 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.789813    2571 generic.go:356] "Generic (PLEG): container finished" podID="0ae7d166-af91-4fab-a018-679e8aecdb5d" containerID="6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025" exitCode=0
Jul 20 20:16:28.790032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.789861    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"
Jul 20 20:16:28.790032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.789899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" event={"ID":"0ae7d166-af91-4fab-a018-679e8aecdb5d","Type":"ContainerDied","Data":"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"}
Jul 20 20:16:28.790032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.789947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2" event={"ID":"0ae7d166-af91-4fab-a018-679e8aecdb5d","Type":"ContainerDied","Data":"e449fb064038f9965f2620bd4c4b027d28777773302003ac0eee0fbcf3b6cdd7"}
Jul 20 20:16:28.790032 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.789965    2571 scope.go:117] "RemoveContainer" containerID="6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"
Jul 20 20:16:28.798514 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.798499    2571 scope.go:117] "RemoveContainer" containerID="6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"
Jul 20 20:16:28.798818 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:16:28.798795    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025\": container with ID starting with 6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025 not found: ID does not exist" containerID="6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"
Jul 20 20:16:28.798918 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.798826    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025"} err="failed to get container status \"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025\": rpc error: code = NotFound desc = could not find container \"6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025\": container with ID starting with 6541f2100ad31ddbb83cbfa7acd6ac57d8a9a99cb78ced48663186e37b87d025 not found: ID does not exist"
Jul 20 20:16:28.811941 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.811922    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:16:28.815944 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:28.815921    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/sub-test-model-9305d0-kserve-6867c76985-kxkd2"]
Jul 20 20:16:29.548453 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:29.548410    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae7d166-af91-4fab-a018-679e8aecdb5d" path="/var/lib/kubelet/pods/0ae7d166-af91-4fab-a018-679e8aecdb5d/volumes"
Jul 20 20:16:37.401603 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:37.401564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:37.402118 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:37.401642    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:37.414144 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:37.414121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:37.844668 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:37.844634    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:16:39.621647 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:39.621619    2571 scope.go:117] "RemoveContainer" containerID="289ebff7adf1b51ad61b062f83bdde95c1bc30cb095417fdb14cca4f96eebf78"
Jul 20 20:16:43.917258 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:43.917220    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:44.018427 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:44.018388    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:50.398463 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:50.398429    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:51.762142 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:51.762099    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:16:51.862200 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:16:51.862172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:17:39.432129 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:39.432099    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:17:39.439796 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:39.439772    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnxnl_d56748cb-ef21-4ef2-b0c6-273b157391f0/ovn-acl-logging/0.log"
Jul 20 20:17:39.643347 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:39.643308    2571 scope.go:117] "RemoveContainer" containerID="ce201874913b3d59e36d95d94213fcbbf2b7fc813ff8be178166e9f6d1a5e33a"
Jul 20 20:17:40.917632 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:40.917600    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:17:40.942554 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:40.942518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:17:41.891048 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:41.890996    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:17:42.915211 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.915176    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961441072"]
Jul 20 20:17:42.915588 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.915503    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae7d166-af91-4fab-a018-679e8aecdb5d" containerName="main"
Jul 20 20:17:42.915588 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.915514    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae7d166-af91-4fab-a018-679e8aecdb5d" containerName="main"
Jul 20 20:17:42.915588 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.915583    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae7d166-af91-4fab-a018-679e8aecdb5d" containerName="main"
Jul 20 20:17:42.919730 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.919713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:42.922635 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.922600    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4bc2q\""
Jul 20 20:17:42.924836 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:42.924809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961441072"]
Jul 20 20:17:43.050993 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.050964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l77js\" (UniqueName: \"kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js\") pod \"test-curl-7441-140361961441072\" (UID: \"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a\") " pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:43.152362 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.152329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l77js\" (UniqueName: \"kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js\") pod \"test-curl-7441-140361961441072\" (UID: \"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a\") " pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:43.161126 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.161105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l77js\" (UniqueName: \"kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js\") pod \"test-curl-7441-140361961441072\" (UID: \"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a\") " pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:43.230163 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.230135    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:43.358897 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.358861    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961441072"]
Jul 20 20:17:43.362920 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:43.362893    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd8eba7_a265_4f6d_be80_a7b5262c8e2a.slice/crio-7a5de4c98464f3aa94e5976f5822b872d7b17391c4b8a2ea8cf0963bb404b8c4 WatchSource:0}: Error finding container 7a5de4c98464f3aa94e5976f5822b872d7b17391c4b8a2ea8cf0963bb404b8c4: Status 404 returned error can't find the container with id 7a5de4c98464f3aa94e5976f5822b872d7b17391c4b8a2ea8cf0963bb404b8c4
Jul 20 20:17:43.364232 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:43.364212    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:17:44.141517 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:44.141491    2571 generic.go:356] "Generic (PLEG): container finished" podID="5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" containerID="9c044a8c0ebda60fd99f82dd61d9cdf4b7903d0197b5544ae1d26a146393ef9c" exitCode=0
Jul 20 20:17:44.141864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:44.141575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961441072" event={"ID":"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a","Type":"ContainerDied","Data":"9c044a8c0ebda60fd99f82dd61d9cdf4b7903d0197b5544ae1d26a146393ef9c"}
Jul 20 20:17:44.141864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:44.141616    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961441072" event={"ID":"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a","Type":"ContainerStarted","Data":"7a5de4c98464f3aa94e5976f5822b872d7b17391c4b8a2ea8cf0963bb404b8c4"}
Jul 20 20:17:45.284019 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.283995    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:45.306249 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.306216    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961441072_5dd8eba7-a265-4f6d-be80-a7b5262c8e2a/test-curl-7441-140361961441072/0.log"
Jul 20 20:17:45.330117 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.330088    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961441072"]
Jul 20 20:17:45.334162 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.334141    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961441072"]
Jul 20 20:17:45.378580 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.378552    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l77js\" (UniqueName: \"kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js\") pod \"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a\" (UID: \"5dd8eba7-a265-4f6d-be80-a7b5262c8e2a\") "
Jul 20 20:17:45.380562 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.380534    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js" (OuterVolumeSpecName: "kube-api-access-l77js") pod "5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" (UID: "5dd8eba7-a265-4f6d-be80-a7b5262c8e2a"). InnerVolumeSpecName "kube-api-access-l77js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:45.459393 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.459310    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961399984"]
Jul 20 20:17:45.459714 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.459697    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" containerName="test-curl-7441-140361961441072"
Jul 20 20:17:45.459784 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.459716    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" containerName="test-curl-7441-140361961441072"
Jul 20 20:17:45.459825 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.459813    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" containerName="test-curl-7441-140361961441072"
Jul 20 20:17:45.462889 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.462871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:45.469592 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.469562    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961399984"]
Jul 20 20:17:45.479361 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.479334    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l77js\" (UniqueName: \"kubernetes.io/projected/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a-kube-api-access-l77js\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:45.547619 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.547588    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd8eba7-a265-4f6d-be80-a7b5262c8e2a" path="/var/lib/kubelet/pods/5dd8eba7-a265-4f6d-be80-a7b5262c8e2a/volumes"
Jul 20 20:17:45.579780 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.579729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9c9\" (UniqueName: \"kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9\") pod \"test-curl-7441-140361961399984\" (UID: \"a7285368-4856-4d43-b956-a281513c59f7\") " pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:45.680625 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.680574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9c9\" (UniqueName: \"kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9\") pod \"test-curl-7441-140361961399984\" (UID: \"a7285368-4856-4d43-b956-a281513c59f7\") " pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:45.691473 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.691441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9c9\" (UniqueName: \"kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9\") pod \"test-curl-7441-140361961399984\" (UID: \"a7285368-4856-4d43-b956-a281513c59f7\") " pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:45.773498 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.773466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:45.898630 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:45.898604    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961399984"]
Jul 20 20:17:45.901066 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:45.901040    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7285368_4856_4d43_b956_a281513c59f7.slice/crio-4ac014506f13a9e1934a2c626f282783af18bc045ef640d090a014ed0f4d2e5f WatchSource:0}: Error finding container 4ac014506f13a9e1934a2c626f282783af18bc045ef640d090a014ed0f4d2e5f: Status 404 returned error can't find the container with id 4ac014506f13a9e1934a2c626f282783af18bc045ef640d090a014ed0f4d2e5f
Jul 20 20:17:46.152638 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:46.152545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961399984" event={"ID":"a7285368-4856-4d43-b956-a281513c59f7","Type":"ContainerStarted","Data":"4ac014506f13a9e1934a2c626f282783af18bc045ef640d090a014ed0f4d2e5f"}
Jul 20 20:17:46.153836 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:46.153816    2571 scope.go:117] "RemoveContainer" containerID="9c044a8c0ebda60fd99f82dd61d9cdf4b7903d0197b5544ae1d26a146393ef9c"
Jul 20 20:17:46.153962 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:46.153834    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961441072"
Jul 20 20:17:46.290172 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:17:46.290142    2571 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7285368_4856_4d43_b956_a281513c59f7.slice/crio-conmon-067170cab8215480c1a66a7b9fbe8960140316b2076630c654e63072eee85128.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7285368_4856_4d43_b956_a281513c59f7.slice/crio-067170cab8215480c1a66a7b9fbe8960140316b2076630c654e63072eee85128.scope\": RecentStats: unable to find data in memory cache]"
Jul 20 20:17:47.159635 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:47.159591    2571 generic.go:356] "Generic (PLEG): container finished" podID="a7285368-4856-4d43-b956-a281513c59f7" containerID="067170cab8215480c1a66a7b9fbe8960140316b2076630c654e63072eee85128" exitCode=0
Jul 20 20:17:47.159829 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:47.159678    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961399984" event={"ID":"a7285368-4856-4d43-b956-a281513c59f7","Type":"ContainerDied","Data":"067170cab8215480c1a66a7b9fbe8960140316b2076630c654e63072eee85128"}
Jul 20 20:17:48.294230 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.294209    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:48.314870 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.314849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961399984_a7285368-4856-4d43-b956-a281513c59f7/test-curl-7441-140361961399984/0.log"
Jul 20 20:17:48.339963 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.339934    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961399984"]
Jul 20 20:17:48.344130 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.344106    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961399984"]
Jul 20 20:17:48.405656 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.405625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb9c9\" (UniqueName: \"kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9\") pod \"a7285368-4856-4d43-b956-a281513c59f7\" (UID: \"a7285368-4856-4d43-b956-a281513c59f7\") "
Jul 20 20:17:48.407667 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.407646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9" (OuterVolumeSpecName: "kube-api-access-nb9c9") pod "a7285368-4856-4d43-b956-a281513c59f7" (UID: "a7285368-4856-4d43-b956-a281513c59f7"). InnerVolumeSpecName "kube-api-access-nb9c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:48.506777 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.506724    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb9c9\" (UniqueName: \"kubernetes.io/projected/a7285368-4856-4d43-b956-a281513c59f7-kube-api-access-nb9c9\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:48.521987 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.521958    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:48.522315 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.522302    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7285368-4856-4d43-b956-a281513c59f7" containerName="test-curl-7441-140361961399984"
Jul 20 20:17:48.522368 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.522317    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7285368-4856-4d43-b956-a281513c59f7" containerName="test-curl-7441-140361961399984"
Jul 20 20:17:48.522408 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.522368    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7285368-4856-4d43-b956-a281513c59f7" containerName="test-curl-7441-140361961399984"
Jul 20 20:17:48.525064 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.525049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:48.532024 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.531973    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:48.708377 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.708346    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bdl\" (UniqueName: \"kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl\") pod \"test-curl-7441-140361961341264\" (UID: \"8fbda55d-495f-46dd-b50f-12a674c07766\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:48.809727 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.809636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bdl\" (UniqueName: \"kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl\") pod \"test-curl-7441-140361961341264\" (UID: \"8fbda55d-495f-46dd-b50f-12a674c07766\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:48.818800 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.818748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bdl\" (UniqueName: \"kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl\") pod \"test-curl-7441-140361961341264\" (UID: \"8fbda55d-495f-46dd-b50f-12a674c07766\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:48.834641 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.834611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:48.967745 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:48.967698    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:48.974382 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:48.974356    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fbda55d_495f_46dd_b50f_12a674c07766.slice/crio-478e934f542897e5b1904866ad33626f3cbc3a94baccee7de1b846d3656f5c76 WatchSource:0}: Error finding container 478e934f542897e5b1904866ad33626f3cbc3a94baccee7de1b846d3656f5c76: Status 404 returned error can't find the container with id 478e934f542897e5b1904866ad33626f3cbc3a94baccee7de1b846d3656f5c76
Jul 20 20:17:49.171014 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:49.170923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961341264" event={"ID":"8fbda55d-495f-46dd-b50f-12a674c07766","Type":"ContainerStarted","Data":"478e934f542897e5b1904866ad33626f3cbc3a94baccee7de1b846d3656f5c76"}
Jul 20 20:17:49.172087 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:49.172064    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ac014506f13a9e1934a2c626f282783af18bc045ef640d090a014ed0f4d2e5f"
Jul 20 20:17:49.172205 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:49.172095    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:49.182542 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:17:49.182515    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-140361961399984\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" podUID="a7285368-4856-4d43-b956-a281513c59f7" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:49.546326 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:17:49.546283    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-140361961399984\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" podUID="a7285368-4856-4d43-b956-a281513c59f7" pod="opendatahub/test-curl-7441-140361961399984"
Jul 20 20:17:49.548960 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:49.548936    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7285368-4856-4d43-b956-a281513c59f7" path="/var/lib/kubelet/pods/a7285368-4856-4d43-b956-a281513c59f7/volumes"
Jul 20 20:17:50.177388 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:50.177352    2571 generic.go:356] "Generic (PLEG): container finished" podID="8fbda55d-495f-46dd-b50f-12a674c07766" containerID="ff596ee089e980ed1e4d1c5958708276596e97b38beaacbdaccb8eedc28c38cd" exitCode=0
Jul 20 20:17:50.177595 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:50.177412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961341264" event={"ID":"8fbda55d-495f-46dd-b50f-12a674c07766","Type":"ContainerDied","Data":"ff596ee089e980ed1e4d1c5958708276596e97b38beaacbdaccb8eedc28c38cd"}
Jul 20 20:17:51.305986 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.305957    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.326528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.326505    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961341264_8fbda55d-495f-46dd-b50f-12a674c07766/test-curl-7441-140361961341264/0.log"
Jul 20 20:17:51.328746 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.328727    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8bdl\" (UniqueName: \"kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl\") pod \"8fbda55d-495f-46dd-b50f-12a674c07766\" (UID: \"8fbda55d-495f-46dd-b50f-12a674c07766\") "
Jul 20 20:17:51.330806 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.330781    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl" (OuterVolumeSpecName: "kube-api-access-k8bdl") pod "8fbda55d-495f-46dd-b50f-12a674c07766" (UID: "8fbda55d-495f-46dd-b50f-12a674c07766"). InnerVolumeSpecName "kube-api-access-k8bdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:51.350071 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.350046    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:51.353688 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.353665    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:51.429894 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.429865    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8bdl\" (UniqueName: \"kubernetes.io/projected/8fbda55d-495f-46dd-b50f-12a674c07766-kube-api-access-k8bdl\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:51.490651 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.490621    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:51.491082 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.491067    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fbda55d-495f-46dd-b50f-12a674c07766" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:51.491130 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.491084    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbda55d-495f-46dd-b50f-12a674c07766" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:51.491170 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.491141    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fbda55d-495f-46dd-b50f-12a674c07766" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:51.493942 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.493926    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.498565 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.498535    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:51.530463 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.530436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8t5\" (UniqueName: \"kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5\") pod \"test-curl-7441-140361961341264\" (UID: \"82c93522-2fce-47e6-84bf-92e640569917\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.547665 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.547612    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fbda55d-495f-46dd-b50f-12a674c07766" path="/var/lib/kubelet/pods/8fbda55d-495f-46dd-b50f-12a674c07766/volumes"
Jul 20 20:17:51.631508 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.631474    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8t5\" (UniqueName: \"kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5\") pod \"test-curl-7441-140361961341264\" (UID: \"82c93522-2fce-47e6-84bf-92e640569917\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.641056 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.641026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8t5\" (UniqueName: \"kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5\") pod \"test-curl-7441-140361961341264\" (UID: \"82c93522-2fce-47e6-84bf-92e640569917\") " pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.803925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.803843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:51.927718 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:51.927691    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:51.929947 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:51.929918    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82c93522_2fce_47e6_84bf_92e640569917.slice/crio-96c16f460a84af8dae2adb284229fb2f69591bd4fc0c0da68cd9cf153444387e WatchSource:0}: Error finding container 96c16f460a84af8dae2adb284229fb2f69591bd4fc0c0da68cd9cf153444387e: Status 404 returned error can't find the container with id 96c16f460a84af8dae2adb284229fb2f69591bd4fc0c0da68cd9cf153444387e
Jul 20 20:17:52.188188 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:52.188102    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:52.188188 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:52.188132    2571 scope.go:117] "RemoveContainer" containerID="ff596ee089e980ed1e4d1c5958708276596e97b38beaacbdaccb8eedc28c38cd"
Jul 20 20:17:52.189595 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:52.189536    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961341264" event={"ID":"82c93522-2fce-47e6-84bf-92e640569917","Type":"ContainerStarted","Data":"96c16f460a84af8dae2adb284229fb2f69591bd4fc0c0da68cd9cf153444387e"}
Jul 20 20:17:53.197196 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:53.197160    2571 generic.go:356] "Generic (PLEG): container finished" podID="82c93522-2fce-47e6-84bf-92e640569917" containerID="43eb1fbc62566b8ad63d3653fa49a8be357ee12ed91dc57a1d8abac71ff3ea1f" exitCode=0
Jul 20 20:17:53.197591 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:53.197227    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961341264" event={"ID":"82c93522-2fce-47e6-84bf-92e640569917","Type":"ContainerDied","Data":"43eb1fbc62566b8ad63d3653fa49a8be357ee12ed91dc57a1d8abac71ff3ea1f"}
Jul 20 20:17:54.334925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.334901    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:54.350216 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.350194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw8t5\" (UniqueName: \"kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5\") pod \"82c93522-2fce-47e6-84bf-92e640569917\" (UID: \"82c93522-2fce-47e6-84bf-92e640569917\") "
Jul 20 20:17:54.352590 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.352561    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5" (OuterVolumeSpecName: "kube-api-access-dw8t5") pod "82c93522-2fce-47e6-84bf-92e640569917" (UID: "82c93522-2fce-47e6-84bf-92e640569917"). InnerVolumeSpecName "kube-api-access-dw8t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:54.359890 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.359871    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961341264_82c93522-2fce-47e6-84bf-92e640569917/test-curl-7441-140361961341264/0.log"
Jul 20 20:17:54.386869 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.386844    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:54.392053 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.392033    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961341264"]
Jul 20 20:17:54.450839 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.450809    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw8t5\" (UniqueName: \"kubernetes.io/projected/82c93522-2fce-47e6-84bf-92e640569917-kube-api-access-dw8t5\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:54.522980 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.522952    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:54.523311 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.523296    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c93522-2fce-47e6-84bf-92e640569917" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:54.523374 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.523314    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c93522-2fce-47e6-84bf-92e640569917" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:54.523374 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.523372    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c93522-2fce-47e6-84bf-92e640569917" containerName="test-curl-7441-140361961341264"
Jul 20 20:17:54.526341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.526323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:54.535650 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.535627    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:54.551190 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.551162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khw9x\" (UniqueName: \"kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x\") pod \"test-curl-7441-140361961313312\" (UID: \"ea6de858-62ec-4cbd-900b-9b88b475377c\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:54.652357 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.652316    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khw9x\" (UniqueName: \"kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x\") pod \"test-curl-7441-140361961313312\" (UID: \"ea6de858-62ec-4cbd-900b-9b88b475377c\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:54.661838 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.661804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khw9x\" (UniqueName: \"kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x\") pod \"test-curl-7441-140361961313312\" (UID: \"ea6de858-62ec-4cbd-900b-9b88b475377c\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:54.836375 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.836282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:54.966788 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:54.966745    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:54.968543 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:54.968512    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea6de858_62ec_4cbd_900b_9b88b475377c.slice/crio-38dd7e14c3ce9f07ce67a0fcfd5498419a907c6b4442b26063c6a68fef028916 WatchSource:0}: Error finding container 38dd7e14c3ce9f07ce67a0fcfd5498419a907c6b4442b26063c6a68fef028916: Status 404 returned error can't find the container with id 38dd7e14c3ce9f07ce67a0fcfd5498419a907c6b4442b26063c6a68fef028916
Jul 20 20:17:55.209864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:55.209746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961313312" event={"ID":"ea6de858-62ec-4cbd-900b-9b88b475377c","Type":"ContainerStarted","Data":"38dd7e14c3ce9f07ce67a0fcfd5498419a907c6b4442b26063c6a68fef028916"}
Jul 20 20:17:55.210850 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:55.210834    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:55.210924 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:55.210879    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96c16f460a84af8dae2adb284229fb2f69591bd4fc0c0da68cd9cf153444387e"
Jul 20 20:17:55.221310 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:17:55.221271    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-140361961341264\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" podUID="82c93522-2fce-47e6-84bf-92e640569917" pod="opendatahub/test-curl-7441-140361961341264"
Jul 20 20:17:55.547533 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:55.547499    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c93522-2fce-47e6-84bf-92e640569917" path="/var/lib/kubelet/pods/82c93522-2fce-47e6-84bf-92e640569917/volumes"
Jul 20 20:17:55.936970 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:55.936884    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" podUID="cdde1891-f086-4cbc-b743-a652b4d13b3f" containerName="main" containerID="cri-o://b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e" gracePeriod=45
Jul 20 20:17:56.199600 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.199547    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:17:56.216702 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.216678    2571 generic.go:356] "Generic (PLEG): container finished" podID="cdde1891-f086-4cbc-b743-a652b4d13b3f" containerID="b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e" exitCode=0
Jul 20 20:17:56.216854 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.216717    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"
Jul 20 20:17:56.216854 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.216752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" event={"ID":"cdde1891-f086-4cbc-b743-a652b4d13b3f","Type":"ContainerDied","Data":"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"}
Jul 20 20:17:56.216854 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.216812    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4" event={"ID":"cdde1891-f086-4cbc-b743-a652b4d13b3f","Type":"ContainerDied","Data":"2b4b45808d72cf4e3f40387793b9d9550cef6a33a5a01fe4e9973fb4ed459a85"}
Jul 20 20:17:56.216854 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.216836    2571 scope.go:117] "RemoveContainer" containerID="b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"
Jul 20 20:17:56.218480 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.218410    2571 generic.go:356] "Generic (PLEG): container finished" podID="ea6de858-62ec-4cbd-900b-9b88b475377c" containerID="5ab80b6437f3e54e680f802968628d54aba161ef9f6743a2bb13106bf4bbb606" exitCode=0
Jul 20 20:17:56.218617 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.218515    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961313312" event={"ID":"ea6de858-62ec-4cbd-900b-9b88b475377c","Type":"ContainerDied","Data":"5ab80b6437f3e54e680f802968628d54aba161ef9f6743a2bb13106bf4bbb606"}
Jul 20 20:17:56.225925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.225906    2571 scope.go:117] "RemoveContainer" containerID="b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"
Jul 20 20:17:56.226186 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:17:56.226168    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e\": container with ID starting with b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e not found: ID does not exist" containerID="b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"
Jul 20 20:17:56.226259 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.226192    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e"} err="failed to get container status \"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e\": rpc error: code = NotFound desc = could not find container \"b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e\": container with ID starting with b9c8c6770f717d2c8f2d7fde2920b16ca59ba55ab6b29b8d24724e5c64ab222e not found: ID does not exist"
Jul 20 20:17:56.265646 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.265828 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265674    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnc4s\" (UniqueName: \"kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.265828 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265713    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.265828 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265746    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.265998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265898    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.265998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265943    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home\") pod \"cdde1891-f086-4cbc-b743-a652b4d13b3f\" (UID: \"cdde1891-f086-4cbc-b743-a652b4d13b3f\") "
Jul 20 20:17:56.266124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.265989    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:17:56.266183 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.266132    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:17:56.266286 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.266259    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home" (OuterVolumeSpecName: "home") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:17:56.266352 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.266274    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-model-cache\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.266352 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.266309    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-tmp-dir\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.267924 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.267898    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm" (OuterVolumeSpecName: "dshm") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:17:56.268015 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.267941    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:17:56.268015 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.267976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s" (OuterVolumeSpecName: "kube-api-access-gnc4s") pod "cdde1891-f086-4cbc-b743-a652b4d13b3f" (UID: "cdde1891-f086-4cbc-b743-a652b4d13b3f"). InnerVolumeSpecName "kube-api-access-gnc4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:56.367511 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.367485    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnc4s\" (UniqueName: \"kubernetes.io/projected/cdde1891-f086-4cbc-b743-a652b4d13b3f-kube-api-access-gnc4s\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.367511 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.367508    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-dshm\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.367511 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.367518    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdde1891-f086-4cbc-b743-a652b4d13b3f-home\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.367721 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.367526    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdde1891-f086-4cbc-b743-a652b4d13b3f-tls-certs\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:56.538989 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.538955    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:17:56.543104 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:56.543081    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9305d0/rate-test-model-9305d0-kserve-5b7ff8dc75-hbnl4"]
Jul 20 20:17:57.356075 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.356051    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.376744 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.376719    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khw9x\" (UniqueName: \"kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x\") pod \"ea6de858-62ec-4cbd-900b-9b88b475377c\" (UID: \"ea6de858-62ec-4cbd-900b-9b88b475377c\") "
Jul 20 20:17:57.377572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.377542    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961313312_ea6de858-62ec-4cbd-900b-9b88b475377c/test-curl-7441-140361961313312/0.log"
Jul 20 20:17:57.378855 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.378836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x" (OuterVolumeSpecName: "kube-api-access-khw9x") pod "ea6de858-62ec-4cbd-900b-9b88b475377c" (UID: "ea6de858-62ec-4cbd-900b-9b88b475377c"). InnerVolumeSpecName "kube-api-access-khw9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:17:57.398997 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.398972    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:57.402826 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.402804    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:57.478341 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.478265    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khw9x\" (UniqueName: \"kubernetes.io/projected/ea6de858-62ec-4cbd-900b-9b88b475377c-kube-api-access-khw9x\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:17:57.529397 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529361    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:57.529778 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529744    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6de858-62ec-4cbd-900b-9b88b475377c" containerName="test-curl-7441-140361961313312"
Jul 20 20:17:57.529868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529776    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6de858-62ec-4cbd-900b-9b88b475377c" containerName="test-curl-7441-140361961313312"
Jul 20 20:17:57.529868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529796    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdde1891-f086-4cbc-b743-a652b4d13b3f" containerName="main"
Jul 20 20:17:57.529868 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529803    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdde1891-f086-4cbc-b743-a652b4d13b3f" containerName="main"
Jul 20 20:17:57.530017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529901    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdde1891-f086-4cbc-b743-a652b4d13b3f" containerName="main"
Jul 20 20:17:57.530017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.529917    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea6de858-62ec-4cbd-900b-9b88b475377c" containerName="test-curl-7441-140361961313312"
Jul 20 20:17:57.532864 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.532844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.539288 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.539261    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:57.553117 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.553084    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdde1891-f086-4cbc-b743-a652b4d13b3f" path="/var/lib/kubelet/pods/cdde1891-f086-4cbc-b743-a652b4d13b3f/volumes"
Jul 20 20:17:57.553428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.553410    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea6de858-62ec-4cbd-900b-9b88b475377c" path="/var/lib/kubelet/pods/ea6de858-62ec-4cbd-900b-9b88b475377c/volumes"
Jul 20 20:17:57.579017 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.578990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfvkx\" (UniqueName: \"kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx\") pod \"test-curl-7441-140361961313312\" (UID: \"f37d15d8-2de1-4847-a7fa-6efe33ec56b4\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.679561 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.679517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfvkx\" (UniqueName: \"kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx\") pod \"test-curl-7441-140361961313312\" (UID: \"f37d15d8-2de1-4847-a7fa-6efe33ec56b4\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.688612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.688582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfvkx\" (UniqueName: \"kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx\") pod \"test-curl-7441-140361961313312\" (UID: \"f37d15d8-2de1-4847-a7fa-6efe33ec56b4\") " pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.842368 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.842276    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:57.968124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:57.968092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:17:57.972198 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:17:57.972167    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf37d15d8_2de1_4847_a7fa_6efe33ec56b4.slice/crio-a7da31993e79bb6ed0120fd15eaa63484b429b4dc0b9cd7055fdd582e28b55b1 WatchSource:0}: Error finding container a7da31993e79bb6ed0120fd15eaa63484b429b4dc0b9cd7055fdd582e28b55b1: Status 404 returned error can't find the container with id a7da31993e79bb6ed0120fd15eaa63484b429b4dc0b9cd7055fdd582e28b55b1
Jul 20 20:17:58.230471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:58.230443    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:17:58.230471 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:58.230456    2571 scope.go:117] "RemoveContainer" containerID="5ab80b6437f3e54e680f802968628d54aba161ef9f6743a2bb13106bf4bbb606"
Jul 20 20:17:58.231794 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:58.231720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961313312" event={"ID":"f37d15d8-2de1-4847-a7fa-6efe33ec56b4","Type":"ContainerStarted","Data":"a7da31993e79bb6ed0120fd15eaa63484b429b4dc0b9cd7055fdd582e28b55b1"}
Jul 20 20:17:59.238078 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:59.238040    2571 generic.go:356] "Generic (PLEG): container finished" podID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" containerID="3996ca1b83b1a7b045f3f21f333de4895e94bf2e567ab80bc3ce96b26456037d" exitCode=0
Jul 20 20:17:59.238463 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:17:59.238127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-140361961313312" event={"ID":"f37d15d8-2de1-4847-a7fa-6efe33ec56b4","Type":"ContainerDied","Data":"3996ca1b83b1a7b045f3f21f333de4895e94bf2e567ab80bc3ce96b26456037d"}
Jul 20 20:18:00.366877 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.366853    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:18:00.388775 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.388731    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7441-140361961313312_f37d15d8-2de1-4847-a7fa-6efe33ec56b4/test-curl-7441-140361961313312/0.log"
Jul 20 20:18:00.404063 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.404038    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfvkx\" (UniqueName: \"kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx\") pod \"f37d15d8-2de1-4847-a7fa-6efe33ec56b4\" (UID: \"f37d15d8-2de1-4847-a7fa-6efe33ec56b4\") "
Jul 20 20:18:00.406132 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.406109    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx" (OuterVolumeSpecName: "kube-api-access-bfvkx") pod "f37d15d8-2de1-4847-a7fa-6efe33ec56b4" (UID: "f37d15d8-2de1-4847-a7fa-6efe33ec56b4"). InnerVolumeSpecName "kube-api-access-bfvkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:18:00.413016 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.412991    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:18:00.414559 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.414538    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-140361961313312"]
Jul 20 20:18:00.505531 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.505450    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfvkx\" (UniqueName: \"kubernetes.io/projected/f37d15d8-2de1-4847-a7fa-6efe33ec56b4-kube-api-access-bfvkx\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:00.653048 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.653011    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"]
Jul 20 20:18:00.653365 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.653354    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" containerName="test-curl-7441-140361961313312"
Jul 20 20:18:00.653411 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.653367    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" containerName="test-curl-7441-140361961313312"
Jul 20 20:18:00.653443 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.653416    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" containerName="test-curl-7441-140361961313312"
Jul 20 20:18:00.656348 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.656332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:00.659062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.659041    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:18:00.668530 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.668503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"]
Jul 20 20:18:00.707194 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.707164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz\" (UID: \"967df663-9959-455b-8239-72f88b7a8e36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:00.808415 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.808330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz\" (UID: \"967df663-9959-455b-8239-72f88b7a8e36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:00.809015 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.808994    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz\" (UID: \"967df663-9959-455b-8239-72f88b7a8e36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:00.966472 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:00.966437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:01.121331 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.121304    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"]
Jul 20 20:18:01.123846 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:18:01.123819    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967df663_9959_455b_8239_72f88b7a8e36.slice/crio-b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e WatchSource:0}: Error finding container b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e: Status 404 returned error can't find the container with id b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e
Jul 20 20:18:01.248293 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.248263    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:18:01.248460 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.248262    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7da31993e79bb6ed0120fd15eaa63484b429b4dc0b9cd7055fdd582e28b55b1"
Jul 20 20:18:01.249686 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.249650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz" event={"ID":"967df663-9959-455b-8239-72f88b7a8e36","Type":"ContainerStarted","Data":"b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e"}
Jul 20 20:18:01.258562 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:18:01.258532    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-140361961313312\" is forbidden: User \"system:node:ip-10-0-132-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-45.ec2.internal' and this object" podUID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" pod="opendatahub/test-curl-7441-140361961313312"
Jul 20 20:18:01.339139 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.339063    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:01.439612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.439586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:01.547813 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:01.547778    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37d15d8-2de1-4847-a7fa-6efe33ec56b4" path="/var/lib/kubelet/pods/f37d15d8-2de1-4847-a7fa-6efe33ec56b4/volumes"
Jul 20 20:18:02.256245 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:02.256212    2571 generic.go:356] "Generic (PLEG): container finished" podID="967df663-9959-455b-8239-72f88b7a8e36" containerID="d8643c260254af4db52db7808d60d14822e8937421a1b57ad355007f451abe59" exitCode=0
Jul 20 20:18:02.256419 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:02.256252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz" event={"ID":"967df663-9959-455b-8239-72f88b7a8e36","Type":"ContainerDied","Data":"d8643c260254af4db52db7808d60d14822e8937421a1b57ad355007f451abe59"}
Jul 20 20:18:03.384895 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:03.384868    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:03.429927 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:03.429890    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca\") pod \"967df663-9959-455b-8239-72f88b7a8e36\" (UID: \"967df663-9959-455b-8239-72f88b7a8e36\") "
Jul 20 20:18:03.430398 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:03.430376    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "967df663-9959-455b-8239-72f88b7a8e36" (UID: "967df663-9959-455b-8239-72f88b7a8e36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:18:03.530800 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:03.530690    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/967df663-9959-455b-8239-72f88b7a8e36-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:04.267275 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:04.267243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz" event={"ID":"967df663-9959-455b-8239-72f88b7a8e36","Type":"ContainerDied","Data":"b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e"}
Jul 20 20:18:04.267275 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:04.267258    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"
Jul 20 20:18:04.267481 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:04.267293    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4acf23592554b49a0466e7b87ef1066ba6f8e5b564349d4e3a057e612dd0e0e"
Jul 20 20:18:11.141814 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.141777    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:18:11.142202 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.141988    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" podUID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" containerName="maas-api" containerID="cri-o://b69576655bb5c913e48120f1b85aa4a631243468d469db3d290367f7c815dc83" gracePeriod=30
Jul 20 20:18:11.159336 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.159311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:11.165292 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.165271    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"]
Jul 20 20:18:11.174254 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.174232    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9305d0-29742975-lk2f7"]
Jul 20 20:18:11.300681 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.300647    2571 generic.go:356] "Generic (PLEG): container finished" podID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" containerID="b69576655bb5c913e48120f1b85aa4a631243468d469db3d290367f7c815dc83" exitCode=0
Jul 20 20:18:11.300845 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.300714    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" event={"ID":"c9cfae1f-b496-4883-b822-2ba8b35f4be6","Type":"ContainerDied","Data":"b69576655bb5c913e48120f1b85aa4a631243468d469db3d290367f7c815dc83"}
Jul 20 20:18:11.390340 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.390318    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:18:11.500124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.500095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca\") pod \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") "
Jul 20 20:18:11.500284 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.500138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") pod \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") "
Jul 20 20:18:11.500284 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.500173    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxx5f\" (UniqueName: \"kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f\") pod \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\" (UID: \"c9cfae1f-b496-4883-b822-2ba8b35f4be6\") "
Jul 20 20:18:11.500450 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.500427    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9cfae1f-b496-4883-b822-2ba8b35f4be6" (UID: "c9cfae1f-b496-4883-b822-2ba8b35f4be6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:18:11.502315 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.502284    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9cfae1f-b496-4883-b822-2ba8b35f4be6" (UID: "c9cfae1f-b496-4883-b822-2ba8b35f4be6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:18:11.502315 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.502297    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f" (OuterVolumeSpecName: "kube-api-access-vxx5f") pod "c9cfae1f-b496-4883-b822-2ba8b35f4be6" (UID: "c9cfae1f-b496-4883-b822-2ba8b35f4be6"). InnerVolumeSpecName "kube-api-access-vxx5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:18:11.548572 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.548542    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f5e287a-71a4-41cd-98b1-1472e1a083cf" path="/var/lib/kubelet/pods/8f5e287a-71a4-41cd-98b1-1472e1a083cf/volumes"
Jul 20 20:18:11.604097 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.604060    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9cfae1f-b496-4883-b822-2ba8b35f4be6-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:11.604335 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.604318    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9cfae1f-b496-4883-b822-2ba8b35f4be6-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:11.604434 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:11.604421    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxx5f\" (UniqueName: \"kubernetes.io/projected/c9cfae1f-b496-4883-b822-2ba8b35f4be6-kube-api-access-vxx5f\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:12.306374 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:12.306342    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"
Jul 20 20:18:12.306374 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:12.306359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg" event={"ID":"c9cfae1f-b496-4883-b822-2ba8b35f4be6","Type":"ContainerDied","Data":"e3c93ec3d003a1d5051f0b981241a8c7b92ccc0814d7e4c8b6eb7ff074ffa645"}
Jul 20 20:18:12.306891 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:12.306442    2571 scope.go:117] "RemoveContainer" containerID="b69576655bb5c913e48120f1b85aa4a631243468d469db3d290367f7c815dc83"
Jul 20 20:18:12.324055 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:12.324030    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:18:12.329711 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:12.329689    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9305d0-c996cb444-l92gg"]
Jul 20 20:18:13.547170 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:13.547139    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" path="/var/lib/kubelet/pods/c9cfae1f-b496-4883-b822-2ba8b35f4be6/volumes"
Jul 20 20:18:15.704832 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:15.704791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:15.725191 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:15.725155    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"]
Jul 20 20:18:15.727499 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:15.727475    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9305d0-57pbz"]
Jul 20 20:18:16.134226 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:16.134191    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:17.549160 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:17.549124    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967df663-9959-455b-8239-72f88b7a8e36" path="/var/lib/kubelet/pods/967df663-9959-455b-8239-72f88b7a8e36/volumes"
Jul 20 20:18:22.403423 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:22.403383    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:22.477669 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:22.477638    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:22.686247 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:22.686163    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:22.922410 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:22.922374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:23.058661 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.058628    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"]
Jul 20 20:18:23.059025 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059010    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" containerName="maas-api"
Jul 20 20:18:23.059087 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059027    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" containerName="maas-api"
Jul 20 20:18:23.059087 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059036    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967df663-9959-455b-8239-72f88b7a8e36" containerName="revoke-keys"
Jul 20 20:18:23.059087 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059042    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="967df663-9959-455b-8239-72f88b7a8e36" containerName="revoke-keys"
Jul 20 20:18:23.059193 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059110    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="967df663-9959-455b-8239-72f88b7a8e36" containerName="revoke-keys"
Jul 20 20:18:23.059193 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.059119    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cfae1f-b496-4883-b822-2ba8b35f4be6" containerName="maas-api"
Jul 20 20:18:23.062096 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.062076    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:23.064724 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.064702    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vkw2j\""
Jul 20 20:18:23.069376 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.069340    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"]
Jul 20 20:18:23.213139 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.213104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq\" (UID: \"5104a54d-56b9-47ae-919a-4c01196f98be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:23.313690 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.313608    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq\" (UID: \"5104a54d-56b9-47ae-919a-4c01196f98be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:23.314247 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.314227    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq\" (UID: \"5104a54d-56b9-47ae-919a-4c01196f98be\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:23.373846 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.373814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:23.509185 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.509152    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"]
Jul 20 20:18:23.511825 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:18:23.511797    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5104a54d_56b9_47ae_919a_4c01196f98be.slice/crio-47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d WatchSource:0}: Error finding container 47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d: Status 404 returned error can't find the container with id 47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d
Jul 20 20:18:23.619866 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.619736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:23.725014 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:23.724965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:24.365167 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:24.365130    2571 generic.go:356] "Generic (PLEG): container finished" podID="5104a54d-56b9-47ae-919a-4c01196f98be" containerID="3cf01483fccaab46a34c71916543e1afbde4618d94c6908f99ae0b4389b6f34d" exitCode=0
Jul 20 20:18:24.365358 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:24.365177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq" event={"ID":"5104a54d-56b9-47ae-919a-4c01196f98be","Type":"ContainerDied","Data":"3cf01483fccaab46a34c71916543e1afbde4618d94c6908f99ae0b4389b6f34d"}
Jul 20 20:18:24.365358 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:24.365244    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq" event={"ID":"5104a54d-56b9-47ae-919a-4c01196f98be","Type":"ContainerStarted","Data":"47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d"}
Jul 20 20:18:25.503703 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:25.503677    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:25.634969 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:25.634874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca\") pod \"5104a54d-56b9-47ae-919a-4c01196f98be\" (UID: \"5104a54d-56b9-47ae-919a-4c01196f98be\") "
Jul 20 20:18:25.635294 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:25.635270    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5104a54d-56b9-47ae-919a-4c01196f98be" (UID: "5104a54d-56b9-47ae-919a-4c01196f98be"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:18:25.735960 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:25.735930    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5104a54d-56b9-47ae-919a-4c01196f98be-maas-api-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:26.376506 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:26.376473    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"
Jul 20 20:18:26.376676 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:26.376512    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq" event={"ID":"5104a54d-56b9-47ae-919a-4c01196f98be","Type":"ContainerDied","Data":"47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d"}
Jul 20 20:18:26.376676 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:26.376558    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47f415fc4afcc6238302c42497412003b482084a7c1ac75cad85f1dd31fec34d"
Jul 20 20:18:33.643653 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.643570    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:18:33.644104 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.643836    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" podUID="1fc86eb8-2689-45cf-9620-df6be11bcc39" containerName="maas-api" containerID="cri-o://96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90" gracePeriod=30
Jul 20 20:18:33.696530 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.696493    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:33.697303 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.697282    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"]
Jul 20 20:18:33.700226 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.700199    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b02932-29742975-sfmmm"]
Jul 20 20:18:33.887607 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:33.887585    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:18:34.012244 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.012203    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") pod \"1fc86eb8-2689-45cf-9620-df6be11bcc39\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") "
Jul 20 20:18:34.012432 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.012268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzlzk\" (UniqueName: \"kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk\") pod \"1fc86eb8-2689-45cf-9620-df6be11bcc39\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") "
Jul 20 20:18:34.012432 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.012395    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca\") pod \"1fc86eb8-2689-45cf-9620-df6be11bcc39\" (UID: \"1fc86eb8-2689-45cf-9620-df6be11bcc39\") "
Jul 20 20:18:34.012780 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.012736    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1fc86eb8-2689-45cf-9620-df6be11bcc39" (UID: "1fc86eb8-2689-45cf-9620-df6be11bcc39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:18:34.014331 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.014305    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk" (OuterVolumeSpecName: "kube-api-access-rzlzk") pod "1fc86eb8-2689-45cf-9620-df6be11bcc39" (UID: "1fc86eb8-2689-45cf-9620-df6be11bcc39"). InnerVolumeSpecName "kube-api-access-rzlzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:18:34.014431 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.014323    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1fc86eb8-2689-45cf-9620-df6be11bcc39" (UID: "1fc86eb8-2689-45cf-9620-df6be11bcc39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:18:34.113428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.113390    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fc86eb8-2689-45cf-9620-df6be11bcc39-openshift-service-ca\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:34.113428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.113419    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fc86eb8-2689-45cf-9620-df6be11bcc39-maas-api-tls\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:34.113428 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.113431    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzlzk\" (UniqueName: \"kubernetes.io/projected/1fc86eb8-2689-45cf-9620-df6be11bcc39-kube-api-access-rzlzk\") on node \"ip-10-0-132-45.ec2.internal\" DevicePath \"\""
Jul 20 20:18:34.415373 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.415276    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fc86eb8-2689-45cf-9620-df6be11bcc39" containerID="96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90" exitCode=0
Jul 20 20:18:34.415373 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.415350    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"
Jul 20 20:18:34.415598 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.415365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" event={"ID":"1fc86eb8-2689-45cf-9620-df6be11bcc39","Type":"ContainerDied","Data":"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"}
Jul 20 20:18:34.415598 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.415448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh" event={"ID":"1fc86eb8-2689-45cf-9620-df6be11bcc39","Type":"ContainerDied","Data":"0975870c961986ddb59609596ed9918194522dfa3b45a0ec31d1de46948f519f"}
Jul 20 20:18:34.415598 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.415472    2571 scope.go:117] "RemoveContainer" containerID="96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"
Jul 20 20:18:34.424200 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.424184    2571 scope.go:117] "RemoveContainer" containerID="96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"
Jul 20 20:18:34.424476 ip-10-0-132-45 kubenswrapper[2571]: E0720 20:18:34.424457    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90\": container with ID starting with 96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90 not found: ID does not exist" containerID="96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"
Jul 20 20:18:34.424528 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.424485    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90"} err="failed to get container status \"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90\": rpc error: code = NotFound desc = could not find container \"96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90\": container with ID starting with 96f0cc918bd8815bea968511432b9b4ff8018bbc089887b0df2e7e23f0edba90 not found: ID does not exist"
Jul 20 20:18:34.443469 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.443441    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:18:34.446482 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:34.446461    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b02932-85646c5886-ljvlh"]
Jul 20 20:18:35.547346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:35.547309    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc86eb8-2689-45cf-9620-df6be11bcc39" path="/var/lib/kubelet/pods/1fc86eb8-2689-45cf-9620-df6be11bcc39/volumes"
Jul 20 20:18:35.547711 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:35.547587    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ba639a-efc4-4b5a-98c0-7724559fe379" path="/var/lib/kubelet/pods/c4ba639a-efc4-4b5a-98c0-7724559fe379/volumes"
Jul 20 20:18:38.166634 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:38.166598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:38.175093 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:38.175067    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"]
Jul 20 20:18:38.180018 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:38.179997    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b02932-vfjkq"]
Jul 20 20:18:38.587444 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:38.587411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:39.548374 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:39.548343    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5104a54d-56b9-47ae-919a-4c01196f98be" path="/var/lib/kubelet/pods/5104a54d-56b9-47ae-919a-4c01196f98be/volumes"
Jul 20 20:18:44.608106 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:44.608073    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:44.687935 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:44.687908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:44.983368 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:44.983336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:45.276342 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:45.276253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:51.839941 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:51.839905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb4b6b8f9-2smhk_ad015959-95c9-44b8-ad3e-cc975e0b009a/manager/0.log"
Jul 20 20:18:52.489753 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:52.489722    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859c78d9fd-vrrng_d8ccf39a-d936-4adc-84f8-d74f69396799/copy-manifests/0.log"
Jul 20 20:18:52.504305 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:52.504276    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859c78d9fd-vrrng_d8ccf39a-d936-4adc-84f8-d74f69396799/manager/0.log"
Jul 20 20:18:52.893371 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:52.893293    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b6fc7cbf7-rz4wb_027c0abd-5945-49b6-9d86-8df8059aeb9b/maas-api/0.log"
Jul 20 20:18:53.013664 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.013637    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742945-6vj2p_37080446-876b-464d-9733-9ced344e9b7f/cleanup/0.log"
Jul 20 20:18:53.130875 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.130847    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742960-md4l6_7dba2330-f48c-40da-acd5-db2b85e2938b/cleanup/0.log"
Jul 20 20:18:53.257148 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.257113    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742975-zkwjx_626fd30a-87e1-4403-8b4b-5650b5c21841/cleanup/0.log"
Jul 20 20:18:53.273514 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.273489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:53.375164 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.375135    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:18:53.381725 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:53.381699    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h56d4_8fed3257-1586-4eb5-b65f-b67a19866894/postgres/0.log"
Jul 20 20:18:56.433241 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:56.433201    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86d68bcf69-hmpsn_37703954-df9c-42b0-a5a4-862228ccfb47/kube-auth-proxy/0.log"
Jul 20 20:18:56.692781 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:56.692680    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gg799_078ecba6-afcb-4c42-85ec-df8fe862d064/payload-pre-processing/0.log"
Jul 20 20:18:57.327563 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:57.327532    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-d8mm8_4ede7652-e95b-4d06-a9bd-bec7cf73501c/main/0.log"
Jul 20 20:18:57.952636 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:18:57.952609    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-xjwhd_15c1363e-167b-4232-822c-cf051fc0b2d6/main/0.log"
Jul 20 20:19:03.470925 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.470893    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvcn6/must-gather-g8j6p"]
Jul 20 20:19:03.471319 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471228    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc86eb8-2689-45cf-9620-df6be11bcc39" containerName="maas-api"
Jul 20 20:19:03.471319 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471240    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc86eb8-2689-45cf-9620-df6be11bcc39" containerName="maas-api"
Jul 20 20:19:03.471319 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471248    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5104a54d-56b9-47ae-919a-4c01196f98be" containerName="revoke-keys"
Jul 20 20:19:03.471319 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471255    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5104a54d-56b9-47ae-919a-4c01196f98be" containerName="revoke-keys"
Jul 20 20:19:03.471319 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471320    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc86eb8-2689-45cf-9620-df6be11bcc39" containerName="maas-api"
Jul 20 20:19:03.471521 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.471327    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5104a54d-56b9-47ae-919a-4c01196f98be" containerName="revoke-keys"
Jul 20 20:19:03.474606 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.474586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.477459 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.477436    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvcn6\"/\"kube-root-ca.crt\""
Jul 20 20:19:03.477570 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.477495    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvcn6\"/\"openshift-service-ca.crt\""
Jul 20 20:19:03.478602 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.478588    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvcn6\"/\"default-dockercfg-66lh9\""
Jul 20 20:19:03.484657 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.484633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvcn6/must-gather-g8j6p"]
Jul 20 20:19:03.484845 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.484826    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:19:03.560233 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.560198    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f87c7e56-7615-4db9-8a6f-e525e348c329-must-gather-output\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.560416 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.560259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb59v\" (UniqueName: \"kubernetes.io/projected/f87c7e56-7615-4db9-8a6f-e525e348c329-kube-api-access-jb59v\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.585630 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.585604    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log" limit=1024
Jul 20 20:19:03.661278 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.661241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb59v\" (UniqueName: \"kubernetes.io/projected/f87c7e56-7615-4db9-8a6f-e525e348c329-kube-api-access-jb59v\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.661455 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.661404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f87c7e56-7615-4db9-8a6f-e525e348c329-must-gather-output\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.661855 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.661830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f87c7e56-7615-4db9-8a6f-e525e348c329-must-gather-output\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.670211 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.670182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb59v\" (UniqueName: \"kubernetes.io/projected/f87c7e56-7615-4db9-8a6f-e525e348c329-kube-api-access-jb59v\") pod \"must-gather-g8j6p\" (UID: \"f87c7e56-7615-4db9-8a6f-e525e348c329\") " pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.784587 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.784556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvcn6/must-gather-g8j6p"
Jul 20 20:19:03.932139 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:03.932112    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvcn6/must-gather-g8j6p"]
Jul 20 20:19:03.934751 ip-10-0-132-45 kubenswrapper[2571]: W0720 20:19:03.934725    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf87c7e56_7615_4db9_8a6f_e525e348c329.slice/crio-f4c7cb8d74badd454b9c2503b550ae341c6dfebadbedcf099a32d40d28c1c622 WatchSource:0}: Error finding container f4c7cb8d74badd454b9c2503b550ae341c6dfebadbedcf099a32d40d28c1c622: Status 404 returned error can't find the container with id f4c7cb8d74badd454b9c2503b550ae341c6dfebadbedcf099a32d40d28c1c622
Jul 20 20:19:04.560525 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:04.560488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvcn6/must-gather-g8j6p" event={"ID":"f87c7e56-7615-4db9-8a6f-e525e348c329","Type":"ContainerStarted","Data":"f4c7cb8d74badd454b9c2503b550ae341c6dfebadbedcf099a32d40d28c1c622"}
Jul 20 20:19:05.569927 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:05.569893    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvcn6/must-gather-g8j6p" event={"ID":"f87c7e56-7615-4db9-8a6f-e525e348c329","Type":"ContainerStarted","Data":"b4c79df64a92fd66902fb6cb66cf355bb0b74a79a900e26cbdcecffb1ff25fe6"}
Jul 20 20:19:05.570332 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:05.569947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvcn6/must-gather-g8j6p" event={"ID":"f87c7e56-7615-4db9-8a6f-e525e348c329","Type":"ContainerStarted","Data":"5e56bb4cb1ad3ebf7f15f69fa79d50850f3f3861c4bccdeab56dfeee7957144d"}
Jul 20 20:19:05.585257 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:05.585199    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvcn6/must-gather-g8j6p" podStartSLOduration=1.666004067 podStartE2EDuration="2.585172948s" totalImagesPullingTime="919.168881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:19:05.585008736 +0000 UTC m=+3087.687472086" watchObservedRunningTime="2026-07-20 20:19:05.585172948 +0000 UTC m=+3087.687636298"
Jul 20 20:19:06.512521 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:06.512491    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vqzt6_e67862db-568f-45d2-befa-cf4a9c34d52d/global-pull-secret-syncer/0.log"
Jul 20 20:19:06.567069 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:06.567032    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9pwlw_0d0a62dd-250a-42f3-abea-659b243bc562/konnectivity-agent/0.log"
Jul 20 20:19:06.727769 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:06.727706    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-45.ec2.internal_6fe68b5cb1b7fe1d6d7f652b5d9b720e/haproxy/0.log"
Jul 20 20:19:14.404128 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.403992    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nc827_d3a16e57-41b2-4a0b-8a2d-d56491328557/kube-state-metrics/0.log"
Jul 20 20:19:14.428442 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.428388    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nc827_d3a16e57-41b2-4a0b-8a2d-d56491328557/kube-rbac-proxy-main/0.log"
Jul 20 20:19:14.451644 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.451617    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nc827_d3a16e57-41b2-4a0b-8a2d-d56491328557/kube-rbac-proxy-self/0.log"
Jul 20 20:19:14.655625 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.655482    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jdpbs_da05813e-3bbf-4ae0-be66-6d243de98d22/node-exporter/0.log"
Jul 20 20:19:14.677913 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.677879    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jdpbs_da05813e-3bbf-4ae0-be66-6d243de98d22/kube-rbac-proxy/0.log"
Jul 20 20:19:14.701335 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.701294    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jdpbs_da05813e-3bbf-4ae0-be66-6d243de98d22/init-textfile/0.log"
Jul 20 20:19:14.907787 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.907689    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/prometheus/0.log"
Jul 20 20:19:14.934346 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.934310    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/config-reloader/0.log"
Jul 20 20:19:14.964417 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.964391    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/thanos-sidecar/0.log"
Jul 20 20:19:14.994411 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:14.994384    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/kube-rbac-proxy-web/0.log"
Jul 20 20:19:15.022073 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:15.022041    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/kube-rbac-proxy/0.log"
Jul 20 20:19:15.047270 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:15.047237    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/kube-rbac-proxy-thanos/0.log"
Jul 20 20:19:15.073614 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:15.073584    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea8d917e-015a-4ea9-8ccf-ec4312ae6dbd/init-config-reloader/0.log"
Jul 20 20:19:16.476632 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.476599    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"]
Jul 20 20:19:16.484412 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.484363    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.490133 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.490106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"]
Jul 20 20:19:16.592502 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.592403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-sys\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.592502 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.592441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-podres\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.592502 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.592459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-lib-modules\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.592843 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.592557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ffbn\" (UniqueName: \"kubernetes.io/projected/732a8b67-9efa-435f-8ef6-1357ff6cd9be-kube-api-access-2ffbn\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.592843 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.592605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-proc\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693450 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ffbn\" (UniqueName: \"kubernetes.io/projected/732a8b67-9efa-435f-8ef6-1357ff6cd9be-kube-api-access-2ffbn\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693450 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-proc\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693514    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-sys\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-sys\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693613    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-proc\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-podres\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693699 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-lib-modules\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693981 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-podres\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.693981 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.693820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/732a8b67-9efa-435f-8ef6-1357ff6cd9be-lib-modules\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.702612 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.702578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ffbn\" (UniqueName: \"kubernetes.io/projected/732a8b67-9efa-435f-8ef6-1357ff6cd9be-kube-api-access-2ffbn\") pod \"perf-node-gather-daemonset-l2vkz\" (UID: \"732a8b67-9efa-435f-8ef6-1357ff6cd9be\") " pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.798986 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.798672    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:16.972513 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:16.972434    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"]
Jul 20 20:19:17.654062 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:17.654015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz" event={"ID":"732a8b67-9efa-435f-8ef6-1357ff6cd9be","Type":"ContainerStarted","Data":"3c6e6fe760b8f9942df1459ddc8d38409c08605a7a0d5cbd8253351118181412"}
Jul 20 20:19:17.654619 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:17.654129    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz" event={"ID":"732a8b67-9efa-435f-8ef6-1357ff6cd9be","Type":"ContainerStarted","Data":"0deb8a5259fabc7e620cad6b6fca8ae048dd1ca5ab97045658ba0f70f5a3b3b8"}
Jul 20 20:19:17.654619 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:17.654351    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:17.673335 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:17.673272    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz" podStartSLOduration=1.673250739 podStartE2EDuration="1.673250739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:19:17.671770706 +0000 UTC m=+3099.774234050" watchObservedRunningTime="2026-07-20 20:19:17.673250739 +0000 UTC m=+3099.775714088"
Jul 20 20:19:19.515258 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:19.515220    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4hb8q_b21d7e38-fef6-485c-b588-7c8df2c1d367/dns/0.log"
Jul 20 20:19:19.536746 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:19.536708    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4hb8q_b21d7e38-fef6-485c-b588-7c8df2c1d367/kube-rbac-proxy/0.log"
Jul 20 20:19:19.688124 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:19.688092    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qr9f7_d790f871-1adb-4dd5-b33e-76eddb1a7e37/dns-node-resolver/0.log"
Jul 20 20:19:20.313565 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:20.313508    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpf7n_60abd88d-d838-4a64-9c73-7a8fcb293ba9/node-ca/0.log"
Jul 20 20:19:21.499961 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:21.499930    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86d68bcf69-hmpsn_37703954-df9c-42b0-a5a4-862228ccfb47/kube-auth-proxy/0.log"
Jul 20 20:19:21.593843 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:21.593814    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gg799_078ecba6-afcb-4c42-85ec-df8fe862d064/payload-pre-processing/0.log"
Jul 20 20:19:22.308739 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:22.308637    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84znv_58a81467-5bc1-4dca-8288-8fa508be8b12/serve-healthcheck-canary/0.log"
Jul 20 20:19:22.922655 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:22.922625    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmtzs_f818aad9-946f-43dc-89de-fd1f524c511a/kube-rbac-proxy/0.log"
Jul 20 20:19:22.945696 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:22.945667    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmtzs_f818aad9-946f-43dc-89de-fd1f524c511a/exporter/0.log"
Jul 20 20:19:22.968998 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:22.968964    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmtzs_f818aad9-946f-43dc-89de-fd1f524c511a/extractor/0.log"
Jul 20 20:19:23.669295 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:23.669256    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvcn6/perf-node-gather-daemonset-l2vkz"
Jul 20 20:19:25.807053 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:25.807008    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb4b6b8f9-2smhk_ad015959-95c9-44b8-ad3e-cc975e0b009a/manager/0.log"
Jul 20 20:19:26.141095 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:26.141005    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859c78d9fd-vrrng_d8ccf39a-d936-4adc-84f8-d74f69396799/manager/0.log"
Jul 20 20:19:26.162635 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:26.162605    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-859c78d9fd-vrrng_d8ccf39a-d936-4adc-84f8-d74f69396799/copy-manifests/0.log"
Jul 20 20:19:27.373478 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:27.373445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86d68bcf69-hmpsn_37703954-df9c-42b0-a5a4-862228ccfb47/kube-auth-proxy/0.log"
Jul 20 20:19:27.458627 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:27.458593    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gg799_078ecba6-afcb-4c42-85ec-df8fe862d064/payload-pre-processing/0.log"
Jul 20 20:19:27.500398 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:27.500371    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65bc99bbc8-m8mbc_820b4e3a-de7b-4d1c-b14d-a9eb11d8ba6c/manager/0.log"
Jul 20 20:19:28.920588 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:28.920549    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86d68bcf69-hmpsn_37703954-df9c-42b0-a5a4-862228ccfb47/kube-auth-proxy/0.log"
Jul 20 20:19:28.998541 ip-10-0-132-45 kubenswrapper[2571]: I0720 20:19:28.998513    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-gg799_078ecba6-afcb-4c42-85ec-df8fe862d064/payload-pre-processing/0.log"